How meeting professionals can measure and improve event ROI in a post-pandemic world

[My June 2021 guest post for BlueJeans by Verizon on event ROI.]Event ROI: Illustration with buildings in a cloud "raining" down dollar signs. Below them are people with arms crossed thinking about dollars surrounded by rotating circles.

What is event ROI?

Return On Investment (ROI) is such a familiar business concept that it’s easy to gloss over the complexities of defining it in the context of events. So let’s define event ROI in a little more detail.

Typically, ROI is thought of as a financial metric to evaluate the profitability of an investment. Some event stakeholders use ROI as a financial tool to evaluate the profitability of holding or attending an event. Others view it as a non-financial metric. For example, an academic invited to speak at a meeting might compare their investment of time and money spent attending with their expected return of increased status, easier access to colleagues, or greater likelihood of obtaining tenure.

Rather than spend more time delving into the complexities of defining event ROI (explore further at the Event ROI Institute), suffice it to say that event ROI is an intricate attempt to measure value for event stakeholders.

Who gets ROI at an event?

Events have multiple stakeholders. All events have owners, suppliers of services and products, and attendees. And there are often other stakeholders, such as associated organizations, exhibitors, employees, and volunteers.

Which stakeholders receive the event ROI?

Ideally, all of them!

For example:

  • Event owners expect to profit financially from the event, or its contribution to shareholder value, or its support of an organization’s mission.
  • Suppliers of services and products plan to make a financial profit from their investment of time and resources, and perhaps firm up additional profitable business too.
  • Exhibitors hope to gain new customers, maintain or strengthen existing business relationships, increase brand awareness, and promote their offerings to a wider audience, thus obtaining greater market share.
  • Attendees profit by learning about top-of-mind topics and issues of interest, getting their questions answered, building their knowledge peer network, and maintaining or increasing their status and visibility.

Notice that different event stakeholders think of ROI in very different ways. Successful win-win events provide attractive ROI for every stakeholder.

Event ROI and the pandemic

With the loss of most in-person meetings during the pandemic, stakeholders with tangible investments in face-to-face meetings have an ROI of zero. The meeting industry continues to reel under a wave of cancellations, postponements, and uncertainty.

Post-pandemic, potential event ROI is not significantly different from what it was before, except that the delivery models for meetings are going to be different. It seems likely that the mix will include:

  • Fewer in-person;
  • More online; and
  • More hybrid (in-person and online) meetings.

Considerations for event owners

Calculating post-pandemic ROI is especially difficult for event owners because it’s not clear yet:

  • What the mix of these three delivery models will be.
  • How eager people will be to attend in-person events.
  • Whether there are attractive ROI models for online exhibitors, who are typically significant revenue contributors to in-person meetings.
  • What will people be willing to pay for online attendance, compared to what they paid for pre-pandemic face-to-face meetings?

In addition, the meeting industry is still clarifying the production costs involved with larger online meetings. After a year of hasty learning how to produce online events that satisfy still indeterminate norms for event production quality and reliability, it’s still unclear what a typical online meeting will involve and cost for each of the different pre-pandemic meeting sectors.

Considerations for event supplies and attendees

Calculating post-pandemic ROI for suppliers and attendees is unlikely to be markedly different from what they did before. Attendees, of course, will now often have the option to attend online or in person. It will be interesting to see the choices people make. One clear trend has been the increase in attendance for meetings that have successfully transitioned to online from in-person. Larger audiences at such events may be a way to increase revenue (though at a lower cost-per-seat) over time.

How has the COVID-19 pandemic positively affected the meeting industry?

Yes, the coronavirus pandemic has had a terrible impact on the meeting industry. But, there’s a silver lining.

During the pandemic, online meetings replaced many in-person meetings. Producing and experiencing online meetings has been challenging. Yet stakeholders have discovered numerous positive aspects, including:

  • You’re instantly “there”. Travel expense and time is eliminated, with an associated sustainability bonus.
  • It’s become clear that many in-person meetings can be conducted just as effectively and successfully online. Meeting stakeholders now have much more experience as to when online can replace in-person meetings.
  • Participants’ increased familiarity and acceptance of online meetings have led to the rise of new ways of meeting for organizations. I’ve worked with clients who have replaced large in-person meetings of physically separated senior executives with more frequent, smaller, tightly targeted online meetings. These meetings have been so well received, that they will continue online post-pandemic.
  • Online meetings, which attendees can easily leave or ignore, have increased stakeholder awareness of the importance and value of using engaging, interactive meeting formats.

Event platforms for connection

The pressure to find comprehensive replacements for face-to-face meetings has sped the development of technology platforms that better support connection between participants. Pre-pandemic online platforms were designed to provide broadcast-style meeting formats. A host of new online platforms, like Gatherly, Wonder, and others, allow fluid, participant-driven connection much closer to that found in an in-person meeting social. These platforms provide the “hallway conversations” missing from larger platforms, like Zoom, BlueJeans, and Teams.

Finally, the pandemic has helped the meeting industry to better appreciate the unique advantages that pre-pandemic, in-person events could offer. The value of our human desire to meet in person, unfettered by masks and social distancing, has only been strengthened by its absence. The meeting industry will never be the same after this pandemic. But, thanks to it, we have all gained a heightened awareness of the importance of face-to-face meetings in our lives.

Improving event ROI

The COVID-19 pandemic has given the meeting industry and its customers a painful but potentially valuable opportunity to rethink events.

The most promising way to improve event ROI involves simple but fundamental changes to the processes and meeting formats we use at our meetings.

During the last decade, the meeting industry has become aware of the importance of providing meetings that are highly relevant, interactive, and engaging. In the past, once you induced attendees to attend an in-person meeting they became captives of the meeting program.  They were trapped in the middle of a row of seats during sessions that were often irrelevant/poorly presented/boring.

Over a year of online meetings with attendees routinely tuning out after a few minutes, has clearly shown the poor quality of the majority of traditional meeting sessions.

Improving meetings

Decades of experience show that you can improve all kinds of meetings, whether in-person or online, by designing them to:

  • Provide opening opportunities for participants to discover who else is present, what they want to discuss and learn about, and the collective expertise and experience that’s available to tap.
  • Include significant time for participant-driven sessions. In other words, the meeting provides a real-time structure for participants to choose what they want to discuss and learn, and then create sessions that meet those wants and needs.
  • Create and strengthen community throughout the meeting. Meetings are perhaps the most powerful ways to build community. This pays rich long-term dividends for everyone involved. Yet traditional meetings provide little if any explicit support for community building.

When participants are truly happy with the meetings they attend, all stakeholders benefit. The adoption of participant-driven and participation-rich meeting formats improves event ROI. Why? Because such events are better at satisfying stakeholders’ actual wants and needs. It’s not surprising that responsive and interactive event designs and sessions are steadily replacing the lecture-centric formats of many formerly webinar-style meetings.

Event ROI is likely to improve in other ways, of course. For example, as online meeting technology matures, production costs will likely drop, improving event owners’ bottom line. But I think the greatest (and easiest) improvements to event ROI involve adopting human process technologies that allow meetings to become what participants actually want and need.

Conversations => Relationships => Value (Part 2)

Conversations => Relationships => Value. A photograph of two conference attendees sitting on steps and talking to each other.

Conversations => Relationships => Value

In Part 1 of this post, I introduced this core component of Conference 2.0.

Here’s why this sequence is an important consideration for modern meeting design, and how it’s enhanced by Conference 2.0 designs.

Why should customers buy from you?

Sometimes, business value grows out of the barrel of a gun. When you have a monopoly on a product or service, you can charge as much as the market will bear. But when competition exists, you must use different strategies. For example, you can play race-to-the-bottom: squeezing your suppliers for rock bottom costs that, hopefully, are lower than your competitors. Or, you can differentiate what you offer in many other ways: better service, more options, faster delivery, longer warranties, superior customer support, etc. Thousands of books have been written about how to profitably and consistently market and sell. And, except perhaps for the most cutthroat commodity markets, the ability to build and maintain good relationships with your customers is a key component of most techniques.
This ability is even more crucial in today’s markets, because of four factors:

  • The increased complexity of products and services.
  • The increased variety of products and services.
  • The increased speed of product and service development.
  • The increased transparency in many marketplaces caused by online customer reviews and feedback.

The first three factors make it harder for potential customers to evaluate whether a specific product or service is a desirable fit for their needs. The last amplifies any deficiencies (perceived or otherwise) that may exist, any of which could prove fatal to sales.

In this new business environment, creating and maintaining good, trustworthy relationships with your customers becomes crucial.

Relationships are the new impressions

In the good old days, the more people heard about your product through broadcast marketing (impressions), the greater your sales. Today, business value, especially for non-commodity products and services, is becoming increasingly linked to the strength and quality of buyer-seller relationships. Traditional marketing can’t manufacture relationships, which are built through conversations between you and potential customers. Some of your conversations will turn into relationships, and some of those relationships will lead to value for your business.

Not all meetings are alike

Meetings provide wonderful opportunities for conversations. But, for two reasons, some meeting environments provide better opportunities than others.

First, for all but very small meetings, the number of conversations doesn’t scale with event size. For example, at a one-day, two-hundred-attendee event you can’t have more ten-minute conversations than you can with a hundred in attendance. In fact, at a large conference it’s often harder to find the people you really want to talk to than at a smaller, more focused event.

Second, Conference 1.0 sessions don’t foster conversations. Conversations only take place during breaks and socials. Compare this with Conference 2.0 designs, which excel at providing opportunities for relevant conversations

How Conference 2.0 designs support conversations

I’ve quoted Howard Givner before and I’ll quote him again. (Why? Because he made this highly positive remark about one of my conferences 😀.)

I easily established triple the number of new contacts, and formed stronger relationships with them, than at any other conference I’ve been to.

Why is Howard’s experience a common one at Conference 2.0? Let’s take Conferences That Work as an example. This conference design starts with initial roundtables that not only provide a structured forum for attendees to meet and learn about each other’s affiliations, interests, experience, and expertise but also effectively uncover the topics that people want to discuss and share. Within a couple of hours, every attendee has the initial introductions and information necessary to go out and start the right conversations about the right topics with the right people. Other Conference 2.0 designs encourage fruitful conversations by giving attendees the ability to meet around topics that they choose during the event.

The bottom line: Conference 2.0 formats routinely lead to more meaningful conversations, which in turn lead to more relationships, which in turn lead to more business value.

Does Conversations => Relationships => Value make sense to you?

Conversations → Relationships → Value Part 1

Conversations and relationships

I do not have a good reaction when someone talks about the return on investment (ROI) from attending an event.

My initial internal response is a rant:

Do we ask for the ROI when we buy tickets to a concert?

How can you evaluate the ROI for learning something new or seeing something in a new way?

And my favorite: So, what is the ROI on a wedding? (Please don’t respond with an analysis of the average value of wedding gifts versus the cost of the wedding. I’d probably argue diminished responsibility at the subsequent trial.)

Conversations Relationships Value part 1: a photograph of a large iced cake. The icing on the top shows the Mastercard logo and the word "Priceless".In some ways, my reaction is alarmingly similar to the message of the brilliant formula for the MasterCard advertisement:

[List of mundane items with $ assigned]
[Intangible item – Priceless!]

The delicious subtext: Forget the money, whip out the credit card, and go to the event anyway!

The morning after

OK, it’s strong black coffee time. Whether the benefits are intangible or concrete, we all know that some kind of calculation goes on when a potential attendee decides whether to attend an event. I’ve written about how existing event ROI methodologies are a noble attempt to quantify this calculation and give it as much respectability and logic as we can. So, enough on ROI; here’s a core component of Conference 2.0.

Conversations => Relationships => Value

In Part 2 of this post, I explain why this sequence is now an important driver of modern meeting design and how Conference 2.0 designs enhance it.

Photo attribution: Flickr user alanchan

How participant-driven events can improve event ROI

improve event ROI: photograph of a skeptical male boss with glasses and a white beard. Photo attribution: Flickr user andyi.“Why do you want to go to this conference?” is a question that a boss has probably asked you at some point. The real question is, of course, Is it worth the money and time invested in having you attend? It can be a hard question to answer. Especially when the event in question has no or few predetermined sessions, like the peer conferences I design and facilitate. So how can we measure and improve event ROI?

Improving Event ROI

Probably the most exhaustive methodology for planning and evaluating event ROI has been developed by Jack Phillips and Elling Hamso. It’s long and comprehensive, and here’s a summary of it.

According to this methodology, one of the components involved in evaluating Event ROI is the degree of Relationship Learning, which Elling defines as follows:

“Relationship learning refers to the building of affinity between people, getting to know others, trust and liking. All forms of peer learning benefit from the strength of personal relationships, it is the foundation for subsequent information, skills and attitude learning in the peer relationship. Relationship learning may be measured in much the same manner as other forms of learning. At the most detailed level, individual relationships of trust and liking, for example, may be scored on a scale from very low to very high, or more general reports of relationship learning may be collected.”

How peer conferences improve event ROI

Well, this is exactly the kind of learning experience at which peer conference designs like Conferences That Work excel! Here’s how Howard Givner described a peer conference he attended:

“…one of the most innovative and eye-opening professional experiences I’ve had. Aside from coming back with lots of new tips and ideas, I easily established triple the number of new contacts, and formed stronger relationships with them, than at any other conference I’ve been to.”
—Howard Givner article: The Un-Conference: Participant-Driven Agenda + Mashup Networking = Relationship Building on Steroids

Conversations, and subsequent relationships, are very important. Doc Searls, co-author of the Cluetrain Manifesto, wrote a great article about their pivotal role: Building a Relationship Economy. Well-designed peer conferences provide an environment that encourages and supports a rich abundance of the initial components of the following sequence:

Conversations => Relationships => Value

“Value” here means the kind of business worth your boss is thinking about. More prospects, new sales, increased customer satisfaction, etc. All the things that translate into funding for your paycheck, profit for your company, and a happy boss.

So, when your boss next asks you The Question about the participant-driven conference you want to attend, take a deep breath. Tell them you expect to make many more business relationships at this event than you would at a conventional conference. Relationships that will turn into solid business value for your organization. Communicate exactly why you want to go. Explain that participant-driven conferences improve event ROI because they are much better than traditional meetings at building sessions around the content that attendees actually want. Good luck!

Photo attribution: Flickr user andyi

Can we measure ROI in social media? – Part 2

ROI in SM part 1: a cartoon of a round medieval tower surrounded by a moat with a drawbridge. Three people are standing on the roof where a flag waves. The wall of the tower is covered with a white grid that holds numbers, like a spreadsheet.In my post Can we measure the ROI in social media? – Part 1 I argued that it’s pointless to try and calculate ROI in social media. If convinced you might ask, “In that case, how can I justify the allocation of resources towards social media marketing?”

Perhaps the following will help.

As I previously explained, the problem with applying classic ROI to SM marketing is we can’t quantify the Return monetarily. This is because we can’t tie increases in sales or profits directly to specific social media actions or programs. This inability blocks us from talking about ROI at all.

But wait—surely what we really want to do is to make decisions about allocating resources amongst different marketing channels? Since we need to market our products and services, the real question is how and where do we spend our marketing budget. Here’s David Meerman Scott again, emphasizing this point in his usual forthright fashion.

So why not use a slightly different metric, one that allows us to compare the effectiveness of different marketing channels in ways we can measure? Let’s call it the Relative Return On Investment (RROI). RROI sidesteps the problem of assigning a monetary value to Return. Instead, it concentrates on providing a practical comparison between investments allocated to specific marketing channels and our desirable and measurable marketing outcomes. (For example: increasing traffic to websites, new product suggestions, time spent on sites, active memberships, or brand mentions.) In effect, we’re replacing Return with the changes in concrete metrics that we believe are important to our marketing objectives. The units of RROI are then [change in metric] per unit of currency invested, e.g. an increase in daily page views per dollar, or a decrease in weekly customer support calls per euro.

Using RROI we can do experiments and make decisions about where we want to allocate marketing resources. Our experiments won’t be as precise as those possible in the past when only targeted audiences saw broadcast marketing. But by using tagged indicators of traffic origins and existing analytics we can probably get a good sense of the relative effectiveness of alternative marketing strategies. That’s useful.

Be aware that using RROI in this way won’t tell you how much you should invest in marketing. That can be answered by ROI analysis performed across potential profit opportunities available to a business. But if measuring ROI in social media is a fantasy, perhaps using RROI in its place is an honest reflection of what’s practically possible.

Is RROI a useful, relevant way to think about investments in social media? Or am I just blowing smoke? As always, your comments are welcome!

Can we measure ROI in social media? – Part 1

ROI in SM part 1: a cartoon of a round medieval tower surrounded by a moat with a drawbridge. Three people are standing on the roof where a flag waves. The wall of the tower is covered with a white grid that holds numbers, like a spreadsheet.

Can we measure ROI in social media?

When Samuel J Smith moved back to the U.S. from Switzerland he needed to buy some insurance and asked for a recommendation on Twitter. Having had car insurance with Progressive Insurance for a number of years, and liking the ease of accessing my policy and payments online as well as the competent Vermont representatives I worked with when dealing with several claims, I tweeted Sam this information.

Five minutes later, the following tweet from @Progressive appeared:

@ASegar Saw your tweet – we appreciate you spreading the word ; ) Glad you’ve had such a positive experience.

What can we say about the Return On Investment (ROI) for this little social media interaction?

Exploring ROI for social media

A quick Google search finds this article which explains how Progressive has monitored mentions on Twitter and other social media channels since 2008 and has a dedicated team in its call center that responds to reported customer service issues. Obviously, this initiative costs Progressive money, and the company surely knows how much. So Progressive knows the Investment part of ROI in cold, hard cash.

But what about the Return? Receiving the tweet tickled me! It increased my positive feelings about the company and the likelihood that I would recommend it to more friends and acquaintances. In addition, anyone looking at Progressive’s Twitter stream (which has ~80,000 followers) might see that I made a positive comment. But wait, there’s more! Now I’ve written a favorable blog post that will be read by more people (including you!), possibly influencing more purchases from the company in the future.

Clearly a small but classic social media success story for Progressive.

But can Progressive quantify the value of their tweet in dollars?

I don’t think so.

Why ROI for social media is suspect

ROI was originally a financial term. However, it’s become common to see it used in areas where there is no simple way to connect what happens with a financial value. We have no idea how much more likely I am to recommend Progressive because of their unexpected tweet. We don’t know how many other people will ever see or be influenced by the tweet, or how many people will be influenced by reading this blog post.

And yet, there are plenty of people writing about measuring ROI in social media.

For example, in February 2010, Brian Solis posted ROI: How to Measure Return on Investment in Social Media. This sounds like a how-to article, but Brian’s article just contains a lot of statistics that businesses have reported about their experiences, beliefs, and predictions about their use of social media, plus one (in my view, see below) weak example from Dell about its claims of increased sales through connecting with customers on Twitter. There’s no how-to, though Brian states that “2010 is the year that social media graduates from experimentation to strategic implementation with direct ties to specific measurable performance indicators.”

This doesn’t convince me. And I’ve got David Meerman Scott on my side. He once said “When someone asks me the ROI of social media, I respond with, ‘What’s the ROI of putting on your pants?'”

What is the Return?

The problem, as exemplified by the Progressive story above, is that the monetary Return on social media marketing cannot be tied directly to the efforts that are made. Now this is not true for many older forms of marketing. For example, it’s possible to test the effectiveness of mail campaigns by sending different coded promotions to randomly chosen subsets of a mailing list and analyzing the response rate. But because social media is, well, social we can’t do this kind of segmented marketing experiment!

To buy a computer from Dell, I decide what I want, go online, and look for a good deal. And that includes checking Dell’s Twitter stream. I do not follow Dell which convinces me to buy; I buy from them when I’m ready. Dell counting a sale to me through a Twitter promo as a Return on their investment in Twitter is not a justification for their investment in social media, because I would have bought from them anyway after finding a satisfactory deal on their website or over the phone. So for Dell to say, as quoted in Brian’s article, that “Dell’s global reach on Twitter has resulted in more than $6.5 million in revenue” is disingenuous at best. There’s no way the company can claim that a sale would not have occurred if it hadn’t been featured on Twitter.

Conclusions

So should we throw out the idea of calculating ROI in social media? No, not entirely. I think there’s a better way to think about what we are trying to do when attempting to decide where and how we expend time, effort, and resources on social media marketing. I’ll explain further in my next post.

Do you think you can measure the ROI in social media? I’d love to hear what you think!