The meeting industry’s biggest dirty secret

Illustration of a group of people crowded around a table. Two people sit at the table, which holds a giant padlock.There are some things that the meeting industry doesn’t like to talk about in public. For example:

But the meeting industry’s biggest dirty secret is so embarrassing, we don’t even talk about it in private.

We make no attempt to discover (let alone evaluate) the long-term value of our meetings to attendees!

Before the event, we turn up our marketing to eleven, create FOMO, and do everything we can to get potential attendees to register. It’s going to be great!

During the event, we do our best to put on a heck of a show.

After the event? Crickets.

Once the event is over, it’s done. We barely look back; we’re on to the next one. Don’t look back! (You might not like what you see.)

This is fine for special events, which are primarily about creating an emotional experience and celebrating cultural rituals.

It’s not OK for any other kind of meeting.

Long-term meeting value for participants

Did the event have any significant long-term impact on the lives of the participants? Did anything significant change as a result? Or was the event effectively a short-term-feel-good, short-term-high-impact experiential blip?

If you think about it, this is shocking. We spend vast sums of money and consign umpteen person-hours to a meeting. And we have no idea whether it made any significant long-term difference to the people who attended it!

Notice I’m not concentrating on other meeting stakeholders here. Those who run meetings as a business can determine whether a meeting met their profit goals or not. Sponsors have metrics to help them decide if the event business booked, new connections made, and existing connections strengthened were worth the time and money expended. Even presenters, to some extent, can discover via feedback their audience impact and often find out whether their exposure led to future opportunities to speak or consult.

But long-term value to participants? We have no idea, because we don’t do anything to discover if there even was any, and, if there was, what it might be.

The invisible elephant in the room

Why do we ignore what I believe is the most important outcome of meetings from the attendee perspective: long-term change? After all, if you go to a meeting and nothing significant changes in your life as a result, what was the point of going?

I think we avoid talking about attendee long-term benefits from our meetings because we secretly know that most meetings do not lead to long-term change for most attendees. And we are embarrassed by this reality.

The meeting industry’s invisible elephant is that most meetings are incapable by design of producing significant long-term attendee benefits.

But, but … we do evaluate our meetings!

If you think that smile sheets dropped in a box at the end of a session, app-based evals, and online surveys that must be completed within a few days provide an accurate picture of the long-term benefits of a meeting, there’s a bridge I’d like to sell you.

Even if we include them (and we often don’t), short-term evaluations measure emotional impact, not long-term change and are unreliable[1, 2] measurements of event value. They tell us nothing about the impact of meeting attendance months later, when the stirring closing session story told by the motivational speaker that you thought was great at the time has been forgotten and, most likely, hasn’t changed your life or perspectives on it one bit.

OK, I hear you. So, if were brave enough to explore my event’s long-term impact, how would I do it?

How do we expose and face the meeting industry’s biggest dirty secret?

<soapbox>First of all, if you really want to create events that are maximally likely to provide long-term attendee value, you need to think about event designs that are likely to provide it! That’s why I design and facilitate meetings that meet participants’ actual wants and needs, rather than the traditional pre-determined, best-guess programs that, from my extensive experience, don’t.</soapbox>

Here are three tools that can be used to explore the long-term impact of an event.

Net Promoter Scores (NPS)

A time-delayed evaluation of conference and sessions’ Net Promoter Scores provides summary feedback about long-term value. (The link explains how NPS is calculated from respondents’ answers.) Use questions of the form:
“Considering the value you gained from Conference C/Session X, Y & Z, how likely is it that you would recommend Conference C/Session X, Y & Z to a friend or colleague?”

Adding an open-ended request for respondents to share their reasons for each rating will provide useful feedback on the value of a conference and its sessions.

A Letter To Myself

Set aside around 30 minutes just before the end of the event, supply each participant with notepaper and an envelope, and ask them to reflect on the changes they would like to make in their lives as a result of the event over the next [3 months/6 months/year/appropriate time period]. Attendees write letters to themselves about their changes and insert the letters into the supplied envelopes, which they then seal and address to themselves. The envelopes are collected and mailed out, unread, by the conference organizers once the announced time period has passed.

A Letter To Myself provides participants with a personal method to evaluate the long-term effect of an event, but meeting organizers remain in the dark unless participant responses to receiving their letters are shared back. That’s why I developed the following tool.

The Reminder

The Reminder is a more sophisticated version of A Letter To Myself that adds valuable long-term feedback to the conference organizers. See the link for full details.

Do it!

If you want to really know about the long-term value of your meetings to attendees, I’ve given you concrete things you can do to find out. I know it can be scary to ask these questions, because there’s usually that little voice in your mind that says, “Suppose I find out that what I’m doing really sucks? Then what?”

I’m here to tell you that the likelihood is very high that you will hear really good stuff about what you’re doing — and yes, there will be some unsettling responses too, because you can’t please everyone no matter what you do. Buried amongst the “not-so-great” responses will be nuggets of gold feedback you can use to improve your event for next time. Working on continuous improvement is increasingly important in the competitive world of meetings, and here are some implementation tools.

It’s your choice whether you use them or not.

Do you agree that not evaluating the long-term value of our meetings to attendees is the meeting industry’s biggest dirty secret? Do you have other suggestions for taking an honest look at what we’re providing to our meeting attendees? Please share your thoughts in the comments below!

Successful event outcomes, unusual web traffic, and the psychology of motivation

better event outcomes: Two Star Wars Lego stormtroopers doing gym exercises. Photo attribution: Flickr user chrish_99Understanding the psychology of motivation can help us create better event outcomes. I’ll illustrate with a story about unusual traffic on this very website…

The other day, I noticed a weird periodic surge of interest in one of my blog posts. Every January 1, page views for this post—but no other—spiked way up. They stayed high for 7 – 10 days. Then they went back to normal year-round levels.

It took some head-scratching before I finally realized what was going on. The article describes an obscure method for quickly deleting all emails on Apple devices—something Apple didn’t make easy until recently. Apparently, every January thousands of people all over the world stare at the 6,000 emails stuck on their iPhones. They resolve that this is the time they’re finally going to clean them up. So they Google “delete mail”, and find my highly ranked post (currently, out of 228 million results I’m #2). They click on it, and, voilà, lots of page views.

Well, lots of page views for a week or so. Then, what I call the New Year’s Resolutions Effect becomes…well, ineffective. People forget about their New Year’s resolutions and go on with their lives.

Why we are so poor at keeping resolutions

Why are we so poor at keeping resolutions? While scientific research into the psychology of motivation doesn’t currently offer a definitive explanation, there are some plausible theories. One of them, nicely explained by psychologist Tom Stafford, is proposed by George Ainslie in his book Breakdown of Will (read a forty-page “précis” here).

As Tom puts it:

“…our preferences are unstable and inconsistent, the product of a war between our competing impulses, good and bad, short and long-term. A New Year’s resolution could therefore be seen as an alliance between these competing motivations, and like any alliance, it can easily fall apart.
Tom Stafford, How to formulate a good resolution

And to make a long story short, he shares this consequence of Ainslie’s theory:

“…if you make a resolution, you should formulate it so that at every point in time it is absolutely clear whether you are sticking to it or not. The clear lines are arbitrary, but they help the truce between our competing interests hold.”

For years, I’ve used this observation to create better event outcomes. Here’s what I do.

If you’ve done a good job, by the close of your event participants will be fired up, ready to implement good ideas they’ve heard and seen. This is prime time for them to make resolutions to make changes in their professional lives. So how can we maximize the likelihood they will make good resolutions—and keep them?

A personal introspective

Close to the end of my events, I use a personal introspective to give every attendee an opportunity to explore changes they may want to make in their life and work as a result of their experiences during the conference. (For full details of how to hold a personal introspective, see my book The Power of Participation: Creating Conferences That Deliver Learning, Connection, Engagement, and Action.)

At the start of the personal introspective, each attendee writes down (privately) the changes they want to make. Before they do so, I explain a crucial question they will need to answer later in the process: “How will you know when these changes happen?” I give them several relevant examples of vague versus measurable goals and actions, like those below.

PI Goals and Actions 2

It turns out that including the question “How will you know when these changes happen?” and giving relevant examples beforehand is very important. If you don’t, I’ve learned that hardly anyone will come up with measurable resolutions that make it crystal clear whether you are succeeding or not.

Even with the directions and support, some people find it very difficult to come up with measurable, time-bound answers. This is one of the reasons why every personal introspective has a follow-up small group component. There, they can share and get help on their goals. But that’s material for another blog post.

Over the years I’ve received enough feedback about the effectiveness of personal introspectives to know they can be a powerful tool for better event outcomes. As predicted by the psychology of motivation, helping participants make specific, measurable, and time-bound resolutions that are easier to keep is a vital component.

Photo attribution: Flickr user chrish_99