Why switching to active learning is hard — and worth it

switching to active learning: a photograph of two students sitting next to each other in a classroom looking at a set of notes together. Image attribution: Inside Higher Ed & Kris Snibbe / Harvard UniversityA September 2019 research study published in the Proceedings of the National Academy of Sciences clearly illustrates why switching to active learning is hard — and worth it!

Lecturing has been the core modality in our education systems for centuries. Sadly it still is, even though we know that active learning provides superior quantity, quality, accuracy, and retention of knowledge. Active learning beats the pants off the “receiving knowledge” model drummed into our heads through years of listening to teachers. (For a full explanation of why active learning modalities are superior, see Chapter 4 of my book The Power of Participation.)

So why do we continue to use broadcast-style formats?

The NAS study gives us some important new information:

[M]ost college STEM instructors still choose traditional teaching methods…We find that students in the active classroom learn more, but they feel like they learn less. We show that this negative correlation is caused in part by the increased cognitive effort required during active learning.
Measuring actual learning versus feeling of learning in response to being actively engaged in the classroom, L Deslauriers, L S McCarty, K Miller, K Callaghan, and G Kestin

Let’s look at these three conclusions in the context of meeting design.

Most meeting presenters still lecture

The majority of college STEM teachers choose traditional teaching methods. And most meeting session presenters resort to lecturing as their dominant session modality.

Attendees learn more when presenters use active learning modalities

We have had research evidence for the effectiveness of active learning modalities for more than a hundred years. (The pioneer of memory retention research, Herman Ebbinghaus, published his seminal work in 1885.)

A large body of research over the last twenty years clearly shows the superiority of active over passive learning.

“Students learn more when they are actively engaged in the classroom than they do in a passive lecture environment. Extensive research supports this observation, especially in college-level science courses (1 2 3 4 5 6). Research also shows that active teaching strategies increase lecture attendance, engagement, and students’ acquisition of expert attitudes toward the discipline (3 7 8 9).

College students are the focus of this research. There’s no reason to believe that these conclusions would not apply to adult learning during meeting sessions.

Superstar lecturers and motivational speakers

Here’s a striking conclusion from the NAS research:

“Students in active classrooms learned more (as would be expected based on prior research), but their perception of learning, while positive, was lower than that of their peers in passive environments. This suggests that attempts to evaluate instruction based on students’ perceptions of learning could inadvertently promote inferior (passive) pedagogical methods. For instance, a superstar lecturer could create such a positive feeling of learning that students would choose those lectures over active learning.

Including highly paid keynote speakers at meetings is a meeting industry fixation. I’ve argued that the evaluations of such sessions are unreliable. Now, the NAS research buttresses my point, by providing an important explanation of why expensive keynote lectures are so popular at meetings. People perceive that they learn more from a smooth lecturer, while the reality is that they learn less!

Conclusion

There is overwhelming evidence that we can improve meetings by switching to active learning from passive lectures. And we now know that the popularity of fluent lectures, as measured by session evaluations, is based on an incorrect belief by attendees that they are learning more than they actually do.

Finally, the NAS report indicates that a simple intervention can overcome false perceptions about the efficacy of lectures.

“Near the beginning of a physics course that used… active learning …the instructor gave a 20-min presentation that started with a brief description of active learning and evidence for its effectiveness. …At the end of the semester, over 65% of students reported on a survey that their feelings about the effectiveness of active learning significantly improved over the course of the semester. A similar proportion (75%) of students reported that the intervention at the beginning of the semester helped them feel more favorably toward active learning during lectures.”

Consequently, we need to educate stakeholders, presenters, and meeting attendees about the benefits of active learning modalities at meetings.

Image attribution and the original inspiration for this post: Inside Higher Ed & Kris Snibbe / Harvard University

Thank you Stephanie West Allen for bringing the above research to my attention!

Something is rotten in the state of meeting industry education

Image of an actor declaring "Something is rotten in the state of meeting industry education" to a human skull in the palm of his hand

I hear increasing concern from the meeting professionals community about the deterioration of the quality of our national industry conferences. A thread on the MECO community (a great resource for meeting professionals since 2006) describes numerous recent basic logistical failings, and points to what I see as symptoms of fundamental problems with meeting industry associations at the national level.

In a nutshell, I think that our industry associations have become too focused on justifying their continued existence financially. They are neglecting their core mission of supporting and representing their members and association meeting attendees.

Meeting industry education

I’ll illustrate with the area where I have the most experience: providing education at these meetings. In my opinion (and many other event professionals with whom I’ve spoken) the “educational” content at the national meetings these days is sub-par. I suspect it’s because the processes for choosing it are seriously flawed and completely opaque.

I’ve lost count of the conference session proposals I’ve made to meeting industry associations. They wind through multiple months-long steps. And then, at the last possible moment, I receive a rejection with no explanation and a boilerplate request to submit more next year. Meanwhile, it’s clear from a review of industry conference programs that employees of sponsors or trade show exhibitors give large numbers of presentations. Also solicited/accepted are keynote/motivational speakers. These folks receive large fees and provide exciting presentations with, in my experience, little or no content of long-term value to the meeting attendees. (Think back to the big-name speakers you’ve listened to in the past. Be honest now, how many of them have changed your professional life in any significant way?) But their inclusion looks good on the promotional materials.

In my case, the demand for the meeting design and facilitation services I provide has been exploding. (In the first quarter of 2018, I’ve booked more business than all of 2017.) Most clients and meeting industry professionals have yet to experience how effective participant-driven, participation-rich design, and facilitation can radically improve their meetings for participants and stakeholders alike. So there’s plenty of work yet to do, and not enough people experienced enough to do it.

Our industry conferences are the obvious places to provide this education.

My contributions to meeting education are Participate! workshops. These provide experiences that significantly improve how the participants design their meetings. They are, in my opinion, fundamental education. They’re certainly on par with the sessions we see at the annual conferences every year on “hot event items”, F&B trends, and meeting management. Yet experiential meeting design is not acknowledged at meeting industry conferences as an overlooked fundamental competency that needs to be offered on a regular basis. Rather, it’s seen as a “hot topic” that can be covered once and subsequently ignored.

Pay presenters!

In addition, industry associations have essentially given up paying for professional education at their events. They prefer, it seems, to spend money on the big-name players I mentioned above. These days, someone like me is lucky to obtain event registration and expense reimbursement. (Let alone any kind of token fee for the hours it takes to design and prepare a great session.) This further biases session submissions in favor of sponsors and corporations who are attending the event anyway for marketing purposes.

Many other independent meeting professionals I know who love our industry, are great presenters, and have unparalleled expertise in important perennial meeting education areas have told me about similar rejections. Most of us have pretty much given up submitting sessions as a result.

Some may see what I’ve written as sour grapes. I’ll only add that I’ve been an educator of one kind or another for forty years. There’s a significant unmet need for what I and other experts do. And I’m frustrated that meeting associations, whose purported mission is serving our industry, stymie our offers to share our expertise with our fellow professionals.

Why meeting evaluations are unreliable and how we can improve them

meeting evaluations are unreliable: an illustration of a skeptical person receiving forms from the hands of many peopleTraditional meeting evaluations are unreliable. We obtain them within a few days of the session experience. All such short-term evaluations of a meeting or conference session possess a fatal flaw. They tell you nothing about the long-term effects of the session.

What is the purpose of a meeting? Excluding special events, which are about transitory celebrations and entertainment (nothing wrong with these, but not what I’m focusing on here), isn’t the core purpose of a meeting to create useful long-term change? Learning to apply productively in the future? Connections that last and reward? Communities that grow and develop new activities and purpose? These are the key valuable outcomes that meetings and conferences can and should produce.

Unfortunately, humans are poor objective evaluators of the enduring benefits of a session they have just experienced.

Why are we poor evaluators in the short term?

Probably the most significant reason for being poor evaluators in the short term is that we are far more likely to be influenced by our immediate emotional experience during a session than by the successful delivery of what eventually turn out to be long-term benefits. We like to think of ourselves as driven by rationality. But as Daniel Kahneman eloquently explains in Thinking, Fast and Slow we largely discount the effects that our emotions have on our beliefs. Information provided by lectures and speeches is mostly forgotten within a week. But the short-term emotional glow fanned by a skillful motivational speaker can last long enough for great marks on smile sheets. Paradoxically, the long-term learning that can result from well-designed experiential meeting sessions may not be consciously recognized for some time.

Other reasons why evaluations of conference sessions can be unreliable include quantifiable reason bias (the distortions that occur when attendees are asked to justify their evaluations) and evaluation environment bias (evaluations are influenced by the circumstances in which they’re made). These biases are minimal if we receive evaluations from the environment in which participants can implement hoped-for learning: i.e. back in the world of work. But instead—worried that no one will provide feedback if we wait too long—we supply evaluation sheets to fill out at the session or push evaluation reminders right away via a conference app.

How can we improve meeting evaluations?

Want meeting evaluations to reflect real-world long-term change? Then we need to use evaluation methods that allow participants to report on their meeting experiences’ long-term effects.

This is hard—much harder than asking for immediate impressions. Once away from the event, memories fade. Our professional lives center around our day-to-day work, and we are less open to refocusing on the past.

While I haven’t formulated a comprehensive approach to evaluating long-term change related to meetings, I think an effective long-term meeting evaluation should include the following activities:

  • Individual participants document perceived learning and change resolutions before the meeting ends.
  • Follow-up with participants after an appropriate time to determine whether their chosen changes have occurred.

In my next post, I’ll share a concrete example of one way to implement a long-term evaluation that incorporates these components.

Photo attribution: Flickr user jurgenappelo

How to make your workshop/meeting/conference middle-aged friendly

middle-aged friendly: photograph of a balding man trying to read a notice using a magnifying glass. Photo attribution: Flickr user philippeleroyer
At the wonderous Applied Improvisational Network 2015 World Conference (more posts coming soon!) I bumped into Doug Shaw, Professor of Mathematics at the University of Northern Iowa [not shown above; he is far better-looking] and he told me of an unpublished article he’d written on how to make conferences middle-aged friendly for people like him and me. Doug sent me a copy, I liked it, and he has given me permission to guest post it here…

Hello, my name is Doug. I went to my first conference in 1989. I was young then, and I believed in accessibility — everyone should be able to benefit from a conference. Never did I think that one day I would be the one who was having problems benefiting. But yes, I became middle-aged, and, well, I’m writing this article…

1) Memory

a. If there is a smallish group, quickly go around and say names. I’ve forgotten yours and I’m embarrassed.

b. Name tags are a boon. Actually, I’ve forgotten lots of names.

2) Vision

a. Think about your font size on handouts. Less than 12 pt is cruel. 16 point? You are a mensch. My eyes are in constant flux — I’m not used to wearing reading glasses, sometimes I don’t have them, and sometimes the prescription is out of date.

b. Dark text, light background. Blue on blue means you are a rotten human being.

c. I see better if there is strong light.

3) Hearing

a. If you aren’t able to speak so I can hear you, get a microphone. I hear better if there is no background noise, it is hard if there is. Hearing aids help if I can’t hear — but the problem is as you get old you still can hear, but you can’t filter out background noise as well.

4) Physicality

a. If part of your group participation involves standing up and sitting down… I can do that, but it hurts a bit. If you make me do it multiple times, I’m no longer going to be focusing on your points, I’m going to be anticipating/dreading having to stand up again.

b. I am fighting to change my diet, having lived 40 years eating badly. Go ahead and put out the cookies, but give me something else I can shove in my mouth, too.

5) Content

a. I’m not asking you to change a word of what you were going to say — but you should know that I’ve been to hundreds of these things, and I am a lot more cynical than I used to be. Clichés make me turn off to you. I know that people’s number one fear is not death, but public speaking. I know that the “jobs of tomorrow” are going to be different than the jobs of today. And I know we need to go beyond our comfort zones, think out of the box, adapt to an increasingly global society, etc. Did you know that the phrase “comfort zone” is lazy and comfortable, the phrase “think out of the box” is totally in the box, and that the 21st century is 1/7 over?

b. Motivational speeches don’t motivate me. Not because I’m a curmudgeon, but because I’m already motivated. I come to these things because I want to, not because I feel I have to. It takes more effort now — it means leaving people behind. So I’m motivated. If you spend a half hour with speakers trying to motivate me, that’s a half hour I’m getting impatient waiting for what I actually came for to start. Oh — and I’ve probably seen better motivational speakers than you are supplying. My favorite motivation is, “Hi. Welcome. Now here is the content you came to receive.”

6) Memory

a. If there is a smallish group, quickly go around and say names. I’ve forgotten yours and I’m embarrassed.

b. Name tags are a boon. Wait…did I cover this point already? Let me look at what I’ve written so far…where the hell did I put my glasses?

Do you have other ideas about how to make your events middle-aged friendly? Share them in the comments below!

Photo attribution: Flickr user philippeleroyer

Motivational speaker topic needs a good home!

Motivational speaker: photograph of a paper towel dispensing machine that includes the instruction "Pull with both hands"

Free! Toilet trained! Motivational speaker topic needs a good home!

Unique opportunity! Too many ideas to handle—this one MUST GO! Great potential for the right presenter! Good for a few minutes OR MORE of your inspirational message! Use it now, before someone else snaps it up!

No trained operators are standing by! This is clearly your Lucky Day!

Are you ready?

Wait…For…It…!

====> Pull With Both Hands! <====

So many angles available in a single four-word concept!

For example.

When you Pull with Both Hands:

  • Your effort is more powerful!
  • Two hands provide balance, one does not!
  • You model cooperation and teamwork!
  • You avoid failure! (Remember—the towel dispenser mechanism jams if only one hand used!)
  • There’s always an alternative! (Just turn the little thingy on the side!)

I’m sure a few moments of contemplation on your part will lead to many more!

No catch! Nothing to pay! No salesperson will call!

Yet another creative idea from the billions of tiny brain cells firing 24/7 at Conferences That Work!

P.S. Yes! I’ve incorporated a record number of exclamation marks into this post! The italics count isn’t too shabby either!

Thank you to the creative environment provided by the men’s bathroom at BATS, where this inspiration struck.