Impact Champions

If you want to measure the impact of your learning programs, start with reaction surveys.They're the most valuable learning metric you can collect for any course — no matter the subject, length, or audience. Best of all, they’re quick and easy to gather.We talk about:Why reaction surveys are critical for learning evaluationHow they fit into measuring training impactTips to start collecting them todayWhether you’re in L&D, eLearning, instructional design, or training management, this is the simplest and most effective way to begin tracking your learning outcomes.---About the Hosts and GuestsAndrew Bloye is the Managing Director of ClearXPDavid N. Johnson is the Chief Technology Officer of ClearXP---Brought to you byClearXP: Measure learning impact---Topics(00:00) Introduction to reaction surveys and why they're so important(01:04) When should you capture reaction surveys(03:15) Different ways to collect learner feedback(05:07) What are the right questions to ask?(06:59) Should rating scales include a neutral option? (09:13) The best timing for collecting feedback(10:34) How to analyse feedback results and why averages can be misleading(14:08) Tying survey results back to business impact(16:00) Summary and outro---ReferencesThe easiest and most effective way to start measuring learning impact

We get in the weeds with Chris Daniel, Senior LMS Strategist at Eastern Kentucky University. Chris co-founded EKU's instructional design master's program and is field faculty for the University of Kentucky.We talk about:Cognitive Load Theory and the importance of learning efficiencyUsing NASA's Task Load Index to measure learning efficiencyStarting with Catherine Sleezer's Needs Assessment prior to building trainingTips for engaging learners to drive learning completionsWhat AI can do now and where it could help in the futureYou can reach Chris at [email protected] or [email protected] to you byClearXP: Start measuring your learning impact---Topics(00:00) Introduction to Chris Daniel(00:58) How to measure learning efficiency using Cognitive Load Theory(03:15) Are narrative simulations more effective than text and image?(07:57) Why learning efficiency matters(10:45) Practical advice for measuring learning efficiency(13:20) Can Kirkpatrick Level 1 be used to evaluate effectiveness?(18:45) The role of Instructional Designers and challenges they face(21:30) Sleezer's Needs Analysis explained(25:40) How do we actually get people to do the training?(29:05) How AI is speeding up University faculty(32:04) Chris' vision for the future of AI agents(37:15) Kentucky vs Australia---ReferencesLearning From Media: Arguments, Analysis, and Evidence | Richard E. ClarkCognitive Load Measurement as a Means to Advance Cognitive Load Theory | Fred PaasA Practical Guide to Needs Assessment | Catherine M. Sleezer, Darlene F. Russ-Eft, Kavita GuptaMap It: The hands-on guide to strategic training design | Cathy MooreInstructional Illusions | Paul A. KirschnerAndrew Yang's Freedom Dividend Tax

Go inside Fulton Hogan’s massive upskilling wave as Learning & Capability Manager Luke Rogers shares how his team is training 11,000+ employees across New Zealand and Australia for a multi-year ERP rollout.You’ll see the blended learning playbook (targeted e-learning + hands-on workshops + live sandboxes), how Oracle Guided Learning powers “learning in the flow of work,” and the metrics that matter—attendance, pre/post confidence lifts, speed-to-competence, and support-desk deflection. We also unpack change management in a decentralized workforce and lessons learned (what worked, what didn’t—looking at you, misaligned gamification).Perfect for L&D leaders, change managers, ERP project teams, and operations leaders in construction & infrastructure.---About the Hosts and GuestsLuke Rogers is the Learning & Capability Manager for Fulton HoganAndrew Bloye is the Managing Director of ClearXPDavid N. Johnson is the Chief Technology Officer of ClearXP---In this Episode(0:00) Introduction & Meet the Guests, and about Fulton Hogan's ERP roll-out(4:50) The L&D approach to systems training at Fulton Hogan(8:45) How success is measured for ERP systems training(12:30) (Just some run-of-the-mill LMS bashing)(13:49) Gamification for knowledge assessments: did it work?(18:30) Retention and analytics for executives(21:10) How frontline training is delivered at Fulton Hogan(26:50) How the ERP pilot influenced the full roll-out(30:18) Measuring job performance against provided learning---ReferencedImpact Champions podcast on Gamification (literally the episode before this one)Oracle Guided Learning (OGL)

How do you use gamification effectively in your learning? In this episode of Impact Champs, we break down how to use gamification in corporate learning the right way.Learn when to use simulations, points, badges, leaderboards, and streaks; how to align rewards with learning outcomes (not vanity clicks); and how to measure real impact with analytics.Expect practical examples (Duolingo, Stack Overflow), tips to prevent “gaming the system,” and design ideas you can apply to your next learning module. Perfect for L&D leaders, instructional designers, and learning technologists looking to drive engagement and performance.Side-note: ClearXP makes gamification really easy.---About the Hosts and GuestsAndrew Bloye is the Managing Director of ClearXP and has built many rich, interactive learning programs for large corporate clients.David N. Johnson is the Chief Technology Officer of ClearXP---In this Episode(0:00) Introduction & Meet the Guests(1:30) What Is Gamification and why it's important(4:00) Gamification needs to align with expected learner behaviours(7:04) How do build simulations with effective reward mechanisms(13:30) Leaderboards: when they work well and when they don't(16:05) Can gamification in learning detract from productivity at work?(17:10) Badges: how to use them effectively(22:05) How social learning and recognition can improve learning effectiveness(23:35) Duolingo's use of gamification (especially streaks and leaderboards) to keep learners hooked(30:58) How Stack Overflow used gamification to become one of the largest Q&A sites on the web(38:20) When rewards become a perverse incentive(40:25) Summary of what we've learned and wrap up---ReferencedHow to hook 500M users: breaking down Duolingo’s gamification | Mary BorysovaReputation in Stack OverflowReputation Gaming in Stack Overflow | Iren Mazloomzadeh, Gias Udin, Foutse Khomh, Ashkan SamiImpacts of gamification on intrinsic motivation | Camilla Dahlstrøm, Norwegian University of Science and Technology

What if you could finally see the real impact of learning? In this episode of Impact Champions, Andrew, David, and special guest Julian Davis (founder of xAPI.com.au) unpack how xAPI (Experience API) is transforming the way organizations measure, track, and prove learning effectiveness.Discover what xAPI is, why it’s more powerful than SCORM, and how it’s being used across industries—from VR training to defense—to capture meaningful learning data. Expect real-world examples, expert insights, and practical advice for implementing xAPI to drive measurable learning impact.Learn more at xapi.com.au---About the Hosts and GuestsJulian Davis is a National Advisory Board Member for the Institute for Learning & Performance, Asia Pacific and founder of xapi.com.auAndrew Bloye is the Managing Director of ClearXPDavid N. Johnson is the Chief Technology Officer of ClearXP---In this Episode(0:00) Introduction & Meet the Guests(0:55) What Is xAPI and Why It Matters(5:33) Real-World Applications and Early Use Cases(12:22) Unlocking Powerful Data & Learning Analytics(19:50) Overcoming Challenges and Shifting Learning Mindsets(25:10 ) The Future of Learning: xAPI, AI, and Real Impact

We provide a brief introduction into measuring learning impact and what we're trying to achieve with this podcast. We talk about:Providing L&D professionals with practical advice on how to measure impactWhy it's important to connect training outcomes to business successHow learning metrics differ from Kirkpatrick evaluation levelsGive a brief overview of real world example of how to measure impact (increasing retention through onboarding)About the Hosts and GuestsAndrew Bloye is the Managing Director of ClearXPDavid N. Johnson is the Chief Technology Officer of ClearXPBrought to you byClearXP: Measure learning impactTopics(00:00) Introduction to Impact Champions(01:30) Who is this podcast for?(03:45) Why we need to focus on learning impact(05:30) Learning impact metrics vs Kirkpatrick(07:03) Real example: How to Improve Retention(09:15) How to get started measuring impactReferencesThe Kirkpatrick Model