Skip to content
Adventures In Evaluation Podcast podcast artwork

PODCAST · business

Adventures In Evaluation Podcast

by James Coyle & Kylie Hutchinson

James Coyle and Kylie Hutchinson chat about topics, trends, and tips in the field of program evaluation. Relevant, practical, and always entertaining.

Publisher-supplied feed metadata · PodParley refreshed Mar 1, 2026 · Source feed

Episodes

  1. The Big Lebowski and Evaluation

    What does evaluation have to do with the movie The Big Lebowski? Well, the answer is "a lot" if you're up on this cult classic and number one favourite movie of James, aka "The Dude". Before you listen to this podcast we strongly suggest you view it first so you don't miss any of our keen…

    more
  2. The Future of Evaluation: A Chat With Michael Scriven

    This week we're thrilled to have Michael Scriven, frequently called "the father of evaluation", as our special guest. Michael chats about his chapter on "The Foundation and Future of Evaluation" in the new book, The Future of Evaluation in Society: A Tribute to Michael Scriven. Check it out here…

    more
  3. Western vs. Development Evaluation: Commonalties and Differences

    In this episode we explore some of the differences between typical Western-style evaluation and the monitoring & evaluation (M&E) that occurs in an international development context. To help us, we invited two guests with experience working in both areas, Ian C. Davies and Tom Pellens. Here are...

  4. Fun in Cameroon at AfrEA 2014 and The Quest for Exciting Journal Articles

    In this episode we present a mixed bag where Kylie debriefs her most excellent week at the African Evaluation Association 2014 conference and James takes us on his search for a "non-boring" evaluation journal article. Fun on the Conference Shuttle Bus Shout outs to Serge-Eric Yakeu Djiam…

    more
  5. New Year's Resolutions for Evaluators!

    Happy New Year Everyone!...okay...we're a little late with that...but we have a short new podcast! Many of us have personal New Year's resolutions, but what about professional ones? In this episode James and Kylie share their evaluation resolutions for 2014. Got some of your own? We'd love to…

    more
  6. Mobile Data Collection in Evaluation

    In this podcast we chat with Kerry Bruce, Director of Results and Measurement at PACT, and an all-round expert on the use of mobile technology for data collection. Here are a couple of resources: Kylie is curating a Pinterest Board of resources in Mobile Data Collection here. If you have any...

  7. Evaluation Rubrics with E. Jane Davidson

    Have you joined the rubrics revolution? In this podcast we chat with Jane Davidson of Real Evaluation about the use of rubrics in evaluation. If this piques your interest, we have a slew of resources for you: slides from the AEA 2013 conference on rubrics: Jane's Evaluation Rubrics: What, Why…

    more
  8. Reflections on AEA2013 in Washington, DC

    Couldn't make it to AEA2013? In this episode we share our own personal highlights of the conference. By the way: the Twitter hashtag for Michael Quinn Patton is #omgmqp. Sheila B. Robinson gives a great summary on her blog here. the evaluation typology map that Kylie mentions is here. Finally,...

  9. Sheila B. Robinson and AEA365

    This week we talk to Sheila B. Robinson about the great AEA365 Blog! cheers, Kylie and James

  10. Presenting Data Effectively: An Interview with Stephanie Evergreen

    Stephanie Evergreen's new book on data visualization came out yesterday, so we asked her to join us again on the podcast to give us some highlights plus her thoughts about the role and future of data visualization in evaluation. You can purchase a copy of the book here. See you at AEA! Kylie & James

  11. Anyone for a Horse Race?

    Anyone in the mood for a horse race? Today we tackle the issue of different and competing evaluation approaches, models, types, whatever you want to call them, plus the challenges of inconsistent terminology in our field. Here are the two articles we mention by Paul Duignan: Terminology in...

  12. Game Changers for Evaluation: A Chat with Hallie Preskill

    This week we're thrilled to have Hallie Preskill join us to give a shortened version of her keynote speech at CES2013 in Toronto. Here are links to some of her current work, plus the Developmental Evaluation graphic she mentioned: Evaluating Social Innovation Breakthroughs in Shared Measurement...

  13. The Changing Role of Evaluators: Reflections from the CES2103 Conference

    Are you a technical specialist, or a social change agent? Or as Dan Wilson at the Ontario Trillium Foundation says, "Are you part of the Rebel Alliance, or a Jedi Knight?" In this episode, we discuss the changing role of evaluators based on provocative keynotes from Hallie Preskill and John…

    more
  14. The Launch of the Evaluation Mentoring Canada Initiative

    In this episode Kylie interviews James and Jane Whynot about their super cool initiative, Evaluation Mentoring Canada. Check out the website, and sign up: http://evaluationmentoringcanada.ca/. Cheers, Kylie & James Kylie and her first mentor, Dr. Anita Myers, at CES2013.

  15. 2013 CES Conference Preview

    Hi Everyone, This week we've got Dawn Campbell-Borland and Dayna Albert as guests giving us a sneak preview into this year's CES conference in Toronto, June 9 - 12th. This year's theme is "Evaluation Across Boundaries". They have some great workshops, keynotes, and presentations lined up, so have…

    more
  16. The CES Evaluator Competencies: A Chat With Heather Buchanan

    In this episode we chat with Heather Buchanan, evaluation volunteer extraordinaire about the history, development, and use of the Canadian Evaluation Society's Competencies for Evaluation Practice. Here are some related links: Competencies for Evaluation Practice (detailed version) CES…

    more
  17. Making the Leap: Evaluation Consulting with Gail Barrington

    This week we chat with Gail Barrington, Evaluation Consultant and author of Consulting Start up & Management: A Guide for Evaluators & Applied Researchers. Plus, here's a great little AEA365 post about small-sized consulting. Cheers, James & Kylie

  18. Oh My God It's March: Dealing with March Madness

    It's March again, and evaluators everywhere are frantically racing to meet multiple deadlines. (In fact, Kylie almost forgot to post this episode herself.) Have a listen to James and Kylie discussing some of their techniques for dealing with March madness. How do you deal with it? Leave us your...

  19. Hey, Where Did My Stats Go?

    Some of us evaluators find ourselves using our stats straight away out of school, and for various reasons some of us don't. In this episode we discuss the different levels of use among evaluators and what is really acceptable in terms of statistical knowledge. Here's the link to Paul D. Ellis'...

  20. Humour and Evaluation

    This week we're pleased to have Chris Lysy, evaluation cartoonist, as our special guest. Chris talks with us about the use of humour in evaluation. To see more of Chris' evaluation funnies visit his website here. And here's a link to another example of humour in evaluation: Roger Miranda's Eva…

    more
  21. 'Soft' Skills for Evaluators: Facilitation and More

    This week we talk about facilitation and it's role as an essential skill for evaluators. Here are some of the resources we mention: book by Sam Kaner International Association of Facilitators Government of Canada's Centre for Intercultural Learning If you have buckets of money and want a skilled...

  22. 10 Things You Didn't Learn in Evaluator School

    Today we chat with evaluator Ann K. Emery about her recent AEA365 blog post for on "10 Things You Didn't Learn in School". Apologies up front for the poor sound quality in this particular episode while Kylie Skypes-in from Africa, and for her rambling after a hard day at work and several glasses…

    more
  23. Evaluation Proverbs, Prepping for Results, and Mobile Data Collection

    Hi folks, This week we again chat about a number of miscellaneous items including helpful proverbs for explaining evaluation in different cultures and mobile data collections. Here are the links to the West African Proverbs for evaluation and the 30 Ideas for Building a Culture of Evaluation. You...

  24. Everything but the Kitchen Sink

    In this episode Kylie and James debrief their respective weeks in evaluation and end up covering a multitude of subjects including re-discovering one's stats skills, evaluator objectivity, and reporting to senior execs. To see the Chris Lysy cartoon we reference click here. Here's an example of…

    more
  25. Budgeting for Evaluation

    Hi Everyone, In this episode we discuss budgeting for evaluation along with the following resources: WMU's Checklist for Developing & Evaluating Evaluation Budgets-by Jerry Horn The Pell Institute's Evaluation Toolkit Kellogg Foundation's Evaluation Handbook The Program Evaluation Standards F4 &…

    more
  26. AEA 2012 Conference Interviews & Debrief

    Neither James nor I were able to make this year's AEA conference :( ... so in this episode we chat with our most excellent reporters on the ground, Pat Mueller and Amy Germuth. You'll hear their personal highlights of the conference as well as the views of various attendees on what was hot and...

  27. Top Reasons Why We Like Being Evaluators

    This week, James and Kylie discuss why they love being evaluators, and have a big happy group hug. What are your reasons? Leave us a Comment below. cheers, James & Kylie

  28. Credentialing Evaluators: An American Perspective with Jean King

    This episode we speak with Jean King, Professor and Director of Graduate Studies in the Department of Organizational Leadership, Policy, and Development at the University of Minnesota, on the viability of credentialing in the United States. Here again is the link to the Canadian Evaluation...

  29. Seven Deadly Sins of Evaluation

    The name of this episode says it all. Have a listen and let us know what you think. By the way, here's the scene we mentioned from Barton Fink. Are we missing any sins? You can add them in the Comments box below. Cheers, Kylie & James

  30. AEA2012 Conference Preview with Susan Kistler

    Our special guest for this episode is Susan Kistler, Executive Director for the American Evaluation Association, who gives us a sneak preview into this year's upcoming conference (Oct. 22 - 27, 2012) as well as some tips for both newbies and the seasoned attendee. AEA2012 Conference Website…

    more
  31. Developmental Evaluation: Perspectives from an Internal vs. External Evaluator

    This week we're talking about doing Developmental Evaluation from the perspectives of both an internal (James) and external (Kylie) evaluator. We're also interesting in hearing what you think. Add your comments below. Here are some of the links James mentions: DE Diagnostic Checklist…

    more
  32. Desert Island Evaluation Resources

    In this episode we discuss our "desert island evaluation resources". These are resources we would want to have with us if we were stuck on a desert island and....uh...still doing evaluation. Here are links to some of the resources we mention: Books by Michael Quinn Patton EVALTALK Listserv…

    more
  33. AEA's Potent Presentations Initiative

    In this podcast we feature our first guest, Stephanie Evergreen, Data Visualization Diva and Director of the AEA's new Potent Presentations Initiative (P2i). As always, note that the views of our speakers do not necessarily represent their employers or clients. Here are some of the links that...

  34. Evaluation Reporting

    Hi Everyone! Here's our 2nd podcast in which we talk about the need for more effective evaluation reporting and some of ways to achieve this. Below are links to some of the resources we refer to during the podcast: Better Evaluation Reporting Pinterest Board Jane Davidson article Upcoming...

  35. Credentialing Evaluators: A Worthwhile Exercise?

    Welcome to our first full length podcast! In this podcast we discuss the Canadian Evaluation Society's Professional Designations Program and our experience with the process. For more information on the credentialing program check out the CES site: http://www.evaluationcanada.ca/site.cgi?en:5:6...

Type above to search every episode's transcript for a word or phrase. Matches are scoped to this podcast.

Searching…

We're indexing this podcast's transcripts for the first time — this can take a minute or two. We'll show results as soon as they're ready.

No matches for "" in this podcast's transcripts.

Showing of matches

No topics indexed yet for this podcast.

Loading reviews...

ABOUT THIS SHOW

James Coyle and Kylie Hutchinson chat about topics, trends, and tips in the field of program evaluation. Relevant, practical, and always entertaining.

HOSTED BY

James Coyle & Kylie Hutchinson

CATEGORIES

Frequently Asked Questions

How many episodes does Adventures In Evaluation Podcast have?

Adventures In Evaluation Podcast currently has 35 episodes available on PodParley. New episodes are automatically indexed when they're published to the podcast feed.

What is Adventures In Evaluation Podcast about?

James Coyle and Kylie Hutchinson chat about topics, trends, and tips in the field of program evaluation. Relevant, practical, and always entertaining.

How often does Adventures In Evaluation Podcast release new episodes?

Adventures In Evaluation Podcast has 35 episodes. Check the episode list to see recent publication dates and frequency.

Where can I listen to Adventures In Evaluation Podcast?

You can listen to Adventures In Evaluation Podcast on PodParley by clicking any episode. We provide an embedded audio player for direct listening, and you can also subscribe via your preferred podcast app using the RSS feed.

Who hosts Adventures In Evaluation Podcast?

Adventures In Evaluation Podcast is created and hosted by James Coyle & Kylie Hutchinson.
URL copied to clipboard!