Episode 312 - IOA

IMPORTANT NOTICE: To earn CEUs for listening, you MUST sign up and listen to this episode on our website to get credit. To listen for the fun of learning? Just push play! Email us at [email protected] for further assistance. Watching treatment implementation is one of the key determinants behind whether great treatments lead to great results. But, deep down in our hearts, we all struggle to hit that magic 33% of sessions with greater than 80% agreement we all learned about in graduate school. But, what if interobserver agreement didn't have to be that. What if we were thinking about IOA all wrong? This week we brush up on some of the basics of IOA procedures like "How do I calculate IOA again?" before moving on to more interesting research in the field like training folks to take good IOA and questioning the standard wisdom of how much IOA is good enough. We'll be watching you! This episode is available for 1.0 LEARNING CEU. Articles discussed this episode: Hausman, N.L., Javed, N., Bednar, M.K., Guell, M., Schaller, E., Nevill, R.E., & Kahng, S. (2022). Interobserver agreement: A preliminary investigation into how much is enough? Journal of Applied Behavior Analysis, 55, 357-368. doi: 10.1002/jaba.811 Garrity, M.L., Luiselli, J.K., & McCollum, S.A. (2008). Effects of a supervisory intervention on assessment of interobserver agreement by educational service providers. Behavioral Interventions, 23, 105-112. doi: 10.1002/bin.258 Hartz, R.M., Gould, K., Harper, J.M., & Luiselli, J.K. (2020). Assessing interobserver agreement (IOA) with procedural integrity: Evaluation of training methods among classroom instructors. Child and Family Behavior Therapy, 43, 1-12. doi: 10.1080/00168890.2020.1848404