EPISODE · May 28, 2026 · 10 MIN
Ep 38 | Mudita Khurana - Rethinking how we evaluate security agents for real-world use | [un]prompted 2026
from [un]prompted Security Practitioner Con 2026 · host [un]prompted
Day 2 | Stage 1Staff Security Engineer from Airbnb addresses how security agents remain rooted in narrow, outcome-only benchmarks. These evaluations tell whether agent produced correct answer but not "how" or whether behavior remains stable once deployed. In practice, security is connected end-to-end workflow (find → confirm exploit → patch → validate loop). Introduces practical, capability-centric framework for evaluating security agents.Mudita Khurana is Staff Security Engineer, Airbnb.Watch on YouTube: https://www.youtube.com/watch?v=uImn7_dmeoY
What this episode covers
Day 2 | Stage 1Staff Security Engineer from Airbnb addresses how security agents remain rooted in narrow, outcome-only benchmarks. These evaluations tell whether agent produced correct answer but not "how" or whether behavior remains stable once deployed. In practice, security is connected end-to-end workflow (find → confirm exploit → patch → validate loop). Introduces practical, capability-centric framework for evaluating security agents.Mudita Khurana is Staff Security Engineer, Airbnb.Watch on YouTube: https://www.youtube.com/watch?v=uImn7_dmeoY
NOW PLAYING
Ep 38 | Mudita Khurana - Rethinking how we evaluate security agents for real-world use | [un]prompted 2026
No transcript for this episode yet
Similar Episodes
No similar episodes found.
Similar Podcasts
No similar podcasts found.