FlowCheck: Helping End-Users Specify and Verify Intent in Vibe-Coded Web Apps — Vir et al. (2026)
from 1 More Paper (Brief)
Vibe-coded applications often contain silent behavioral failures in which the interface appears functional even though user-visible information does not flow to the expected state or output. We introduce FlowCheck, a constraint language to specify these user-visible information flows directly through the application interface, where constraints can also be displayed and inspected without reading code, and are structured enough for reliable LLM generation. FlowCheck translates the constraints into deterministic CodeQL analyses, and we evaluate it across four applications generated via Claude Code, and compare with three coding models as bug-finding baselines. We find that FlowCheck correctly translates and flags all 30 of our injected constraint violations with no false positives. In contrast, frontier models (Claude Opus 4.7, DeepSeek V3, and Gemini Pro) showed significantly lower accuracy when prompted to find bugs in the same code, with none achieving full accuracy. This approach lets vibe coders state intent in terms of the interface they understand, and checks it deterministically against the code they do not. This Brief reads the authors' abstract in the authors' own words. Abstract source: doi-metadata Authors: Reya Vir, Lydia Chilton, Zhuo Zhang, Eugene Wu Published in: arXiv Publication date: 2026-08-28 Read the paper Source license: Creative Commons Attribution 4.0 International Narration: Read verbatim by an AI-generated voice. The authors and publisher do not sponsor or endorse this recording. Full episode
Embed this episode
No transcript yet.