LLMs Transform Mutation Testing for Compliance at Meta

The source from Engineering at Meta introduces the company's Automated Compliance Hardening (ACH) tool, which leverages Large Language Models (LLMs) to transform software testing and compliance adherence. Specifically, Meta explains how LLMs overcome the long-standing scalability and relevance issues that have plagued traditional mutation testing for decades. ACH works by using LLMs to generate highly realistic, problem-specific software faults (mutants) and then automatically creating tests guaranteed to catch those faults, which simplifies risk assessment and enables continuous compliance. Furthermore, the article highlights Meta's efforts to further explore the use of LLMs in testing through the Catching Just-in-Time Test (JiTTest) Challenge for the wider community. Overall, the text positions LLMs as a crucial development for making software testing more efficient, reliable, and scalable across large codebases like those at Meta. ============== Code content percentage: 0% Total text length: 16066 characters 🔗 Original article: https://engineering.fb.com/2025/09/30/security/llms-are-the-key-to-mutation-testing-and-better-compliance/ 📋 Monday item: https://omril321.monday.com/boards/3549832241/pulses/18111812758