LlamaIndex ‘legal-kb’: Agentic Retrieval over Index v2 with retrieve, find, read, and grep Tools — 2026-07-05

## Short Segments Open-source tools are transforming how enterprises handle PDF data, making structured extraction more accessible and cost-effective. Today, we'll explore how these tools are reshaping document processing, and later, we'll dive into LlamaIndex's innovative legal knowledge base that could redefine agentic retrieval. But first, let's look at the latest in PDF-to-JSON conversion. Structured PDF-to-JSON extraction is now a cornerstone of enterprise data management. With most enterprise data locked in PDFs and scans, converting this information into structured JSON is crucial for leveraging AI models. Open-source document extraction models have become the go-to solution, allowing businesses to perform these conversions on their own hardware, avoiding the high costs and privacy concerns of proprietary APIs. These models fall into two categories: schema-driven extraction, which fills predefined fields, and document parsing, which reconstructs documents into structured formats. Choosing the right approach is essential, as it can save significant time and resources. Open-source models like Datalab's Lift, which boasts a 90.2% field accuracy, are leading the charge, offering enterprises a reliable and private way to handle their document data. This shift towards open-source solutions is making data extraction more accessible and efficient for businesses worldwide. Junyang Lin, former lead of Alibaba's Qwen project, critiques hybrid thinking and advocates for agent-based AI systems. In a recent talk, Lin outlined the evolution of the Qwen model family, emphasizing a shift from traditional reasoning models to AI agents capable of planning and acting based on real-world feedback. Lin argues that the future of AI lies in systems that can think to act, rather than just think in isolation. This perspective marks a significant departure from the current focus on enhancing model reasoning capabilities. Lin's insights suggest a paradigm shift in AI development, where the emphasis will be on creating agents that can dynamically interact with their environment, potentially leading to more adaptable and intelligent systems. As Lin transitions to independent research, his ideas could influence the next wave of AI innovation, steering the industry towards more practical and interactive AI solutions. ## Feature Story LlamaIndex's new legal knowledge base, 'legal-kb,' introduces a groundbreaking approach to document retrieval with its agentic retrieval harness. This public reference application, available on GitHub, leverages LlamaIndex Index v2 to create a dynamic knowledge base for legal documents. Unlike traditional single-shot retrieval methods, 'legal-kb' employs a suite of filesystem-style tools that allow an agent to autonomously navigate and query a vast, evolving database. These tools include semantic and keyword search, regex grep, file search, and read operations, enabling more comprehensive and flexible data retrieval. The 'legal-kb' application is designed as a TanStack Start web app, where users can sign in, create projects, upload files, and interact with an agent that queries the indexed data in real-time. This setup not only automates the indexing process but also ensures that the data pipeline remains updated and accessible for ongoing queries. The retrieval harness's design mirrors familiar filesystem operations, making it intuitive for engineers to integrate into their existing workflows. By providing a persistent data pipeline and a set of generic tools, LlamaIndex allows users to plug the harness into their own agents, facilitating autonomous data exploration and task-solving. This development is particularly significant for enterprises dealing with complex, document-heavy processes, as it offers a reliable and automated solution for managing and retrieving large volumes of legal documents. As LlamaIndex continues to enhance its document-centric AI infrastructure, the 'legal-kb' project exemplifies the potential of agentic retrieval in transforming how businesses handle and utilize their data. Looking ahead, the integration of such advanced retrieval systems could redefine enterprise data management, making it more efficient and adaptable to the needs of modern businesses. For developers and enterprises alike, 'legal-kb' represents a step forward in creating more intelligent and autonomous AI systems capable of navigating complex information landscapes.