LLMs in Indian languages: An insurmountable challenge?

Large language models (LLMs) generally do not work that well with non-English languages. But why is that the case? What does this mean for India, which has 22 languages recognised by the constitution and, according to different estimates, has total languages running into hundreds? How do we build and deploy LLMs for Indian languages? Should we even do so? Lokendra sits with Adya and Anwesha from the Takshashila Institution to discuss these pertinent issues. All Things Policy is a daily podcast on public policy brought to you by the Takshashila Institution, Bengaluru. The Takshashila Institution has designed the 'Technopolitik: A Technology Geopolitics Survey' to understand and assess what people think about how India should navigate high-tech geopolitics. Please take this 5-minute survey at the following link: ⁠⁠⁠⁠⁠⁠⁠https://bit.ly/technopolitik_survey⁠⁠⁠⁠⁠⁠⁠ Find out more on our research and other work here: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://takshashila.org.in/⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠...⁠⁠ Check out our public policy courses here: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://school.takshashila.org.in⁠⁠⁠