Jerry Liu - Building LlamaIndex, the Data Framework for LLMs

Jerry Liu is the co-founder and creator of LlamaIndex (formerly known as GPT-Index), an interface that allows users to connect their data to LLM’s such as Chat-GPT. He has a B.S. in Computer Science from Princeton and has worked at companies such as Quora, Uber, and Robust Intelligence prior to starting LlamaIndex. Host: David Wu Twitter: @davidjhwu Audio Producer: Aaron Schumacher LinkedIn: Aaron Schumacher Video Editor + Art: Saurin Kantesaria Instagram: saorange314 Social Media: Nikhil Kapur Time Stamps: 01:25 The path to starting LlamaIndex + initial ideas 07:09 LLMs like Chat-GPT vs traditional machine learning 10:00 4 steps of traditional machine learning 10:45 How do large LLMs change the game? 14:11 How does LlamaIndex help LLMs work with unstructured data? 18:08 How do you work with gigabytes of private data? 19:57 Organizing words and paragraphs by topic with embeddings 24:55 The importance of structuring data 26:00 3 key abstractions in LlamaIndex 29:25 Medical use cases for LlamaIndex 31:29 Increasing efficiency in medicine 33:25 An AI medical Research Assistant (Insight) 34:31 Other methods of connecting LLMs to data 36:55 What is langchain? 39:56 What work in the AI and LLM space excites you the most? 42:23 Do you ever feel scared about the developments of AI? 43:45 Llamas and Machine Learning 45:36 What do you think the future of AI in medicine will look like in 10-20 years? 47:24 What advice would you give to grad students, med students, and other early career professionals getting into AI and medicine?