ANTHOLOGY — Open source AI (Changelog Interviews #541)

Chapters

1. 0:00 This week on The Changelog
2. 1:44 Sponsor: DevCycle
3. 4:38 Start the show!
4. 5:46 We met Beyang 10 years ago!
5. 6:08 The mission of Sourcegraph
6. 7:22 Adam still Googles, just less
7. 8:30 Plugins make models interesting
8. 9:35 When did you start thinking about this?
9. 12:16 This is a "Eureka!" momement in time
10. 13:11 The gospel of text based input
11. 15:44 Is this the future interface of Sourcegraph?
12. 17:21 Iterating the interface
13. 17:59 How can you access Cody?
14. 18:27 Cody is open source
15. 20:13 How does it get code intelligence?
16. 21:58 What about privacy?
17. 26:11 GPT for X
18. 26:53 Cody vs Copilot
19. 29:25 Open source + model agnostic
20. 31:22 What's next?
21. 33:19 How high up the stack can AI tooling go?
22. 36:07 Is this a step change to plateau?
23. 38:21 The ultimate flattener
24. 42:56 Will AI awallow all of programing?
25. 45:52 Sponsor: Sentry
26. 50:08 We're fine-tuned
27. 50:51 JIT conference presenter
28. 52:32 This time 4 weeks ago
29. 53:54 Let's generate our own data
30. 55:05 All 15,000 Q&A data is open
31. 56:12 Verbose is not always desirable
32. 56:42 I want my own Dolly 2.0
33. 58:14 How did you collect the Q&A data?
34. 1:00:39 We thought we'd need more data
35. 1:01:40 Dolly proved it could be done
36. 1:03:24 Google's leaked memo
37. 1:06:06 Databricks' play in this chess game
38. 1:08:45 Turning AI on our transcripts
39. 1:11:03 Chain or foundational model?
40. 1:12:42 Sponsor: Rocky Linux
41. 1:15:19 The base layer
42. 1:16:27 What should the world know?
43. 1:17:40 Where does the money come from?
44. 1:18:13 Training LLMs is NOT that expensive
45. 1:22:07 Focused on open source AI research
46. 1:25:49 Interpreting LLMs
47. 1:28:30 Influencing the properties of the model
48. 1:31:40 Do you have fear of where this is going?
49. 1:32:58 Connecting with Stella and team
50. 1:34:07 Stella's news source is their Discord server
51. 1:36:22 Outro