“There's another sort of architectural pattern that is…” — The Changelog: Software Development, Open Source at 1:25:21
“There's another sort of architectural pattern that is emerging in AI called Mixture of Experts. Mixture of Experts is, instead of having one gigantic large model, how about having a lot of small models that can work together? How do humans work? We don't have an expert in everything. We have experts in areas, and we…”
0:00
2:02:37