“On the other hand, DeepSeq v3 only comes in a mixture of…” — Y Combinator Startup Podcast at 9:09
“On the other hand, DeepSeq v3 only comes in a mixture of experts architecture with 671 billion parameters, of which 37 billion are activated for a given token prediction, so considerably larger than even the biggest QN3 model. GPT-OSS sits in the middle. It offers two MOE models, one with 117 billion parameters, of…”
0:00
12:31