Skip to content

“On the other hand, DeepSeq v3 only comes in a mixture of…” — Y Combinator Startup Podcast at 9:09

“On the other hand, DeepSeq v3 only comes in a mixture of experts architecture with 671 billion parameters, of which 37 billion are activated for a given token prediction, so considerably larger than even the biggest QN3 model. GPT-OSS sits in the middle. It offers two MOE models, one with 117 billion parameters, of…”

0:00 12:31