“under their licensing that support a longer context…” — Practical AI at 23:48
“under their licensing that support a longer context length. One of these being the Salesforce XGen model. So if you go on Hugging Face, just search for XGen. It's a 7 billion parameter model with an 8,000 input sequence length, which is obviously quite a bit more than that 2,000. And one of the things I find…”
0:00
42:11