“We also spend a lot of time doing those research in-house.…” — Software Engineering Daily at 26:12
“We also spend a lot of time doing those research in-house. Yeah, speculative decoding is definitely also workload dependent and making sure that we can train different form of speculative decoding models while the data is coming in to make sure that we keep up with the change in distribution in our customer's data.”
0:00
53:13