At LlamaCon today. I think this is the first time I’ve seen TTFT on the short…
April 29, 2025
At LlamaCon today. I think this is the first time I’ve seen TTFT on the short list of flagship metrics in a SOTA model presentation. This makes me very, very happy. (Latency matters!)
