started building a benchmark for vision decision models was expecting to trade accuracy for speed... meanwhile... - GPT-6.1 Terra (high): 96/100 correct, 7.98s average / image - TypeSafe AI Jev 1.14: 89/100 correct, 9.64s average / image wtf? decision model are so slow?
Engagement counts are snapshots taken when collected.



