AI reasoning models cost more to benchmark, making it harder to independently verify claims; Artificial Analysis: OpenAI's o1 costs $2,767.05 to evaluate (Kyle Wiggers/TechCrunch)

Kyle Wiggers / TechCrunch:
AI reasoning models cost more to benchmark, making it harder to independently verify claims; Artificial Analysis: OpenAI's o1 costs $2,767.05 to evaluate  —  AI labs like OpenAI claim that their so-called “reasoning” AI models, which can “think” through problems step by step …