[Thread] A new US paper shows the best frontier LLM models achieve 0% on hard real-life Programming Contest problems, domains where expert humans still excel — This is really BAD news of LLM's coding skill. ☹️ The best Frontier LLM models achieve 0% on hard real-life Programming Contest problems, domains where expert humans still excel. LiveCodeBench Pro, a benchmark composed of problems from Codeforces, ICPC, and IOI ("International [image]
Tuesday, June 17, 2025
[Thread] A new US paper shows the best frontier LLM models achieve 0% on hard real-life Programming Contest problems, domains where expert humans still excel (Rohan Paul/@rohanpaul_ai)
Subscribe to:
Post Comments (Atom)
ICANN receives 1,615 TLD applications from 481 applicants; Meta, OpenAI, and eight others applied for .agent, seven companies applied for .agi, and six for .asi (David Pierce/The Verge)
David Pierce / The Verge : ICANN receives 1,615 TLD applications from 481 applicants; Meta, OpenAI, and eight others applied for .agent, ...
-
Robert Hackett / Fortune : Profile of Kathryn Haun, a former prosecutor who created US' first federal “digital currency task force” a...
-
Amid government scrutiny over its various trade practices, the firm has been able to hold on to a set of consumers looking for cheaper goods...
No comments:
Post a Comment