[Thread] A new US paper shows the best frontier LLM models achieve 0% on hard real-life Programming Contest problems, domains where expert humans still excel — This is really BAD news of LLM's coding skill. ☹️ The best Frontier LLM models achieve 0% on hard real-life Programming Contest problems, domains where expert humans still excel. LiveCodeBench Pro, a benchmark composed of problems from Codeforces, ICPC, and IOI ("International [image]
Tuesday, June 17, 2025
[Thread] A new US paper shows the best frontier LLM models achieve 0% on hard real-life Programming Contest problems, domains where expert humans still excel (Rohan Paul/@rohanpaul_ai)
Subscribe to:
Post Comments (Atom)
Alibaba's DAMO Academy releases RynnBrain, an open-source foundation model to help robots perform real-world tasks like navigating rooms, trained on Qwen3-VL (Saritha Rai/Bloomberg)
Saritha Rai / Bloomberg : Alibaba's DAMO Academy releases RynnBrain, an open-source foundation model to help robots perform real-worl...
-
Amrith Ramkumar / Wall Street Journal : An interview with White House OSTP Director Michael Kratsios, a Peter Thiel protégé confirmed by ...
-
http://bit.ly/2XqNIDz
No comments:
Post a Comment