Discussion about this post

User's avatar
ChatGPT for All's avatar

GPT-6.1 Sol resets the cost frontier $2/$10, 39% cheaper than GPT-6 Sol. Anthropic holds the top 3 Agent Arena spots but evals are breaking same model scores 62% vs 33% across harnesses, multi agent coordination succeeds only 12% of the time and long context accuracy drops 62.8% from 4K to 128K.

Abhishek Pan's avatar

The useful split is between agent harnesses and eval integrity. Teams can ship a capable loop quickly, but the regression surface is what decides whether it belongs in production.

5 more comments...

No posts

Ready for more?