11
Humans Still Beat AI in the Long Horizon: Revisiting Test-Time Scaling in the Agent Era
(joyemang33.github.io)
Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.
The derived Elo is a great tool to isolate whether agent loops are actually "reasoning" or just brute-forcing the search space. It clearly proves that current agent scaling (via basic try-observe-reflect loops) quickly plateaus because it lacks the human capacity for abstract conceptual shifts and structural refactoring over long-horizon tasks. I believe the future of test-time compute in the agent era shouldn't just be about scaling trials or running more iterations; it should be about building architectures capable of hierarchical planning that can dynamically pivot their entire strategy when stuck.