Reasoning LLMs are wandering solution explorers
Computer Science > Computation and Language arXiv:2505.20296 (cs) [Submitted on 26 May 2025] Title:Reasoning LLMs are Wandering Solution Explorers Authors:Jiahao Lu, Ziwei Xu, Mohan Kankanhalli View a PDF of the paper titled Reasoning LLMs are Wandering Solution Explorers, by Jiahao Lu and 1 other authors View PDF Abstract:Large Language Models (LLMs) have demonstrated impressive reasoning abilities through test-time computation (TTC) techniques such as chain-of-thought prompting and tree-based reasoning. However, we argue that current reasoning LLMs (RLLMs) lack the ability to systematically explore the solution space. This paper formalizes what constitutes systematic problem solving and identifies common failure modes that reveal reasoning LLMs to be wanderers rather…
