LifePlanner benchmark reports that LLM agents falter at complex planning with social-media data
A new arXiv benchmark evaluates LLM agents on geospatial planning using maps, tools and local social-media posts. Its authors report a sharp decline on complex tasks, with a 40.2% pass rate.