PhysElite paper reports that leading multimodal LLM solved 33.7% of Olympiad-level physics problems
A new benchmark of 11,586 bilingual, diagram-based physics problems reports that the strongest of 18 tested multimodal language models achieved only 33.7% answer accuracy.