Papers

Filtered to multilingual benchmarks · clear filter

Browse by term

continual learning 89reinforcement learning 43vision-language models 19benchmarking 12benchmarks 12robotics 12language models 9world models 9large language models 8video generation 7multimodal models 5recursive self-improvement 5video world models 5agents 4diffusion models 4embodied AI 4foundation models 4generative models 4human-computer interaction 4multimodal large language models 4natural language processing 4policy optimization 4reasoning 4self-supervised learning 4spatial reasoning 4agentic models 3conversational AI 3dialogue systems 3evaluation benchmarks 3LLMs 3

Matching papers

SWE-Bench ProMax: Benchmarking Agents on Large-Scale Multilingual Code Refactoring

115 upvotes · 10 AUG 2026 · Yuling Shi, Jinghan Xu, Kelin Fu et al.

This paper introduces SWE-Bench ProMax, a new benchmark for testing AI coding agents on large-scale multilingual code refactoring tasks, which is designed to be more realistic and challenging than existing benchmarks. Practitioners can care about this paper because it provides a rigorous evaluation of current AI coding agents' capabilities on a more representative set of tasks.