Papers

Filtered to policy optimization · clear filter

Browse by term

continual learning 89reinforcement learning 43vision-language models 19benchmarking 12benchmarks 12robotics 12language models 9world models 9large language models 8video generation 7multimodal models 5recursive self-improvement 5video world models 5agents 4diffusion models 4embodied AI 4foundation models 4generative models 4human-computer interaction 4multimodal large language models 4natural language processing 4policy optimization 4reasoning 4self-supervised learning 4spatial reasoning 4agentic models 3conversational AI 3dialogue systems 3evaluation benchmarks 3LLMs 3

Matching papers

Multiscale Policy Optimization for Long-Horizon LLM Agents

379 upvotes · 26 OCT 2026 · Tao Ren, Hui Yang, Jia Deng et al.

This paper proposes a new optimization technique for long-horizon language model agents, allowing them to make more informed decisions by allocating credit more finely across individual tokens. Practitioners might care because it could lead to better performance in tasks like search, tool-use, and automation.

Learn What's Left, Not What's Mastered: Saturation Aware Advantage Reweighting for Multi-Reward Policy Optimization

142 upvotes · 17 AUG 2026 · Yixuan Wang, Yifei Chen, Haichao Zhang et al.

This paper improves reinforcement learning for post-training language model reasoners by addressing two problems in existing methods: identical advantages for distinct reward profiles and fixed relative weights for all objectives. A new method, SA-MRPO, dynamically reallocates optimization effort toward under-optimized objectives while maintaining performance on well-satisfied objectives.

Turns Matter: Advancing Streaming Video RL via Turn-Level Credit

126 upvotes · 4 NOV 2026 · Shuai Dong, Kanghui Tian, Linghan Chen et al.

This paper develops a new reinforcement learning approach for understanding streaming video, allowing models to make more informed decisions by assigning credit for individual turns rather than just overall trajectories. Practitioners can benefit from this approach by creating more effective models for applications like video chatbots or automated customer service.

DONIC: Generalist Dexterous Bimanual Tracking Control from Human Demonstrations

124 upvotes · 21 OCT 2026 · Mingze Sun, Ziang Cao, Yuan Fei et al.

This paper develops a system that can track both hands of a robot in complex, real-life situations, using demonstrations from humans. Practitioners might care because it could enable robots to perform tasks like assembly, cooking, or surgery with greater precision and flexibility.