Papers

Filtered to self-supervised learning · clear filter

Browse by term

continual learning 89reinforcement learning 43vision-language models 19benchmarking 12benchmarks 12robotics 12language models 9world models 9large language models 8video generation 7multimodal models 5recursive self-improvement 5video world models 5agents 4diffusion models 4embodied AI 4foundation models 4generative models 4human-computer interaction 4multimodal large language models 4natural language processing 4policy optimization 4reasoning 4self-supervised learning 4spatial reasoning 4agentic models 3conversational AI 3dialogue systems 3evaluation benchmarks 3LLMs 3

Matching papers

UniEvo-VL: An On-policy Self-Distillation Training Recipe for Multimodal Model Self-improvement

179 upvotes · 30 SEP 2026 · Fang Wu, Da Xing, Yanjie Huang et al.

This paper introduces UniEvo-VL, a self-improvement framework for multimodal models that uses their own feedback to learn and improve, without relying on an external teacher. Practitioners might care because it can lead to better image generation capabilities and more efficient models.

PhiZero: A World Model Built Around Physical Language

158 upvotes · 30 JUL 2026 · Shuyao Shang, Yuqi Wang, Ruopeng Gao et al.

This paper introduces PhiZero, a world model that uses physical language to predict how the physical world evolves, allowing for more explicit reasoning and potentially more realistic simulations. Practitioners might care because this approach could lead to more realistic and interactive world modeling in applications like robotics, video games, and virtual reality.

Self-Supervised Visual On-Policy Distillation

158 upvotes · 14 AUG 2026 · Yijiang Li, Yijun Liang, Yunjie Tian et al.

This paper proposes a new method called Self-Supervised Visual On-Policy Distillation (S^2VOPD) that generates learning signals from asymmetric augmented views of images, allowing for effective on-policy learning without privileged information. Practitioners might care about this paper because it presents a simple yet effective way to improve performance on various perception benchmarks.

Does On-Policy Distillation Really Distill? From Noisy Teacher to Self-Improvement

89 upvotes · 31 AUG 2026 · Yi Ding, Ruqi Zhang

This paper investigates whether on-policy distillation (OPD) truly improves student policies by analyzing the effects of noisy teacher supervision. It finds that OPD works by suppressing low-probability tokens, which can be achieved without a teacher, and introduces a new method called On-Policy Self-Adaptation (OPSA) that outperforms OPD and traditional reinforcement learning methods.