Papers

Filtered to multimodal large language models · clear filter

Browse by term

continual learning 89reinforcement learning 43vision-language models 19benchmarking 12benchmarks 12robotics 12language models 9world models 9large language models 8video generation 7multimodal models 5recursive self-improvement 5video world models 5agents 4diffusion models 4embodied AI 4foundation models 4generative models 4human-computer interaction 4multimodal large language models 4natural language processing 4policy optimization 4reasoning 4self-supervised learning 4spatial reasoning 4agentic models 3conversational AI 3dialogue systems 3evaluation benchmarks 3LLMs 3

Matching papers

Making MLLM Latents Matter: Factor-Aware Predictive Learning for Cinematic Video Generation

173 upvotes · 22 OCT 2026 · Songlin Yang, Zhe Wang, Xiaotong Zhao et al.

This paper proposes a method to use multimodal large language models (MLLMs) to improve cinematic video generation by providing both temporal inference and factor-aware control. A practitioner might care about this paper if they want to generate more realistic and controllable videos.

InteractiveWorld: A Verifiable Human-Centric Environment for Building Better Interactive MLLM Assistants

109 upvotes · 25 OCT 2026 · Qinsi Wang, Wei Wen, Chong Zhou et al.

This paper creates a simulated environment where a human and AI assistant interact, allowing researchers to test how well AI assistants can guide humans in the physical world. Practitioners might care because it could lead to more reliable AI assistants that can truly help people with tasks like remembering what to do.

UrbanGround: From Local Perception to Spatial Agency in a Real-Scale City

106 upvotes · 27 AUG 2026 · Tianjie Ju, Zheng Wu, Yueqing Sun et al.

This paper explores how large language models can turn local observations of a city into reliable actions, and whether these models can sustain goal-directed behavior in complex urban environments. Practitioners in AI/ML and urban planning might care about the limitations and potential of current models in navigating real-world cities.

Annotations as Rollouts: Efficient and Scalable Reinforcement Learning for Video MLLMs

98 upvotes · 20 AUG 2026 · Yunheng Li, Guohong Mu, Hao Li et al.

This paper introduces a method called OraRL to improve the efficiency and scalability of reinforcement learning for multimodal large language models (MLLMs) trained on video data. By leveraging annotations as a source of high-quality rollouts, OraRL can significantly reduce the number of required rollouts, leading to faster training times and better performance on video understanding tasks.