Papers

Filtered to attention mechanisms · clear filter

Browse by term

continual learning 89reinforcement learning 43vision-language models 19benchmarking 12benchmarks 12robotics 12language models 9world models 9large language models 8video generation 7multimodal models 5recursive self-improvement 5video world models 5agents 4diffusion models 4embodied AI 4foundation models 4generative models 4human-computer interaction 4multimodal large language models 4natural language processing 4policy optimization 4reasoning 4self-supervised learning 4spatial reasoning 4agentic models 3conversational AI 3dialogue systems 3evaluation benchmarks 3LLMs 3

Matching papers

Metis: Memory Foundation Model

256 upvotes · 29 JUL 2026 · Zeyu Zhang, Ziliang Guo, Yihang Sun et al.

This paper introduces a new type of AI model called memory foundation models, which allows the model to learn and retain information internally, rather than relying on external memory modules. This could be useful for practitioners who want to build more efficient and flexible AI agents.

Random Attention: Rethinking KV Cache Eviction for Efficient Reasoning

166 upvotes · 3 SEP 2026 · Heng Wang, Jielin Qiu, Wenting Zhao et al.

This paper proposes a new method for managing the memory of large language models, called Random Attention, which improves their performance on tasks that require extended reasoning by reducing memory usage. Practitioners caring about efficient model deployment might find this approach useful.