This paper introduces a new AI model called Gamer that can play complex video games and interact with both virtual and physical environments. A practitioner might care about this research because it could lead to the development of more versatile and efficient AI agents that can perform a wide range of tasks.
Firehose
Filtered to tagged “reinforcement learning” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives
Browse by tag
This paper introduces HALO, a system for collecting human demonstrations for whole-body mobile manipulation tasks, which aims to align human perception and action with the robot and preserve natural operator mobility. Practitioners in robotics and AI might care about this work as it could lead to more efficient and effective robot learning.
This paper explores the capabilities of decision models in long-horizon agents, examining whether a poorly performing model can still be effective in teaching a policy through reinforcement learning. Practitioners might care about the implications for designing more robust and effective reinforcement learning systems.
This paper develops a new approach to reinforcement learning for large language models that incorporates both scalar rewards and fine-grained environment information, allowing the model to learn from its past experiences and improve its performance over time. Practitioners might care about this method because it has the potential to improve the performance of agentic tasks in applications where complex decision-making is required.
This paper introduces a new approach to decision-making models that can choose whether to perform explicit reasoning or rely on implicit thinking, and how to optimize this decision based on expected benefits. Practitioners might care about this approach for tasks where explicit reasoning is costly or unnecessary.
Genie with Genie Ontology achieves 91% accuracy on a new enterprise benchmark, outperforming two leading frontier agents by 46% and 33% respectively, while using less than half the tokens and finishing three to four times faster. AI summary
This paper investigates the design of robot-use agents, specifically how to improve their performance on a robot arm task, and provides a simple framework for achieving significant gains without requiring complex models or additional tuning.
This paper proposes a method to improve the performance of large language model (LLM) agents when quantized, which reduces their computational cost, by using a full-precision teacher to guide the student to correct its mistakes and adapt to task requirements. Practitioners might care about this method because it could lead to more accurate and efficient AI agents in real-world applications.
This paper introduces a method to adapt long action chunks in robot policies, allowing for more efficient online learning with fewer samples. Practitioners might care about this approach for developing capable robot policies that can adapt to new situations with minimal data collection.
Ian Quigley, co-founder and CEO of Leash Bio, discusses the challenges and innovations in small molecule drug discovery using DNA encoded libraries (DELs) and machine learning. The episode covers the technical details of DELs, lessons from …
This episode features Andy Beam and Rafa Gómez-Bombarelli from Lila Sciences, discussing their vision for AI science factories as the next frontier for generating internet-scale datasets. They explain how their automated labs, leveraging AI…
Alistair Pullen, CEO of Cosine, discusses the UK's initiative to build a sovereign large language model (LLM) in response to US export controls on frontier AI like Fable. He explains Cosine's strategy to compete with larger labs by focusing…
David Dalrymple, known as Davidad, discusses his shift from formal verification approaches to an 'Alignment with Awakening' framework, emphasizing the formation of coalitions of aligned AIs that recognize shared moral truths. He shares empi…
Tim Scarfe interviews the Tufa Labs ARC-AGI-3 team to dissect their winning approach on the ARC-AGI-3 benchmark, focusing on how their system discovers goals and balances exploration with action efficiency. The episode explores the challeng…
🔬 The Coolest Diffusion Research Isn't in LLMs — Evan Feinberg & Sergey Edunov, Genesis Molecular AI
In this episode of Latent Space, Evan Feinberg and Sergey Edunov of Genesis Molecular AI discuss their pioneering work in applying diffusion models to protein-small molecule interactions for drug discovery. They explain how their foundation…
This episode features Thomas von Tschammer of Neural Concept, discussing how physics-aware AI is revolutionizing product engineering. Neural Concept's models accelerate design evaluation from days to minutes, enabling companies like Jaguar …
This episode argues that current AI progress is primarily driven by an immense quantity of high-quality, task-specific data, rather than improvements in sample efficiency. The speaker highlights the vast data requirements of frontier models…
Carina Hong, CEO of Axiom Math, discusses the company's recent $200M Series A funding and their perfect Putnam exam score, highlighting their mission to scale "verified AI" through formal mathematics. She explains how formal verification, u…
Eric Jang explains how to build AlphaGo from scratch using modern AI tools, detailing the game of Go's rules and the core Monte Carlo Tree Search (MCTS) algorithm. He describes how deep neural networks, specifically value and policy network…
The RL Fine-Tuning Playbook: CoreWeave's Kyle Corbitt on GRPO, Rubrics, Environments, Reward Hacking
Kyle Corbitt, founder of OpenPipe and leader of CoreWeave's serverless training team, provides a master class on reinforcement learning (RL) and custom fine-tuning for AI models. He explains how RL differs from supervised fine-tuning (SFT) …
This episode features Qasar Younis and Peter Ludwig, co-founders of Applied Intuition, discussing their company's mission to build physical AI for various moving systems like cars, trucks, and mining equipment. They delve into the evolution…