This episode argues that current AI progress is primarily driven by an immense quantity of high-quality, task-specific data, rather than improvements in sample efficiency. The speaker highlights the vast data requirements of frontier models…
Firehose
Filtered to tagged “Scaling laws” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives
Browse by tag
artificial intelligence 63continual learning 22AI 19agentic coding 17open-weight models 14reinforcement learning 12AI agents 11AI safety 8datasette 7machine learning 7natural language processing 7benchmarks 6language models 6Nvidia 6Reinforcement learning 6robotics 6deep learning 5Diffusion models 5large language models 5open-source 5Agentic AI 4AI ethics 4AI Gateway 4Databricks 4decision models 4Gemini 4general 4Jensen Huang 4Recursive self-improvement 4software development 4
Alex Rives, Head of Science at Biohub, discusses ESM-C, a fourth-generation protein language model that leverages the "Bitter Lesson" of scaling with massive metagenomic datasets to achieve unprecedented protein structure prediction and des…
Eric Jang explains how to build AlphaGo from scratch using modern AI tools, detailing the game of Go's rules and the core Monte Carlo Tree Search (MCTS) algorithm. He describes how deep neural networks, specifically value and policy network…