This paper introduces a new method for video generation, called Video DeltaNet, which combines attention mechanisms to improve efficiency and quality in livestream video generation. Practitioners may care about this paper if they work on video generation tasks and want to explore more efficient and effective methods.
Firehose
Filtered to tagged “attention mechanisms” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives
Browse by tag
artificial intelligence 87continual learning 32AI 24reinforcement learning 14agentic coding 13AI safety 13open-weight models 13AI agents 10existential risk 9AI ethics 8cybersecurity 8ethics 7language models 7machine learning 7natural language processing 6open-source 6Reinforcement learning 6security 6artificial general intelligence 5Diffusion models 5recursive self-improvement 5robotics 5software development 5Agentic AI 4large language models 4mathematics 4multi-agent systems 4Recursive self-improvement 4agentic AI 3agents 3
This paper explores how transformer representations change over time and how these changes can be understood and manipulated. Practitioners might care about this research because it could lead to more robust and efficient transformer models, especially in applications where model updates need to be edited or compressed.