This paper proposes a new method for aligning large language models with human preferences, called Comparison-based Preference Optimization (ComPO), which is more efficient than existing methods and can mitigate a problem called likelihood displacement. Practitioners might care about this paper because it offers a new approach to aligning LLMs with human preferences, which is essential for developing more reliable and trustworthy AI models.
Firehose
Filtered to tagged “preference alignment” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives
Browse by tag
artificial intelligence 87continual learning 32AI 24reinforcement learning 14agentic coding 13AI safety 13open-weight models 13AI agents 10existential risk 9AI ethics 8cybersecurity 8ethics 7language models 7machine learning 7natural language processing 6open-source 6Reinforcement learning 6security 6artificial general intelligence 5Diffusion models 5recursive self-improvement 5robotics 5software development 5Agentic AI 4large language models 4mathematics 4multi-agent systems 4Recursive self-improvement 4agentic AI 3agents 3