Firehose

Filtered to tagged “uncertainty-aware decoding” · clear filters

All PeopleCompaniesPapersPodcastsHacker News

Browse by tag

10 NOV 2026 · Paper

This paper proposes a new method to dynamically adjust the precision of weights in a small local model during decoding, and evaluates its effectiveness in improving accuracy. A practitioner might care about this approach if they want to improve the performance of their small local models, especially in scenarios where the output distribution is uncertain.