Firehose

Filtered to tagged “weight quantization” · clear filters

All PeopleCompaniesPapersPodcastsHacker News

Browse by tag

10 NOV 2026 · Paper

This paper investigates the trade-off between using fewer bits to store weights in local language models and averaging the order of answer options to reduce sensitivity. Practitioners might care because optimizing this balance can lead to more accurate and efficient models, especially in resource-constrained environments.

10 NOV 2026 · Paper

This paper proposes a new method to dynamically adjust the precision of weights in a small local model during decoding, and evaluates its effectiveness in improving accuracy. A practitioner might care about this approach if they want to improve the performance of their small local models, especially in scenarios where the output distribution is uncertain.