This paper investigates the trade-off between using fewer bits to store weights in local language models and averaging the order of answer options to reduce sensitivity. Practitioners might care because optimizing this balance can lead to more accurate and efficient models, especially in resource-constrained environments.
Firehose
Filtered to Papers, tagged “local language models” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives