This paper develops a way to make large language models more efficient by sharing computation across different depths, rather than using a smaller decision model. Practitioners might care because this approach can improve the accuracy and efficiency of decision-making models.
Firehose
Filtered to Papers, tagged “self-distillation” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives