Firehose

Filtered to tagged “quantization” · clear filters

All PeopleCompaniesPapersPodcastsHacker News

Browse by tag

10 NOV 2026 · Paper

This paper introduces Mobile AI Factory, a system that automates the process of fine-tuning language models for mobile devices, allowing for more private and efficient AI on the go. Practitioners can care about the implications of this work for developing personalized AI models that run on mobile devices without relying on cloud connectivity.

3 AUG 2026 · Podcast · Latent Space: The AI Engineer Podcast

In this episode, Philip Kiely and Ali Taha from Baseten discuss the complexities and innovations in inference engineering for large AI models. They cover topics including model deployment, speculative decoding, quantization, hardware optimi…