The Geometry of Semantic Space: A Continuous Geometric Framework for the Transformer Architecture
This paper develops a mathematical framework to analyze the Transformer architecture, using differential geometry to model its core components. Practitioners may care about this work because it provides new insights into the stability and optimization dynamics of Large Language Models.