ai-ml9 min
The Mathematics of Self-Attention: Deconstructing the Transformer
Inside the equation that powers modern AI
The Transformer architecture revolutionized AI with a single mechanism: self-attention. We break down the linear...
Akhilesh Yadav
Category
AI & ML
The deep mathematical foundations of artificial intelligence
3 articles
ai-ml10 min
The Geometry of Gradient Descent: Curvature, Saddle Points, and Loss Landscapes
Why optimization in deep learning is a geometric problem
Gradient descent navigates high-dimensional loss landscapes shaped by curvature and saddle points. We explore the...
Akhilesh Yadav
ai-ml10 min
Information Geometry and Neural Networks
The Riemannian manifold of probability distributions
Information geometry equips the space of probability distributions with a Riemannian metric — the Fisher information....
Akhilesh Yadav