← All Papers · Machine Learning

Universality Classes of Spectral Learning Dynamics

Dr. Tamás Nagy Updated 2026-03-16 21:20 Short Draft Machine Learning
Unreviewed draft. This paper has not been human-reviewed. Mathematical claims may be unverified. Use with appropriate caution.
Download PDF View in Graph BibTeX

Abstract

Modern learning systems appear algorithmically diverse yet empirically convergent toward a small set of training regimes. We propose a universality framework in which optimization dynamics are classified by spectral invariants rather than by optimizer-specific update rules. We define a common spectral state process, identify invariant scaling signatures, and show that SGD-, Adam-, and attention-driven training trajectories fall into a finite set of universality classes under mild regularity assumptions.

Length
1,768 words
Claims
3 theorems
Status
Draft

Connects To

Formal Foundations of Stochastic Gradient Descent Universal Foundations: A Verified Library of Core Mathematic...

Browse all Machine Learning papers →