Where this topic leads

Topics that build on Preconditioned Optimizers: Shampoo, K-FAC, and Natural Gradient

Once you have Preconditioned Optimizers: Shampoo, K-FAC, and Natural Gradient, these are the topics that cite it as a prerequisite. Pick by tier and the area you want to push into next.

Editor's suggested next (2)

Core flagship topics (1)

Optimizer Theory: SGD, Adam, and Muonlayer 3 · llm-construction

Standard topics (1)

Riemannian Optimization and Manifold Constraintslayer 3 · optimization-function-classes