Unlock: Optimal Brain Surgeon and Pruning Theory
Principled weight pruning via second-order information: Optimal Brain Damage uses the Hessian diagonal, Optimal Brain Surgeon uses the full inverse Hessian, and both reveal why magnitude pruning is a crude but popular approximation.
129 Prerequisites0 Mastered0 Working112 Gaps
Prerequisite mastery13%
Recommended probe
McDiarmid's Inequality is your weakest prerequisite with available questions. You haven't been assessed on this topic yet.
Not assessed13 questions
Not assessed2 questions
Not assessed15 questions
Symmetrization InequalityAdvanced
Not assessed3 questions
VC DimensionCore
Not assessed58 questions
Contraction InequalityAdvanced
Not assessed1 question
Not assessed17 questions
The Hessian MatrixAxioms
Not assessed16 questions
Sign in to track your mastery and see personalized gap analysis.