Lazy vs Feature Learning

2 selectedDifficulty 7-92 unseenView topic

AdvancedNew

0 answered

2 advancedAdapts to your performance

Question 1 of 2

120sadvanced (7/10)conceptual

In the Neural Tangent Kernel (NTK) regime (infinite width, standard parameterization), the network behaves like a linear model. Why does this fail to explain the success of deep learning on structured data?