Neural Tangent Kernel: A theoretical view of Deep Learning Theory

In 2018 (a bit too old for now), a paper by Arthur Jacot, Franck Gabriel, and Clément Hongler dropped a theoretical study on the deep learning community. Their work on Neural Tangent Kernels (NTKs) showed that neural networks, under certain conditions, behave exactly like classical kernel method, a connection that was both surprising and profound.