Kernel Machines and Deep Weights Networks

Home

Discover

Bookmarks

Keep Up With Latest Trending Papers. Computer Science, AI and more.Subscribe

CC BY

Source arXiv

Machine Learning

Neural and Evolutionary Computing

Stats Machine Learning

Kernel Machines and Deep Weights Networks

Every Model Learned by Gradient Descent Is Approximately a Kernel Machine

We show that deep networks learned by the standard gradient descent algorithm are in fact mathematically approximately equivalent to kernel machines, a learning method that simply memorizes the data and uses it directly for prediction via a similarity function (the kernel).

This greatly enhances the interpretability of deep network weights, by elucidating that they are effectively a superpositionof the training examples.

The network architecture incorporates knowledge of the target function into the kernel.

This improved understanding should lead to better learning algorithms.

Authors

Pedro Domingos

◐ Recommended Follows

◐ Latest Activity