Regularization

Slides

Paper on Over-Parameterization

The Alexnet Paper Demonstraing Dropout (2012)

The Journal Dropout Reference (2014)

Effective Dropout for RNNs (2015)

A paper describing exhaustive hyper-parameter search

Blog post arguing for random sampling of hyper-parameters

PAC-Bayes Tutorial

A Paper on computing PAC-Bayes bounds in practice (2017)