6.3. Ablation Study Resources#
Normally, ablation studies are performed on neural networks that are much more complex than the simple example in the notebook.
A first application was done on artificial neural networks in analogy to neurosurgery [Meyes et al., 2019].
For example, Deepmind have been early adopters of thorough ablation studies in their papers [Hessel et al., 2018].
6.3.1. Bibliography#
Matteo Hessel, Joseph Modayil, Hado Van Hasselt, Tom Schaul, Georg Ostrovski, Will Dabney, Dan Horgan, Bilal Piot, Mohammad Azar, and David Silver. Rainbow: combining improvements in deep reinforcement learning. Proceedings of the AAAI Conference on Artificial Intelligence, April 2018. URL: https://doi.org/10.1609/aaai.v32i1.11796, doi:10.1609/aaai.v32i1.11796.
Richard Meyes, Melanie Lu, Constantin Waubert de Puiseau, and Tobias Meisen. Ablation studies in artificial neural networks. 2019. URL: https://arxiv.org/abs/1901.08644, doi:10.48550/ARXIV.1901.08644.