Inventors & Engineers · Digital
Hinton, LeCun & Bengio
The three 'godfathers of deep learning': backpropagation (1986), convolutional nets for checks (1989–98), neural language models (2003), the 2012 AlexNet moment, the 2018 Turing Award, and their split over AI risk.
Step 1 of 4 · Overview30 min read ·
Key idea
Prereqs: Neural networks; Gradient descent. Next: Transformers; AI safety debates. Sources: Rumelhart, Hinton & Williams, *Nature* (1986); LeCun et al., 'Gradient-Based Learning Applied to Document Recognition' (1998); Bengio et al., *JMLR* (2003); Krizhevsky, Sutskever & Hinton (2012); Cade Metz, *Genius Makers* (2021).Next: 1. Contributions