April 28, 2017

The third deep learning revolution

The first revolution took place 1958-1969.
  • We figured out how to train perceptrons.
  • We proved the perceptron convergence theorem.
  • Interest waned after a book (Perceptrons) written by mathematicians.
The second revolution took place 1986-1995.
  • We figured out how to train multi-layer perceptrons.
  • We proved the universal approximation theorem.
  • Interest waned after a book (SLT) written by mathematicians.
The third revolution started in 2012.
  • We figured out how to train deep nets.
  • A mathematician will write a book around 2022.
  • The fourth revolution will not start until 2036 :)

No comments: