10 July 2025 - AI breakthrough
< yesterday --
tomorrow >
The last breakthrough in AI came in the 1940s with the invention of the
artificial neural network. 20 years later it was regularized into the
perceptron. 20 more years gave the multi-layer perceptron. 20 years yet
again and we were finally able to exploit the 1980s idea, and in the 20
years since we've found tricks to exploit it better. I think it's about
time for the next breakthrough.