
Brief Historical review of AI in one picture (with links):
1. AI origins (1943–1957):
- 1943: McCulloch, W.S., & Pitts, W. A Logical Calculus of Ideas Immanent in Nervous Activity. Link
- 1950: Turing, A. Computing Machinery and intelligence. Link
- 1951: Minsky, M. SNARC: Stochastic Neural Analog Reinforcement Calculator Wiki ⇒ The first AI device
- 1955: Newell, A., Simon, H.A., & Shaw, C. Logic Theorist. [Wiki](https://en.wikipedia.org/wiki/Logic_Theorist#:~:text=Logic Theorist is a computer,the first artificial intelligence program".) ⇒ The first AI program
- 1956: Dartmouth conference of Artificial Intelligence. Link ⇒ AI term is coined
2. Inflated interest (1957–1972):
- 1957: Rosenblatt, F. The Perceptron. A perceiving and recognizing automaton. Original | Modern description
- 1960: Widrow, B. An adaptive “ADALINE” neuron using chemical “memistors”. Original | Modern description
- 1965: Feigenbaum, E. DENDRAL: First expert system. Case study
- 1966: Weizenbaum, J. ALIZA - A Computer Program For the Study of Natural Language Communication Between Man And Machine. Link
3. 1st AI Winter (1972–1978):
- 1972: Lighthill, J. Artificial Intelligence: A General Survey. Link ⇒ British government significantly cut funding for AI research.
- 1974: Lack of computational power to do anything substantial. Disappointment with researchers. ⇒ Funding for AI projects was closed.
4. Expert systems (1978–1987):
- 1978: McDermott, J.P. Expert systems of “second generation” - R1 (XCON: eXpert CONfigurer). Link
- 1982: Japan’s Fifth Generation Computer Project. Link
5. 2nd AI Winter (1987–1997):
- 1987: Desktop computers become faster and more powerful than LISP machines. ⇒ An entire half a billion dollars industry was demolished overnight.
- 1991: Japan's Fifth Generation Computer Project outcomes. ⇒ The impressive list of goals had not been met
6. Explosive growth (1997–2017):
- 1997: Deep Blue vs. Kasparov ⇒ The first defeat of a reigning world chess champion by a computer.
- 1997-2004: LSTM Development.
- 1997: Sepp Hochreiter, Jürgen Schmidhuber, Long Short-Term Memory. Link
- 1999: Felix Gers, Jürgen Schmidhuber, and Fred Cummins Learning to Forget: Continual Prediction with LSTM. Link
- 2004: Graves, A., Beringer, N., Eck, D., & Schmidhuber, J. Biologically Plausible Speech Recognition with LSTM Neural Nets. Link
- 2009: Raina, R., Madhavan, A., & Ng, A.Y. Large-scale Deep Unsupervised Learning using Graphics Processors. Link
- 2012: Hinton, G., Sutskever, I., & Krizhevsky, A. CNN architecture for ImageNet challenge. ⇒ This moment showcased the potential of deep CNNs.
- 2016: AlphaGo vs. Lee Sedol. ⇒ Defeat of a human in the most complex board game.
7. Generative AI (2017–nowadays):
- 2017: Transformers. Attention Is All You Need. Link
- 2018: Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever. Improving Language Understanding by Generative Pre-Training. Link
- 2021-2022: Image prompts.
- 2021: OpenAI's Dall-E Link
- 2022: Stable diffusion & Midjourney.
- 2023: OpenAI’s GPT-4. Link