Attention is All You Need (The Transformer), A Brief to AI Origins.

The story behind AI is multifaceted. Where do you begin? 1950’s 1990’s or 2014 – 2017 with GAN and The Transformer. Read on.

It seems as if AI has swept the world off its feet. If you read Apple news, via Scientific American Magazine, Yushua Bengio from the University of Montreal is referenced in the article as the Godfather of AI having published a paper called Generative Adversarial Networks Mr. Bengio along with three others, Geoffrey Hinton at the University of Toronto in Canada and Yann LeCun at the technology company Meta in New York City. The paper has 105,000 citations on Google Scholar, which for papers is big but not big like a vital reel in which some of mine have been seen millions of times. Lol. My reel has not changed the world.

While this may be boring and not as fun as using Nano Banana AI, one may at least start to understand the origins of AI.

According to Lawerence Livermore Laboratories the beginning started with a simpler paper called Computing Machine and Intelligence by Allan Turing in the 1950’s. The very same name for the award Mr. Bengio and his two cohorts got an award named after for their breakthrough paper.

I have also heard about other papers one in which published in 2017 was called Attention is All You Need by a group of Google Scientists.

According to many, this paper was seminal in AI growth to what we see today in the coding architectural and what they had coined The Transformer.