“Transformers process an entire sequence at once — be that a sentence, paragraph or an entire article — analysing all its parts and not just individual words.”
– FT Visual Storytelling Team and Madhumita Murgia
The FT presents an exceptional explainer about transformers, the software that is essential in powering generative AI models like ChatGPT. The origins of transformers were in 2017, in a seminal paper written by eight researchers, then working at Google.
Scrolling through the article’s web page produces a step-by-step illustration of processes underlying a large language model and its apparent ability to “understand” the text it’s given.
Generative AI exists because of the transformer | FT | September 12, 2023 | by the FT Visual Storytelling Team and Madhumita Murgia