“Processing language requires working with sequences of words, where order matters. A cat is a cat no matter where it is in an image, but there’s a big difference between ‘this reader is learning about AI’ and ‘AI is learning about this reader.’“

– Haomiao Huang

Ars Technica traces the trajectory points leading to current large language models (LLMs). The piece leaves what’s next to figure out but provides ample evidence of how we got here.

SEE FULL STORY

The generative AI revolution has begun – how did we get here?
ARS TECHNICA | January 30, 2023 | by Haimiao Huang