“Many of the co-authors still communicate frequently, celebrating each other’s successes and supporting one another through the unique challenges of being start-up entrepreneurs.”
– Madhumita Murgia
The AI revolution of large language models (LLMs) started in a hallway at Google. FT writer Madhumita Murgia chronicles the path of ideas that led to the transformer model, which makes LLMs possible.
Eight Google researchers started their own group to develop the concept, after one was inspired by the way aliens communicate in the sc-film, Arrival.
The FT says they talked with seven of the eight for this piece. They also say all eight no longer work at Google.
Transformers: the Google scientists who pioneered an AI revolution | FT | July 23, 2023 | by Madhumita Murgia