“They are trained by going through mountains of internet text, repeatedly guessing the next few letters and then grading themselves against the real thing.”
– Aatish Bhatia
This interactive explainer from The New York Times shows how large language models assemble text. You can select a variety of source texts and see how the model constructs words, sentences, and eventually meaning from a letter at a time.
The piece offers six classic texts to try.