← Glossary

transformer

The architecture nearly every modern language model uses. Its key trick is attention: every token can look at every other token when deciding what comes next.

ai
Nobody says this one in the transcripts we have yet.