← Glossary

lost in the middle

The observation that models attend best to the start and end of a long context and can skim what is buried in the middle. Put the important thing where it will be read.

ai 1 video 2 mentions also: context rot, needle in a haystack

Where it comes up