lost in the middle
The observation that models attend best to the start and end of a long context and can skim what is buried in the middle. Put the important thing where it will be read.
ai
1 video
2 mentions
also: context rot, needle in a haystack