← Glossary

rate limit

A cap on how many requests or tokens you may use per minute. The usual reason a batch job that worked on ten files falls over on a thousand.

ai 1 video 2 mentions

Where it comes up