inference
Actually running a trained model to get an answer, as opposed to training it. What you pay for per token.
Where it comes up
Cursor 2.0 Launch
“Um other questions we have any insight into how auto decides what model to use? So I have been showing picking specific models. You can also use auto. Auto is a router between different Frontier models. So this isn't when you pick the speci…”
Cursor 201
“I think one thing that I I do like to call out on that cuz often times people hear like self-hosted and they think, "Oh, we're going to like the model inference and stuff is going to be self-hosted, too. So that that's not the case. Um Um t…”
Cursor for Finance Teams
“they kind of feed each other. You can kind of do an investigation, um understand a problem, and then maybe that turns into a further uh analysis that then turns into some sort of automation that you build. Um we struggle a lot with um fraud…”
Cursor for Financial Services
“All right. And from there I can go forward with actually building this out. So because this plan is already kind of built out uh there's not much more to do here in terms of reasoning except maybe uh you know rewriting a little bit but othe…”