The model scores each document in its own prompt, together with the query and an instruction. A request can rank up to 1,000 documents. See the model catalog or the Models API for current pricing and availability.
Use Prime Inference
The model doesn’t take Chat Completions requests. Create a Prime API key with Inference permission in the API keys guide, then call the Rerank API:index in the request and a relevance_score from 0 to 1. To charge a team instead of your personal account, add -H "X-Prime-Team-ID: your-team-id". Keep API keys server-side.
Write an instruction
The model reads a one-line instruction with every document. The default,Given a web search query, retrieve relevant passages that answer the query, suits search. For a different task, set instruction in the same pattern, Given a <kind of query>, retrieve <kind of document> that <relation to the query>: