Inference rate limits
| Plan | Requires payment | Requests / min | Input tokens / min | Output tokens / min | Max concurrent |
|---|---|---|---|---|---|
| Basic | No | 10 | 500,000 | 100,000 | 3 |
| Basic | Yes, at least $5 in credits | 600 | 2,000,000 | 500,000 | 50 |
| Pro | By agreement | 2,000 | 5,000,000 | 1,500,000 | 200 |
| Enterprise | By agreement | Custom rate limits, sized per organization to your workload. | |||
How the limits work
Four dimensions, checked on every request:- Requests / min: how many new requests your organization can start each minute.
- Input tokens / min: prompt tokens the models may process per minute.
- Output tokens / min: tokens the models may generate per minute, limited separately from input because generation, not reading, is the scarce direction.
- Max concurrent: how many requests may be in flight at the same moment.
429: back off briefly and retry, see error handling.
Getting higher limits
To unlock the higher Basic limits, open Billing, click Add credits, and complete a purchase of at least $5. Manual top-ups and successful auto-recharges both qualify. Opening checkout, adding a card, or an unsuccessful payment does not change your limits. The updated limits take effect once the payment settles and the network refreshes your organization’s settings. For Pro or Enterprise features and limits, contact our team from the dashboard:1
Open the plans dialog
Sign in and click Upgrade Plan in the sidebar (it reads Your Plan on organizations already on Pro or Enterprise).
2
Request a plan upgrade
Pick Pro or Enterprise and click GET A QUOTE. Describe the plan features and any custom requests, tokens, or concurrency limits you need. Our team reaches out, usually within one business day. Enterprise also unlocks data residency, monthly invoicing, and dedicated compute. The dashboard’s Support tab reaches the same team. You do not need a quote to unlock the higher Basic limits through a qualifying credit purchase.