Groq
GPT-OSS-120B Developer plan
Rate ceilings are not reserved throughput or achieved speed. Context 131,072; max completion 65,536 tokens.
Source ↗A rate limit is a ceiling. Reserved capacity is a different purchase.
GPT-OSS-120B Developer plan
Rate ceilings are not reserved throughput or achieved speed. Context 131,072; max completion 65,536 tokens.
Source ↗gpt-6.1-sol API usage-tier limits
Launch lists 10,000 RPM / 4,000,000 TPM; Grow 15,000 RPM / 40,000,000 TPM. Free unsupported. Usage/spend can raise the tier; actual account limits and achieved throughput were not checked.
Source ↗Together Serverless
Limit retries to the application latency budget. Provisioned throughput reserves selected model/family capacity under a separate SLA.
Source ↗Amazon Bedrock Runtime / Mantle
Embedding models may be RPM-only. Account age, payment and usage history can affect quotas; no automatic increase or common throughput promise.
Source ↗Cerebras Developer PayGo, GPT-OSS-120B
Models and limits may change without notice. Custom higher limits, SLAs and dedicated capacity require agreement; no production suitability inferred from a self-serve limit.
Source ↗Fireworks Batch jobs
For work that does not need an immediate answer. Not a blanket claim of immediate serving at half price.
Source ↗Claude Message Batches
Batch and Fast cannot be combined. Partner regional pricing and model-specific long-context conditions can differ.
Source ↗gpt-6.1-sol API
Fast 2× Standard; Ultrafast 6×. Long-context and regional conditions still matter; subscription use has different terms.
Source ↗Global Batch, selected supported models
Processing may occur in any Azure region. Data Zone Batch stays within its zone. Not every model supports every deployment type.
Source ↗Fireworks Reserved Throughput
Commitment required. Vendor lists a 99.9% uptime SLA, subject to service terms. Usage above reserved capacity is charged at Standard rates; no contract remedy independently reviewed.
Source ↗Fireworks Spot Serverless, select models only
Retry or fall back to Standard. Not reserved capacity and not every model.
Source ↗Global / Data Zone / Regional Provisioned
Model availability and capacity differ by type. Developer evaluation is a separate 24-hour-lifetime type with no SLA or data residency guarantee.
Source ↗OpenRouter US/EU in-region routing
Standard has data-policy routing but not these in-region features. Contractual SLA Enterprise only; paid rate limits pass through underlying provider.
Source ↗Your model, account, region and requested mode decide the actual limit. We have no live quota check, concurrency test or comparable latency trace.
Check the exact model and endpoint →