What are Rate limits with Scaleway Generative APIs

Reviewed on June 20, 2025

What are the limits?

Any model served through Scaleway Generative APIs gets rate limited based on:

Tokens per minute (total input and output tokens)
Queries per minute (HTTP requests)
Concurrent requests (total simultaneous HTTP sessions)

Base limits apply if you registered a valid payment method, and are increased automatically if you also verify your identity.

Exact limit values are detailed in Organization quotas for Generative APIs. These values apply to your Organization, and are shared by all Projects within your Organization.

Tip

If you created a Scaleway account but did not register a valid payment method, stricter limits apply to ensure usage stays within Free Tier only.

How can I increase the rate limits?

We actively monitor usage and will improve rates based on feedback. If you need to increase your rate limits:

Verify your identity to automatically increase your rate limit as described below
Use Batches API for non-real time workloads. Requests performed through Batches API do not have a rate limit and are billed with a -50% discount compared to standard model prices.
Use Managed Inference, which provides dedicated capacity and does not enforce rate limits (you remain limited by the total provisioned capacity)
Contact your existing Scaleway account manager or our Sales team to discuss volume commitment for specific models that will allow us to increase your quota proportionally.

Why do we set rate limits?

These limits safeguard against abuse or misuse of Scaleway Generative APIs, helping to ensure fair access to the API with consistent performance.

How can I monitor rate limits?

Rate limit information is provided in HTTP response headers:

Header field	Example value	Description
x-ratelimit-limit-requests	600	Maximum number of requests allowed over a minute.
x-ratelimit-remaining-requests	599	Remaining number of requests allowed before reaching rate limit over a minute.
x-ratelimit-reset-requests	250ms	Time until rate limit requests usage resets to its initial value.
x-ratelimit-limit-tokens	1000000	Maximum number of tokens (input and output) allowed over a minute.
x-ratelimit-remaining-tokens	999976	Remaining number of tokens allowed before reaching rate limit over a minute.
x-ratelimit-reset-tokens	35ms	Time until rate limit tokens usage resets to its initial value.

You can see these headers by performing the following HTTP request, using the curl -i option:

curl -i https://api.scaleway.ai/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $SCW_SECRET_KEY" \
  -d '{
    "model": "mistral-small-3.2-24b-instruct-2506",
    "messages": [
      {
        "role": "system",
        "content": "You are a helpful assistant."
      },
      {
        "role": "user",
        "content": "Hello!"
      }
    ]
  }'

Still need help?

Create a support ticket