How to manage allowed IP addresses for LLM Inference deployments

Allowed IPs restrict the IPs allowed to access your LLM Inference endpoints. In the absence of allowed IPs, all IP addresses are allowed by default.

Before you start

To complete the actions presented below, you must have:

• A Scaleway account logged into the console
• An LLM Inference deployment

How to allow an IP address to connect to a deployment

1. Click LLM Inference in the AI & Data section of the Scaleway console side menu. A list of your deployments displays.
2. Click a deployment name or «See more Icon» > More info to access the deployment dashboard.
3. Click the Security tab and navigate to the Allowed IPs section. A list of your allowed IP addresses displays.
4. Click Add allowed IP. The IP can be a single IP or an IP block.
   Note

   The IP must be specified in CIDR format, i.e. 198.51.100.135/32 for a single IP or 198.51.100.0/24 for an IP block.

5. Enter a single IP address or a subnetwork.
   Note

   To restore initial settings and allow connections from all IPs, delete all allowed IPs from the list.

How to delete an IP address from the allowed list

1. Go to your allowed IP address list.
2. Click «See more Icon» and select Delete.
3. A pop-up displays. Type DELETE to confirm.
4. Click Delete allowed IP.