API key authentication
SetTD_API_KEY in the server .env file:
Network options
Cloudflare Quick Tunnel
.env:
Administration
Security
Secure network access and API authentication for Tandemn System.
The Tandemn System control plane accepts connections from EC2 replicas over the network. If the endpoint is exposed through a tunnel or public URL, set an API key.
Replica-to-server communication uses this token. The key is distributed to replicas automatically at launch.
CLI users also need the key when the deployment requires authenticated requests:
Then pass the generated URL when starting the server or set it in
For production, deploy the control plane on a small EC2 instance in the same VPC as the inference replicas. This avoids public exposure and tunnel latency.