S3_UPLOAD_BUCKET | Yes | Existing S3 bucket for uploaded workloads, chunk outputs, assembled output, and metrics. |
HF_TOKEN | For gated models | HuggingFace token for models such as Llama and Gemma. |
TD_API_KEY | Recommended | Shared API key for control plane authentication. |
KOI_SERVICE_URL | Optional | URL for optional Koi recommendations and lifecycle callbacks. Leave unset for standalone Orca behavior. |
ANTHROPIC_API_KEY | For LLM advisor | Enables the LLM placement advisor when the performance database is installed. |
ORCA_URL | Koi service only | URL Koi uses to call back to Orca/Tandemn System. |