Skip to main content
Use the monitoring commands after a job has been submitted with tandemn deploy.

Progress and dashboard

The dashboard shows workload details, chunk progress, replica phase state, cost, ETA, throughput, quota usage, event logs, and metrics charts. It uses server-sent events with polling fallback.

Job and cluster state

Metrics

Metrics can include throughput, queue depth, KV cache utilization, scheduler state, GPU utilization, latency, and completion counters, depending on the replica state and server configuration.

Cleanup

Clusters are destroyed by default after job completion. Use --persist with tandemn deploy when you want to keep clusters alive.