1
Start the relay
linux/amd64.Admin UI and control API on :8081, OpenAI- and Anthropic-compatible inference API on :8080.
2
Sign in and run the setup wizard
On first boot the container prints a generated password for the user Open localhost:8081, sign in as
admin, and an admin token, to its log:admin with that password, and follow the setup wizard to add a provider’s API key and create a relay key.3
Make a request
Hit a snag?
Status codes and error codes, login problems, keys that stop working.
Next steps
Docker
Persisting data, pinning the master key, the Compose stack and the lean image.
Kubernetes
The Helm chart, migrations, scaling and monitoring.
Clients
Point the OpenAI and Anthropic SDKs at Relay.
Inference API
Endpoints, wire shapes, streaming and errors.