prox model

Register LLM deployments that agents can use. Agents declare a capability (e.g. gpt-4-class) — the platform resolves it to a registered model at deploy time.

Commands

model list

prox model list
# ID                  PROVIDER    DEPLOYMENT              CAPABILITY
# gpt4o-prod          azure       gpt-4o                  gpt-4-class
# gpt4o-mini-prod     azure       gpt-4o-mini             gpt-35-class

model register

prox model register \
  --id gpt4o-prod \
  --provider azure \
  --deployment gpt-4o \
  --capability gpt-4-class \
  --endpoint $AZURE_OPENAI_ENDPOINT \
  --secret azure-openai-key

model set-default

prox model set-default gpt4o-prod --capability gpt-4-class

model delete

prox model delete gpt4o-prod --confirm

Supported providers

ProviderValue
Azure OpenAIazure
Amazon Bedrockbedrock
Google Vertex AIvertex
IBM watsonxwatsonx
OpenAIopenai