AnchorShell Relay documentation
Learn how to connect Relay, configure providers, apply limits, route requests, inspect usage, and operate the self-hosted or managed product.
Getting started
Configure Relay
- Providers and endpointsConfigure supported upstream connections and model paths without spreading provider details across application code.
- Routing lanes and fallbacksBuild manually ranked model paths and understand exactly when Relay selects, waits, requeues, or hands off.
- Queue and pacingUnderstand Relay request states, eligibility timing, rate-aware dispatch, and queue persistence boundaries.
- Limits and guardrailsApply shared resource policies and hosted user-specific request, token, and spend boundaries accurately.
- Usage and spendInterpret estimated tokens, provider-reported usage, configurable pricing, and request attribution.