Skip to documentation

Realtime

Realtime

Watch requests wait, run, and finish across your configured models.

Realtime visualizes requests moving through waiting, dispatch, and completion. Watch preferred-model waiting and fallback across your configured capacity.

Dashboard

  1. Open Realtime.
  2. Send a request from Playground or your application.
  3. Watch the request move through the queue and selected model.
  4. Inspect a request to see timing, route, and limit details.

Waiting is not always an error. Relay can wait for a preferred model when it is temporarily busy or capped.

Hosted users can view their own activity. Team-wide views require the relevant plan and permission.

Realtime is a dashboard feature. Use Queue for a current request list or Logs for completed requests.

Next

Providers.