ODOCK.AI
ManagementRouting

Routing

Route model calls across approved candidates with failover, priority, or round-robin behavior.

Routing

Smart routing lets Odock choose among approved model candidates at runtime. It is configured at two levels:

  1. The organisation routing switch enables routing for the organisation.
  2. The API-key routing policy defines candidates and strategy for that key.

If the switch is disabled, requests behave as direct model calls. If the switch is enabled but a key has no routing policy, that key also behaves as a direct model call.

Runtime Flow

Routing never bypasses access grants. Every routing candidate must be a model the key can access.

Pages In This Submenu

On this page