Relay comparison

API relay vs direct provider access

Direct provider access is often the fastest way to start. A relay becomes useful when teams need consistent controls across apps, keys, users, or environments.

Direct provider access

Direct access is simple and has fewer moving parts. It is often enough for experiments and single-user scripts.

Relay access

A relay adds policy before the upstream request and logs after completion.

Prepaid balance protection
Per-key model policy
One request ledger

When to choose each

Use direct access for minimal prototypes. Use a relay when multiple people, environments, or customer-facing features share AI spend.

FAQ

Does a relay add latency?

A gateway adds a small network hop, usually accepted for policy and auditability.

Can a relay still use OpenAI-compatible SDKs?

Yes, when it exposes compatible base URLs and request formats.