AI Gateway

Unified AI model access, intelligent routing and traffic management, compatible with OpenAI API format

What You Can Do

The AI Gateway is a proxy layer between your application and upstream AI providers. Simply replace the request domain with the gateway address to get unified authentication, rate limiting, usage statistics, and security protection.

Unified API Access

Single endpoint for 20+ mainstream AI models. Fully compatible with OpenAI API format; just replace the domain.

Key Lifecycle Management

Create virtual API Keys for developers, bind suppliers, set quotas and expiry. Real supplier keys are encrypted.

Security Protection

Built-in Prompt injection detection, sensitive content review (10 categories), PII identification and masking.

Smart Routing

Configure upstream AI suppliers by tenant or by Key. Multiple suppliers under one gateway with flexible routing.

Rate Limiting & Quota Control

RPM/TPM rate limiting at Key level, daily/monthly Token quotas at tenant level.

App-Level Access Control

App Keys support JWT user identity binding for per-user usage tracking and permission control.

Full-Chain Auditing

Every request records caller, model, Token usage, latency, and status code. Logs pushed to Kafka for long-term storage.

Request Flow

Developer→AI Gateway→Upstream AI Provider

1.Developer sends request with virtual Key to the gateway

2.Gateway validates Key → checks rate limit & quota → runs security checks

3.Gateway replaces virtual Key with real supplier Key and forwards the request

4.Extracts Token usage from response, records audit log, returns result to developer

Configuration & Usage

View the complete integration flow