ทันเอไอ

ngrok Unveils AI Gateway, a Single Gateway Connecting All Major AI Models with Automatic Failover When Models Go Down

ngrok launches AI Gateway, a unified gateway service that lets developers connect to multiple AI model providers through a single URL, featuring automatic model failover and support for local models

ngrok, the developer networking company, has launched a new product called AI Gateway via Product Hunt, pitching it as "a single personal gateway for every AI model" that allows developers to manage traffic to multiple AI models and providers through a single endpoint.

Key features of the service include automatic failover/fallbacks — when a primary model encounters issues or becomes unavailable, the system immediately switches to a backup model; Bring Your Own Key (BYOK) API key management that lets users plug in their own keys; access control; and observability for tracking model usage behavior.

Another notable point is that AI Gateway supports connecting to locally run models (Local LLMs) or self-hosted models through ngrok's private network, without needing to open public ports — reducing security risks for organizations that want to keep models within their own infrastructure.

According to ngrok's official blog and documentation, developers can use the service via the URL `gateway.ngrok.ai` with their existing OpenAI or Anthropic SDKs, with almost no code changes required. The service is currently in early access, meaning features and usage policies may change before the full launch.

Until now, a major challenge for development teams using models from multiple AI providers has been managing keys, API formats, and backup systems separately for each provider. A central gateway significantly reduces this burden. The AI Gateway market is drawing attention, with multiple players — from infrastructure companies to specialized startups — entering the competition.