mrkeyoor.com_
Wed 16 Sept 22:11 UTC
AI Toolsevaluationupdated 26 Aug 2026

kong review

Kong Gateway sits between clients and APIs, LLM providers, or MCP servers to route traffic and apply shared controls. It handles load balancing, health checks, authentication, rate limits, TLS, logging, transformations, multi-provider AI requests, and MCP traffic policy through configuration and plugins.

+27stars / 7d
Verdict

Our Kong proxy-Wasm fixture built in 22 seconds and passed all 6 tests, but that result covers only a small Rust directory inside the gateway repository. Kong is a sensible shortlist choice when one boundary must govern APIs, several LLM providers, and MCP traffic. For a single model integration, its operational surface is hard to justify; for a platform, the mature proxy and plugin model can centralize policy that would otherwise spread across services.

We ran it

Lab card: what happened when we ran kongScreenshot of kong (konghq.com/install)
Install✓ · 11s65 packages
Build✓ · 22s
Tests✓ · 10s6 passed · 0 failed of 6 (cargo test)
Repo2499 files~4,264 lines of source · 16.9 MB · 24 CI workflows · tests dir

Answers from our run

Does kong build from source?

Dependencies installed in 11 seconds (65 packages), and the build succeeded in 22 seconds. We cloned commit fa9c3b6 into a clean Debian container with 3 CPUs and no project-specific setup.

Do kong's tests pass?

Yes: 6 of 6 passed when we ran the project's own test command (cargo test). Some failures need services or credentials a bare container does not have.

Who should not use kong?

Small applications calling one model provider with no shared traffic policy: Kong adds a separate proxy, configuration, upgrades, and failure domain.

What are the alternatives to kong?

Apache APISIX, Envoy, LiteLLM. Our Kong proxy-Wasm fixture built in 22 seconds and passed all 6 tests, but that result covers only a small Rust directory inside the gateway repository.

Setup3/5Quick Compose trial, followed by substantial gateway configuration
Docs5/5Deep installation, gateway, plugin, Kubernetes, AI, and MCP guides
Community5/544,039 stars with August pushes and detailed issue reports
Maturity5/5Long-running gateway with stable modes, plugins, and release lines

Discussed on

  1. hnKong 3.6 with LLM Support9 points

Who it’s for

Platform teams that need one gateway for conventional APIs, LLM traffic, and MCP endpoints.
Organizations standardizing authentication, throttling, observability, and routing across many services.
Kubernetes operators using Kong's ingress controller or teams separating control and data planes.
AI platform teams that want provider routing and policy at the network boundary instead of inside every application.

Who it’s NOT for

Small applications calling one model provider with no shared traffic policy: Kong adds a separate proxy, configuration, upgrades, and failure domain.
Teams that cannot protect an administrative control plane: the quick start exposes an Admin API on port 8001 and a management UI on port 8002 for local use.
Buyers assuming every AI, MCP, analytics, or portal feature is in the Apache-licensed gateway: the README separately describes commercial Konnect functionality.
Docker Compose users who cannot rename an upstream service called web: issue #14970 reproduces Kong 3.7 resolving that literal hostname to a failure placeholder on two platforms.
Anyone treating our green Rust fixture result as a full Kong test: the lab measured only a small proxy-Wasm fixture under spec.

Setup reality

Our sandbox entered spec/fixtures/proxy_wasm_filters, installed 65 Rust packages in 11 seconds, and built in 22 seconds. cargo test succeeded in 10 seconds with 6 passed and 0 failed out of 6. This is a proxy-Wasm fixture, not the Lua gateway, its plugins, PostgreSQL mode, or a running proxy.

The README's suggested trial clones the separate docker-kong repository and starts a PostgreSQL profile. Kong then exposes proxy traffic on port 8000, the Admin API on 8001, and Kong Manager on 8002. DB-less Docker is another documented route. AI and MCP use still requires upstream provider credentials, plugins, routes, policies, certificates, and protected administration.

Our test method used commit fa9c3b6 in an unprivileged Rust container with 3 CPUs, 12 GB of RAM, and no secrets. The repository had 2,499 files, about 4,264 source lines by the lab counter, 24 CI workflows, and a tests directory, but no Dockerfile. The narrow 6-test result should only support confidence in that fixture.

Kong puts API, LLM, and MCP traffic behind one gateway

Kong began as an API gateway and now presents the same boundary for model and agent traffic. Conventional services get routing, load balancing, health checks, TLS termination, authentication, authorization, rate limits, transformations, and logs. AI Gateway adds a common LLM API across OpenAI, Anthropic, Gemini, Bedrock, Azure AI, Databricks, Mistral, Hugging Face, and other providers. MCP support adds traffic governance, security, analytics, and generation of MCP interfaces from REST APIs.

That combination matters when a platform needs one policy point for several traffic types. Model providers differ in authentication, limits, and failure behavior, while MCP servers add tool permissions. A gateway keeps clients thinner and gives operators one place to stop traffic. Kong then becomes part of every request path and must be operated like critical network infrastructure.

The local trial opens 3 ports and uses PostgreSQL

The README recommends cloning the separate docker-kong repository, entering its Compose directory, and starting the database profile. Proxy requests arrive on port 8000. The Admin API listens on 8001, and Kong Manager appears on 8002. A DB-less Docker procedure is also documented for declarative configuration. Konnect offers a managed control plane for teams that prefer a hosted route, while the Apache-licensed gateway can run on containers, bare metal, or Kubernetes.

A successful proxy request is only the beginning. Production needs certificates, upstream health policy, protected administration, configuration promotion, backups, plugins, logs, and upgrades. AI use adds provider credentials, routing, and failure policy. MCP adds server identity, tool authorization, and audit requirements. Kong centralizes those controls; each still needs an owner and a test.

What happened when we ran it

Our sandbox measured spec/fixtures/proxy_wasm_filters at commit fa9c3b6. Cargo installed 65 packages in 11 seconds and built the Rust fixture in 22 seconds. Tests finished in 10 seconds with 6 passed and 0 failed out of 6. The environment was an unprivileged container with 3 CPUs, 12 GB of RAM, and no secrets. This result is clean and narrowly scoped.

The fixture is not Kong Gateway. It does not exercise the main Lua application, OpenResty, PostgreSQL mode, DB-less configuration, the Admin API, proxy routing, AI plugins, MCP controls, or the management UI. The repository scan found 2,499 files, about 4,264 source lines by the harness counter, 24 CI workflows, and a tests directory, but no Dockerfile. Buyers should not quote the 6 passing tests as proof that a Kong deployment or plugin set works.

Plugins supply policy and create compatibility work

Kong's plugin model is the practical center of the product. First-party and community plugins add authentication, traffic control, transformations, monitoring, serverless calls, and provider-specific behavior. Developers can extend the gateway in Lua, Go, or JavaScript. Declarative DB-less mode suits immutable configuration, while database and hybrid modes support other operational patterns. The Kubernetes ingress controller connects these gateway policies to cluster resources without changing the proxy's core job.

Plugins also touch streaming bodies, credentials, caches, and request phases where small mistakes create noisy failures. Issue #14967 reports that the response-transformer plugin logs a warning for every intermediate chunk of a large JSON response even though the final transformation succeeds. The report identifies an existing large-response test that does not assert log output. This is not a data-corruption report, but false warnings can flood logs and trigger alerts, so large or streamed responses belong in plugin acceptance tests.

DNS and administration deserve targeted failure tests

Issue #14970 documents Kong 3.7 failing to resolve an upstream container literally named web, while the operating system resolver and other container names work. The reporter reproduced the behavior on Docker Desktop and native Linux, and Kong substituted 127.0.53.53 before returning 502. Renaming the service to webui fixed it. The report is version-specific and does not establish the behavior in 3.9.3, but the minimal reproduction is relevant to Compose users.

Another current report says malformed foreign keys or workspaces can produce a generic 500 from the Admin API where a 400 with the actual validation message would be more useful. Gateway teams should test bad configuration as carefully as good configuration: invalid upstream names, unavailable DNS, expired vault secrets, oversized bodies, provider timeouts, and partial control-plane failure. A traffic gateway earns trust through failure behavior, not through a successful hello-world route.

Open source gateway and commercial platform are separate decisions

The repository is Apache 2.0 and includes the gateway, plugin development kit, DB-less mode, hybrid deployment, and Kubernetes integration. The README separately describes Konnect subscriptions with managed control plane services, analytics, a service catalog, and developer portals. AI Gateway marketing also groups many capabilities under a broad product name. Teams should map every required plugin and control to its actual edition before assuming the open repository covers the buying list.

Kong Community can be judged against APISIX or an Envoy-based platform. Konnect belongs against managed API platforms. LiteLLM is narrower for teams that only need model normalization and budgets. Existing Kong users can add AI and MCP policy incrementally. New adopters should confirm that general API governance justifies the wider system.

Current maintenance supports a production shortlist

GitHub showed 44,039 stars, 191 open issues and pull requests, and a last push on August 16, 2026. The latest GitHub release we fetched was 3.9.3 from June 17. Recent issues cover DNS, UTF-8 validation, Admin API status codes, response transformation, and vault secret deduplication. The later push and active reports matter more than the release date alone when judging health.

Kong belongs on the shortlist for a shared edge that must handle many services and now several AI protocols. Test the exact edition, deployment mode, and plugins with representative traffic. Include a provider outage, an MCP authorization failure, DNS failure, a large streamed response, and an unavailable database or control plane. If those tests feel excessive for the application, Kong is probably excessive too. If they match risks the platform already owns, centralizing them at a mature gateway is a reasonable decision.

Alternatives

ProjectWhat it isPick it when
Apache APISIXA plugin-driven cloud-native API gateway built on Nginx and etcd.pick this instead when its Lua plugin model, etcd control plane, and existing ecosystem better fit the platform.
Envoy gh↗A high-performance service and edge proxy used as a foundation for gateways and meshes.pick this instead when the team wants a lower-level proxy and will build more of the control plane itself.
LiteLLM gh↗An LLM-focused proxy that normalizes provider APIs, budgets, and model routing.pick this instead when model access is the primary job and general API or MCP gateway features are unnecessary.

Sources

  1. Kong Gateway repository and README
  2. Kong 3.9.3 release
  3. Kong AI Gateway documentation
  4. Kong DNS failure for upstream named web
  5. Response transformer chunk warning report

More ai tools reviews

eve · MemOS · LongCat-Video · Concat · DLSS5-Feeder · Concat · the whole board →