mrkeyoor.com_
Sun 01 Nov 19:51 UTC
AI Toolsevaluationupdated 29 Sept 2026

new-api review

New API is a self-hosted gateway that puts OpenAI, Anthropic, Gemini, and other model providers behind one managed service. Its default README and linked documentation are available in English, while much of the issue activity is in Chinese. It solves the practical mess of routing requests, issuing client credentials, and tracking usage across several upstream accounts.

+362stars / 7d
Verdict

Our New API run built in 6 seconds, but 5 of 89 Go test packages failed, so adopt it only if its broad gateway console is worth your own release gate. It is a strong fit for an operator managing several providers, users, quotas, and protocol shapes from one service. Wait if you need a finished 1.0 release or cannot test your exact conversion paths and billing rules.

We ran it

Lab card: what happened when we ran new-apiScreenshot of new-api (www.newapi.ai)
Install✓ · 286s846 packages
Build✓ · 6s
Tests✗ · 483s84 passed · 5 failed of 89 (go test)
Repo2530 files~526,847 lines of source · 23.6 MB · 6 CI workflows · Dockerfile

Answers from our run

Does new-api build from source?

Dependencies installed in 286 seconds (846 packages), and the build succeeded in 6 seconds. We cloned commit c2b7a9a into a clean Debian container with 3 CPUs and no project-specific setup.

Do new-api's tests pass?

No. The project's own test command finished in 483 seconds and reported 84 passed, 5 failed (go test).

Who should not use new-api?

Organizations that cannot accept AGPLv3 obligations and the README's added visible attribution and original-project link requirements for modified user interfaces.

What are the alternatives to new-api?

LiteLLM, Portkey Gateway, One API. Our New API run built in 6 seconds, but 5 of 89 Go test packages failed, so adopt it only if its broad gateway console is worth your own release gate.

Setup3/5286-second install and quick build, but 5 test packages failed
Docs4/5English setup, topology, security, and development guidance
Community5/549,097 stars, September activity, and a large issue and PR queue
Maturity3/5Wide production scope, still on v1.0.0-rc.40 with failed tests

Who it’s for

Teams that want one private endpoint for OpenAI, Anthropic, and Gemini client protocols.
Operators who need user quotas, subscriptions, usage logs, and model pricing in the same console.
API businesses prepared to own licensing, upstream terms, billing accuracy, and local regulatory duties.
Go teams willing to test every protocol conversion their applications depend on.

Who it’s NOT for

Organizations that cannot accept AGPLv3 obligations and the README's added visible attribution and original-project link requirements for modified user interfaces.
Teams that require a green fresh-container suite before adoption: our run finished with 84 passing and 5 failing Go test packages.
Claude tool users assuming every protocol conversion is interchangeable: open issue 7593 reports Anthropic tools sent to an OpenAI-compatible upstream failing with HTTP 400 on v1.0.0-rc.40.
Operators looking for a finished 1.0 release: the latest release we found was v1.0.0-rc.40.
Anyone planning a public resale service without legal and operational staff: the README assigns filing, licensing, content safety, log retention, tax, and upstream authorization duties to the operator.

Setup reality

Our sandbox installed commit c2b7a9a in 286 seconds, covering 846 Go packages. The build succeeded in 6 seconds. The test step ran for 483 seconds and failed: 84 packages passed and 5 failed out of 89.

The local Docker path uses SQLite, but a working gateway still needs an administrator account, upstream provider credentials, enabled models, pricing, quota, and a New API-issued client key. The Compose example adds PostgreSQL and Redis and tells you to replace sample passwords and create a persistent SESSION_SECRET.

Production adds HTTPS, trusted proxy settings, backups, streaming and WebSocket proxying, plus shared secrets and storage across nodes. The repository includes 6 CI workflow files, a Dockerfile, and Compose configuration, but our complete Go test command did not pass.

Four client protocols meet in one gateway

New API earns attention because it does more than rename provider URLs. One service accepts OpenAI Chat and Responses, Anthropic Messages, and Gemini requests, then routes them to configured upstream channels. The console manages users, model access, quotas, subscriptions, usage logs, and expression-based pricing. For a team already juggling 3 provider accounts, that is a coherent reason to run a gateway rather than scatter credentials through each application.

The scope also changes the risk. A conversion layer sits between your client and the billable upstream request, while the same system records usage and decides quota. The README warns that protocol-specific fields do not always map exactly. Open issue 7593 makes that warning concrete: on v1.0.0-rc.40, a reporter reproduced Anthropic tools reaching an OpenAI-compatible upstream in the wrong shape and receiving HTTP 400. Test the precise model, endpoint, streaming mode, and tool path you plan to sell.

The 286-second install was easy to start and slow to trust

The repository gives you a friendly first route: one Docker container, SQLite, a mounted data directory, and localhost port 3000. After the setup wizard, you add an upstream channel, enable models, configure pricing and quota, and issue a New API client credential. That gets a private trial moving without PostgreSQL or Redis. It does not prove that your chosen protocol conversion, retry policy, or accounting path behaves correctly.

Compose is the more realistic production starting point. Its default stack adds PostgreSQL and Redis, and the README tells you to replace example passwords and generate a persistent SESSION_SECRET. HTTPS deployments need secure cookies plus an exact trusted origin. Multi-node installs must share the database and effective cryptographic secret, while rate limits need shared Redis if you want them enforced across nodes. These are ordinary gateway duties, but none disappears behind the web console.

What happened when we ran it

Our sandbox installed commit c2b7a9a in 286 seconds, covering 846 Go packages in a fresh Debian container with 3 CPUs and 8 GB of RAM. The build then succeeded in 6 seconds. The checkout held 2,530 files, about 526,847 lines of source, and occupied 23.6 MB before that setup. This is a substantial codebase, yet compilation itself was the shortest part of our run.

The Go test step failed after 483 seconds. Of 89 packages, 84 passed and 5 failed. The supplied end of the log shows successful results for service, service/authz, and several setting packages, followed by FAIL. It does not identify the five failures or explain their causes, so blaming missing Debian packages or a specific subsystem would be guesswork. The useful finding is simply that commit c2b7a9a did not clear its complete Go test run in our sandbox.

We found 6 CI workflow files, a Dockerfile, and Compose configuration, but no tests directory. Go projects often keep tests beside the code, so that directory layout alone says little. The 84 passing packages show meaningful test coverage was exercised. The 5 failures still need to be reproduced and understood before this service gets authority over credentials, access, and usage charges.

Billing and access control make this an operator's product

New API includes channel priorities and weights, retries, multiple upstream credentials, user groups, API restrictions, passkeys, two-factor authentication, and session management. It can also account for cached tokens and different pricing tiers. That combination suits an internal platform team or a lawful API operator far better than a developer who only wants to proxy one model from a laptop.

Public operation brings a separate burden. The README places responsibility for upstream authorization, content safety, real-name rules, log retention, tax, and any required filings on the operator. Its AGPLv3 terms also add visible attribution and a link back to the original project for modified versions with a user interface. Read those conditions before changing the console or selling access, rather than treating licensing as a deployment detail after the fact.

September activity is high, and the queue is enormous

GitHub recorded 49,097 stars and a last push on September 28, 2026. Two days later, search showed 742 open issues and 618 open pull requests, matching the repository API's combined count of 1,360. That is evidence of a very active project and a heavy review burden at once. Recent reports include the protocol-conversion failure in issue 7593 and a restart problem after database migration in issue 7595.

The latest release we found, v1.0.0-rc.40, shipped on September 21. It raised task-plugin source uploads to 8 MiB, accepted more successful upstream task status codes, and fixed media handling in tool results. Frequent release work is reassuring, but the rc label and our 5 failed test packages argue for pinned versions, backups, and a staging replay of real traffic. Choose New API for the breadth of its operating console, then make every conversion and billing path earn production access.

Alternatives

ProjectWhat it isPick it when
LiteLLM gh↗A model gateway and SDK with provider routing, budgets, and OpenAI-compatible APIs.pick this instead when broad provider support and a Python-centered gateway fit your stack better than New API's Go service and admin console.
Portkey GatewayAn open-source AI gateway focused on routing, fallbacks, observability, and guardrails.pick this instead when gateway policy and observability matter more than running a user, subscription, and resale console.
One API gh↗The earlier single-binary API management project on which New API is based.pick this instead when you want the smaller upstream project and do not need New API's wider protocol and task-plugin scope.

What people are saying

  1. [github-trending] QuantumNous/new-api

Sources

  1. New API README
  2. New API repository
  3. New API v1.0.0-rc.40 release
  4. Issue 7593: Anthropic tools conversion failure
  5. Issue 7595: restart failure after database migration

More ai tools reviews

skills · anarlog · pr-agent · agent-sprite-forge · KiroCrew · Orkas · the whole board →