In the rapidly expanding universe of AI models, developers face a chaotic reality: every provider has its own API, its own authentication, and its own billing system. Juggling keys for OpenAI, Azure, Claude, and a half-dozen others is a recipe for messy code and runaway costs. New API is an ambitious open-source project that aims to bring order to this chaos. It acts as a central gateway, a single point of entry that lets you manage, monitor, and monetize access to a wide array of LLM services.
At its core, New API is a sophisticated proxy server. You feed it your collection of API keys from various providers, and it exposes a single, unified API endpoint that is compatible with OpenAI's standards. This is its killer feature. Your applications only need to speak one language—the OpenAI dialect—and New API handles the translation and routing to the correct upstream service. This dramatically simplifies development and makes your applications model-agnostic.
The Business-in-a-Box Gateway
Where New API truly distinguishes itself from simpler proxies is in its extensive suite of management and billing features. It’s built with the assumption that you're not just using AI, but managing its use for others, whether they're internal teams or paying customers. The feature list reads like a checklist for a SaaS startup:
- User and Permission Management: You can create users, group them, and assign specific access rights. For example, you can create a token for the marketing team that only has access to a fine-tuned marketing copy model and has a hard spending limit.
- Cost Accounting and Billing: The system tracks usage per token or user, calculates costs based on model-specific pricing, and even handles billing statistics for cached responses. With integrations for Stripe and EPay, it provides a direct path to monetizing API access.
- Data Dashboard: A built-in web UI offers a visual console for monitoring usage, analyzing costs, and managing the system. This is crucial for administrators who need a clear overview of what's happening without digging through logs.
- Flexible Authentication: Support for OIDC, Discord, Telegram, and other login methods makes it easy to integrate into existing user systems.
This comprehensive feature set makes New API a powerful tool for organizations. A company's platform engineering team could deploy it to give developers self-serve access to AI models while maintaining central control over budgets and security. A startup could use it as the entire backend for a business that resells curated access to premium AI models.
The Bleeding Edge Has Sharp Corners
While powerful, New API is not a tool you can set and forget. Its biggest weakness is its maturity. The latest version, v1.0.0-rc.23, is a release candidate, not a final, stable release. This signals that the project is still in a state of flux. With over 1,100 open issues on GitHub, it's clear that the rapid pace of development is creating a long tail of bugs, feature requests, and necessary refinements. This is the classic trade-off: you get the latest features, but you also take on the risk of instability.
Another critical consideration is the AGPL-3.0 license. This is a strong "copyleft" license. If you use New API as-is, you're fine. But if you modify its source code and then offer it as a service to others over a network, you are legally obligated to make your modified source code publicly available. For many businesses looking to build proprietary technology on top of an open-source base, this is a non-starter.
The project's documentation is external, which is a good practice, but the sheer number of features means the quality of that documentation is paramount. An administrator will need to spend considerable time learning the system's intricacies to configure billing policies, manage user permissions, and troubleshoot routing issues correctly.
Community and Ecosystem
With over 44,000 stars on GitHub and a release just two days ago (as of this review), New API's community is undeniably massive and active. This is a double-edged sword. The popularity ensures a steady stream of feedback and a high likelihood that someone else has encountered any problem you might face. However, the high issue count suggests the maintainers may be struggling to keep up. This is a project for those comfortable navigating active, and sometimes chaotic, open-source communities.
It's also important to note its heritage as a fork or evolution of One API. New API maintains database compatibility with this predecessor, offering an upgrade path for existing One API users who need more advanced features. This positions One API as the more stable, conservative choice, and New API as the feature-rich, progressive option.
In a real-world stack, New API sits between your applications and the AI model providers. It becomes a critical piece of infrastructure, centralizing logic that would otherwise be scattered across multiple services. For any serious deployment, it should be run in a high-availability configuration and backed by a robust database like MySQL, not the default SQLite.