mrkeyoor.com_
Wed 11 Nov 06:25 UTC
Self-Hostedevaluationupdated 11 Nov 2026

run-ai review

NVIDIA Run:ai manages shared GPU workloads and resource policies on Kubernetes. Its repository includes the platform control plane, cluster services and an MCP server that lets AI assistants access Run:ai operations. Our sandbox checked that MCP server project, rather than deploying the full platform.

Verdict

Our Run:ai MCP server run passed all 20 recorded Go tests, but did not deploy the Kubernetes GPU platform. Existing Run:ai operators have a concrete reason to evaluate the adapter with scoped access. Teams choosing the platform still need a cluster trial that checks their own quota and workload policies.

We ran it

Lab card: what happened when we ran run-aiScreenshot of run-ai (docs.nvidia.com/run-ai)
Install✓ · 25s165 packages
Build✓ · 148s
Tests✓ · 72s20 passed · 0 failed of 20 (go test)
Repo29075 files~3,461,975 lines of source · 310 MB · 32 CI workflows · Dockerfile

Answers from our run

Does run-ai build from source?

Dependencies installed in 25 seconds (165 packages), and the build succeeded in 148 seconds. We cloned commit 036acf6 into a clean Debian container with 3 CPUs and no project-specific setup.

Do run-ai's tests pass?

Yes. The project's own test command finished in 72 seconds and reported 20 passed, 0 failed (go test).

Who should not use run-ai?

Teams seeking a standalone GPU runtime: Run:ai requires Kubernetes and adds control-plane and cluster services.

What are the alternatives to run-ai?

KAI Scheduler, Kueue. Our Run:ai MCP server run passed all 20 recorded Go tests, but did not deploy the Kubernetes GPU platform.

SetupN/AThe MCP server project passed its recorded steps, but full platform installation and live authentication were not reproduced.
Docs3/5On the visible 1-5 documentation rubric, the component map and authentication instructions provide a usable path with material gaps: client examples contain placeholder artifacts, and live operation was not verified.
CommunityN/AThe November 11 push and issues opened on November 10 do not establish support capacity or response-time expectations.
MaturityN/APassing MCP project checks do not establish cluster scheduling reliability, live authorization behavior or production platform maturity.

Who it’s for

Kubernetes platform teams evaluating shared GPU quotas and workload policies across departments or projects.
Existing Run:ai operators evaluating assistant access through the MCP adapter with scoped credentials.

Who it’s NOT for

Teams seeking a standalone GPU runtime: Run:ai requires Kubernetes and adds control-plane and cluster services.
A single team with dedicated GPUs and ordinary scheduling needs: the README says native Kubernetes scheduling may suffice.
Developers expecting the root Makefile to exercise the services: the README identifies those targets as placeholders.
MCP users without a Run:ai endpoint and authentication arrangement: the component requires a control-plane URL and credentials or client-supplied tokens.

Setup reality

Our November 10, 2026 run at 036acf6 covered ./runai-mcp-server/: installation succeeded in 25 seconds with 165 dependencies recorded, build succeeded in 148 seconds, and tests succeeded in 72 seconds. The Go summary recorded 20 passed, zero failed out of 20. These results do not establish a deployed Run:ai platform.

The MCP server needs a Run:ai control-plane URL. Stdio uses an environment-supplied service-account client ID and secret; HTTP uses a client-supplied Bearer token. Write tools default to disabled. Full platform installation separately needs Kubernetes infrastructure and control-plane and cluster services.

The sandbox configuration listed 3 CPUs, 8 GB RAM and golang:1.24-bookworm. Actual toolchain and operating-system versions are unverified without raw logs. Client configuration examples contain placeholder container registry names, and no live authenticated MCP operation or GPU workload was measured.

Run:ai manages shared GPUs; our run covered its MCP server

NVIDIA Run:ai puts a management layer around shared Kubernetes GPU infrastructure. Its README describes quotas across departments and projects, workload scheduling and centralized monitoring. Those capabilities are relevant when several teams share capacity and administrators need organizational resource policies.

Our successful sandbox result concerns a narrower part of that system: the Go project in runai-mcp-server/. This component exposes Run:ai control-plane operations to AI assistants through Model Context Protocol. Passing its recorded checks provides a starting point for evaluating the adapter. It does not establish that the Kubernetes platform was deployed or that GPU resources were shared correctly.

A platform team has two separate decisions: whether it needs Run:ai's management model and, if it already uses Run:ai, whether to connect an assistant to its operations. Assistant access introduces credentials and tool permissions that a successful Go build cannot settle.

What happened when we ran it

Our November 10, 2026 sandbox run installed the Run:ai MCP server project in 25 seconds, built it in 148 seconds and completed its test step in 72 seconds. At commit 036acf6, the recorded Go summary reported 20 passed and zero failed out of 20. Installation recorded 165 dependencies.

The measured project lived in ./runai-mcp-server/. The checkout around it was much larger: 29,075 files, approximately 3,461,975 source lines and 310 MB. Those checkout figures describe the monorepo, not the adapter's own implementation or installed dependencies.

The sandbox configuration listed 3 CPUs, 8 GB RAM and image golang:1.24-bookworm. Raw toolchain logs were not supplied to establish the actual Go or operating-system version. The record also contains no live control-plane request, deployed cluster, GPU allocation exercise or throughput benchmark. The passing summary provides no test-by-test inventory from which to infer those checks.

The scan found 32 CI workflow files and a Dockerfile, with no tests directory detected. That directory signal does not contradict the recorded passing Go tests. No vulnerability-audit result accompanies the supplied measurements.

The platform requires Kubernetes and separate operating components

The README divides Run:ai into a control plane and cluster services, both installed on Kubernetes. The control plane manages organizational resources and connected clusters. Cluster services handle scheduling and workload management where jobs run. Platform evaluation therefore requires a team that operates Kubernetes or intends to take on that responsibility.

The root documentation offers guided installation through a configuration YAML file and manual Helm deployment. It also describes a local Kind environment that builds services in containers. None of those paths was exercised by our MCP-server run. For a single team's jobs on dedicated GPUs, the README says native Kubernetes scheduling may be sufficient.

The repository warns that root Makefile targets are placeholders and directs developers into individual service directories. To reproduce component checks, identify the service first: a root-level command does not establish that the intended service was checked.

The MCP adapter needs a control plane and an authentication choice

The component README requires a Run:ai control-plane base URL. Its default stdio transport uses a service-account client ID and secret through environment variables. The documentation says credentials are not accepted on the command line. Obtaining an appropriately scoped account remains an operational prerequisite outside our sandbox evidence.

For HTTP mode, the README says the MCP client obtains a Bearer token from the Run:ai identity manager and presents it on each request; the server validates the token and forwards it downstream. HTTP therefore leaves the client responsible for obtaining and presenting the token. Our run did not verify identity discovery, token validation or authorization against a real deployment.

Write tools are disabled by default in the documented configuration. Evaluate inspection access before enabling tools that mutate Run:ai state. Our recorded checks do not establish which production permissions a particular account receives.

The README includes Claude Code and Cursor configuration examples, but their container image names use registry.example.com. Those examples require a verified replacement artifact. They do not establish client compatibility, and our run did not test those configurations.

KAI Scheduler and Kueue offer other evaluation paths

KAI Scheduler documents GPU sharing and hierarchical queues. Its README describes quotas, limits, priorities and fairness policies across multi-level queue hierarchies. Evaluate it when scheduling policy is the requirement and the broader Run:ai management layer is unnecessary. Run:ai's own README says it ships KAI Scheduler, so this is partly a component-versus-platform choice.

Kueue documents queueing and scheduling alongside kube-scheduler and job controllers. Consider it when admission, quotas and job integration fit the problem you need to solve. These are infrastructure evaluation paths; this record contains no comparative setup or scheduling-performance measurements.

What remains unassessed

GitHub metadata records a November 11, 2026 push; the supplied issues listing shows issues opened on November 10. This does not establish support responsiveness. Community support and production maturity remain unassessed, alongside setup ease for the full platform.

Documentation receives 3/5 on our editorial scale: 1 means missing basic instructions, 3 means a usable documented path with material gaps and 5 means detailed guidance verified in operation; 2 and 4 fall between. The component map and authentication instructions support the rating, while placeholder client artifacts require resolution and live operation remains unverified. This rating assesses the supplied documentation, not deployment success.

For an existing operator, the next useful check is an authenticated read through the MCP adapter against a nonproduction control plane. A team selecting the full platform needs a separate cluster trial of its quota and workload policies.

Alternatives

ProjectWhat it isPick it when
KAI Scheduler gh↗A Kubernetes scheduler with documented GPU sharing and hierarchical queues.Evaluate it when scheduling policy is the requirement and the broader Run:ai management layer is unnecessary.
Kueue gh↗Kubernetes queueing and scheduling that works alongside kube-scheduler and job controllers.Evaluate it when workload admission, quotas and job integration cover your infrastructure needs.

What people are saying

  1. [github-trending] dsx-ai-factory/run-ai

Sources

  1. NVIDIA Run:ai README
  2. Run:ai MCP server configuration
  3. KAI Scheduler README
  4. Kueue README
  5. Run:ai metadata
  6. Run:ai issues listing

More self-hosted reviews

sure · woodpecker · localthings · kubevirt · nvke · voxl · the whole board →