mrkeyoor.comAsk

exo-explore/exotested 29 Sept 2026commit 21a54c5

exo review

Our exo run installed 89 packages and used 530 MB, then pytest stopped in 9 seconds because exo_tools could not be imported, so it misses a basic fresh-container release gate.

  • Build 8 s
  • Tests failed
411 sto install
  • 89 packages
AI Toolsevaluationupdated 30 Sept 2026
+61stars / 7d

exo joins several computers into one local AI cluster, splitting a model across their combined memory and compute. It is built mainly for recent Apple Silicon machines, with automatic discovery, a dashboard, and APIs that existing OpenAI, Claude, Responses, and Ollama clients can call. Linux currently runs on CPU.

Verdict

Our exo run installed 89 packages and used 530 MB, then pytest stopped in 9 seconds because exo_tools could not be imported, so it misses a basic fresh-container release gate. Use it when several recent Macs are the hardware you already own and one model needs their combined memory. Choose a single-host runner for one capable machine, and choose a GPU server rather than exo's current CPU-only Linux path.

We ran it

Lab card: what happened when we ran exo
Lab card from our sandbox run
Screenshot of exo (github.com/exo-explore/exo)
github.com/exo-explore/exo
Install✓ · 411s89 packages · 530 MB
Build✓ · 8s
Tests✗ · 9sran, no count parsed
Known vulns2(pip-audit)
Repo883 files~89,617 lines of source · 7.5 MB · 2 CI workflows · tests dir

Answers from our run

Does exo build from source?

Dependencies installed in 411 seconds (89 packages), and the build succeeded in 8 seconds. We cloned commit 21a54c5 into a clean Debian container with 3 CPUs and no project-specific setup.

Do exo's tests pass?

No. The project's own test command exited unsuccessfully after 9 seconds, and its output did not expose an individual test count.

Does exo have known vulnerabilities in its dependencies?

pip-audit flagged 2 known advisories in the dependency tree at the time of our run.

Who should not use exo?

Linux teams expecting GPU inference: the README says Linux currently runs on CPU and describes GPU support as under development.

What are the alternatives to exo?

Ollama, MLX LM, vLLM. Our exo run installed 89 packages and used 530 MB, then pytest stopped in 9 seconds because exo_tools could not be imported, so it misses a basic fresh-container release gate.

Setup2/5411-second install, platform prerequisites, and tests did not start
Docs4/5Clear platform, RDMA, storage, API, and model instructions
Community5/547,720 stars, an October 2 push, and active issue work
Maturity3/5v1.0.71 shipped, but our supplied test entry point failed

Discussed on

  1. hnExo: Run your own AI cluster at home with everyday devices439 points
  2. hnEXO v1 Release3 points

Who it’s for

Apple Silicon owners combining recent Macs to run a model that does not fit on one machine.
Researchers testing pipeline or tensor parallel inference on a local cluster.
Developers who want familiar OpenAI, Claude, Responses, or Ollama API shapes in front of local models.
Operators comfortable managing model downloads, cluster discovery, and hardware-specific networking.

Who it’s NOT for

Linux teams expecting GPU inference: the README says Linux currently runs on CPU and describes GPU support as under development.
Mac users expecting the packaged app on an older OS: it requires macOS Tahoe 26.2 or later.
Buyers planning the RDMA path without Thunderbolt 5 hardware and matching OS versions across every Mac: both are explicit requirements.
Release pipelines that require a green fresh-container suite: our test command exited 4 because exo_tools could not be imported.
Teams standardized on a checked-in Dockerfile: our scan found none, while the README documents source, Nix, and macOS app routes.

Setup reality

Our sandbox installed 89 packages in 411 seconds and used 530 MB on disk. The build passed in 8 seconds. Tests stopped after 9 seconds with exit 4 because tests/conftest.py could not import exo_tools. Pip-audit reported 2 known vulnerabilities.

The source route needs uv, Node 18 or newer for the dashboard, and nightly Rust. macOS also needs Xcode's Metal toolchain and a pinned macmon build. The quick start does not ask for a hosted inference credential, but useful runs still need model downloads and enough memory for the chosen model.

The packaged app requires macOS Tahoe 26.2 or later. RDMA needs supported Thunderbolt 5 Macs, full interconnection, and matching OS versions. Linux is CPU-only today, and custom cluster namespaces must be configured when separate groups share a network.

v1.0.71 pools Mac memory while Linux stays on CPU

exo joins several computers so one model can use their combined resources. Automatic discovery finds nodes, a topology view tracks available hardware and network links, and the scheduler chooses how to split the work. The project supports pipeline and tensor parallel placement. That combination addresses a specific problem: a model is too large for one machine, but several machines are already available on the same network.

Apple Silicon is the center of the current design. The README describes MLX as the inference backend and shows recent Mac Studios working as a cluster. Linux has a source-install path, but its documented runtime is CPU-only while GPU support remains under development. That makes exo a poor match for a Linux team that already owns NVIDIA accelerators. The project's published benchmark material is also separate from our run, which did not measure model speed or output quality.

What happened when we ran it

Our sandbox installed commit 21a54c5 in 411 seconds, adding 89 packages and occupying 530 MB. The build completed successfully in 8 seconds. We used an unprivileged Debian container with 3 CPUs, 8 GB of RAM, Python 3.12, and no secrets. Pip-audit found 2 known vulnerabilities. Those results cover repository setup only because we did not load a model or assemble a multi-node cluster.

The test command failed after 9 seconds with exit code 4. Pytest was loading tests/conftest.py when Python raised ModuleNotFoundError: No module named 'exo_tools'. The log does not show why that module was unavailable, so blaming a missing system package or a packaging mistake would be guesswork. The defensible finding is narrower: the supplied test entry point did not reach the tests in our fresh container, even though installation and build had succeeded.

The checkout itself contained 883 files, roughly 89,617 lines of source, and occupied 7.5 MB. We found 2 CI workflow files and a tests directory, but no Dockerfile. That last detail matters for teams expecting the repository to define a container deployment. The README instead documents source setup through uv, a dashboard build through Node, a nightly Rust toolchain, Nix on macOS, and a packaged Mac app.

macOS 26.2 and Thunderbolt 5 define the RDMA path

The packaged app requires macOS Tahoe 26.2 or later. Source builds add Xcode's Metal toolchain and a pinned revision of macmon; the README warns that the Homebrew macmon 0.6.1 release crashes on Apple M5. The app also asks for permission to change system settings and install a network profile. These are manageable steps for a dedicated cluster, but they are more invasive than installing a normal desktop model runner.

RDMA requires supported Thunderbolt 5 Macs and cables, with every participating device connected to every other device. One Thunderbolt port on a Mac Studio is explicitly excluded. The README also says all nodes should run exactly matching macOS versions, including beta numbers, and enabling RDMA starts in Recovery mode with rdma_ctl enable. Two Macs on ordinary Ethernet can still explore exo, but they are outside the project's highlighted fast path.

Four API endpoints keep existing clients useful

exo documents 4 client-facing API routes: OpenAI Chat Completions, Claude Messages, OpenAI Responses, and Ollama chat. Each node also provides the dashboard and API on port 52415. That breadth means an application can often change its base URL rather than replace its client library. Instance creation is asynchronous, and a separate event stream tells the caller when the selected placement is ready.

Model handling still asks for operator judgment. exo can search Hugging Face, create a model instance, show its placement, and remove it later. Custom models that require trust_remote_code are disabled by default and must be enabled explicitly. Storage can be split across a default model directory, extra writable directories, and read-only stores such as an NFS mount. A 530 MB environment is therefore only the starting footprint; model weights are outside our measurement.

440 open issues and pull requests accompany same-day source activity

GitHub showed 47,720 stars and 440 open issues and pull requests combined on October 2, 2026. The search API split that queue into 211 issues and 229 pull requests, and the repository had been pushed the same day. That is active development rather than an abandoned release page. It also leaves a large review queue, so adopters should check their exact hardware, model, and OS combination in current issues before buying more machines.

The latest tagged release was v1.0.71, published April 23, 2026. Its notes include fixes for M5 Macs and RDMA, plus changes to model parsing and API tool calls. Six months between that tag and the October source activity does not prove neglect. It does mean a team choosing main instead of the release should identify which fixes it needs and pin a tested commit instead of treating the moving branch as a release channel.

The 411-second install makes exo a deliberate hardware choice

Our 411-second install and failed test entry point rule out a casual recommendation. exo makes sense when the desired model will not fit on one recent Mac and several compatible Macs are already in the room. Ollama or MLX LM carries less distributed machinery when one host is enough. vLLM fits a different buyer, one building a production service around datacenter GPUs rather than a local Apple cluster.

Before adopting exo, reproduce the full test command, clear the 2 audit findings, and load the actual model on 2 isolated nodes. Check discovery, placement, restart behavior, and output on the same macOS build that will run in service. The decision should turn on that result. An 8-second build proves the source compiles in our sandbox; it does not prove that a Thunderbolt cluster will stay healthy under your workload.

Alternatives

ProjectWhat it isPick it when
Ollama gh↗A local model runner with a desktop-friendly setup and its own widely used API.pick this instead when the model fits on one machine and simple local operation matters more than distributed sharding.
MLX LMApple's MLX-based toolkit for running and fine-tuning language models on Apple Silicon.pick this instead when one Mac has enough memory and you want direct Python or command-line control.
vLLM gh↗A language-model serving engine aimed at high-throughput accelerator workloads.pick this instead when production GPU throughput matters more than pooling personal Macs.

Sources

  1. exo README and setup guide
  2. exo v1.0.71 release notes
  3. exo open issues and pull requests

More ai tools reviews