mrkeyoor.com_
Thu 12 Nov 16:01 UTC
LLM Toolsevaluationupdated 01 Nov 2026

TensorFold review

TensorFold is a model server for Apple Silicon and NVIDIA GPUs. Evaluate it when the documented checkpoint and backend match your deployment and you can qualify serving on that hardware. Our September 28, 2026 run at commit 34bae79 installed and built the historical Python package, but its test command failed. It did not validate model serving.

+113stars / 7d
Verdict

Evaluate TensorFold when your chosen release documents the checkpoint and hardware you intend to use. Our September 28, 2026 run at commit 34bae79 installed in 22 seconds and built in 3 seconds, but the test command exited 1. It did not validate model serving or assess the current native binary. The next useful step is a workload replay on the intended deployment configuration.

We ran it

Lab card: what happened when we ran TensorFoldScreenshot of TensorFold (github.com/ashhart/TensorFold)
Install✓ · 22s51 packages · 129 MB
Build✓ · 3s
Tests✗ · 192s777 passed · 75 failed · 157 skipped · 2 errors of 854 (pytest)
Known vulns0(pip-audit)
Repo476 files~73,794 lines of source · 11 MB · 0 CI workflows · tests dir

Answers from our run

Does TensorFold build from source?

Dependencies installed in 22 seconds (51 packages), and the build succeeded in 3 seconds. We cloned commit 34bae79 into a clean Debian container with 3 CPUs and no project-specific setup.

Do TensorFold's tests pass?

No. The project's own test command finished in 192 seconds and reported 777 passed, 75 failed, 157 skipped, 2 collection errors (pytest).

Does TensorFold have known vulnerabilities in its dependencies?

pip-audit found none in the dependency tree at the time of our run.

Who should not use TensorFold?

Readers seeking measured inference speed, usable context or serving memory requirements from this sandbox run.

What are the alternatives to TensorFold?

vLLM, llama.cpp. Evaluate TensorFold when your chosen release documents the checkpoint and hardware you intend to use.

Setup2/5Historical installation and build succeeded, but supported model serving still required separate hardware qualification. The visible evidence rubric assigns 2 to material limitations requiring qualification.
Docs4/5The pinned README details checkpoints, formats, backend requirements and exactness boundaries. Fitted-context and peak-memory measurements remain TBD, limiting the documentation's deployment evidence.
CommunityN/AThe supplied primary extracts do not corroborate the earlier star and activity rationale. They provide no supported basis for a numerical community assessment.
Maturity2/5The historical evaluation requires substantial further qualification: the sandbox suite failed and no supported serving workload was validated. This rating does not assess the current native release or establish a serving defect.

Who it’s for

Operators evaluating a checkpoint and backend documented for their chosen release.
Developers who want to compare drafted output with the same engine's serial output.
Inference engineers able to replay their workload on supported Apple Silicon or NVIDIA hardware.

Who it’s NOT for

Readers seeking measured inference speed, usable context or serving memory requirements from this sandbox run.
Teams requiring validated model serving before considering a deployment.
Operators applying current native installation instructions to the historical Python checkout.
Applications relying on required tool calls without checking the chosen engine's grammar support and request behavior.

Setup reality

Installation succeeded in 22 seconds; the build succeeded in 3 seconds. Installation added 51 packages with a recorded footprint of 129 MB. The test command exited 1 after 192 seconds.

The stored parser fields report 777 passed, 75 failed, 157 skipped and 2 errors, with total stored as 854. They do not establish exhaustive unique test coverage. Do not combine them into a new total or count skips as failures.

The pinned README requires Python 3.11 or newer and MLX 0.32.2 or newer on a Mac. Its NVIDIA instructions use NVIDIA's PyTorch container. Current documentation describes native executables, so select installation instructions for the release you intend to deploy.

Pip-audit recorded 0 advisories. Scan coverage is unknown: scannedPackages is absent, and the stored packages value of 0 does not identify which dependencies were scanned.

Should you evaluate TensorFold?

TensorFold's historical package installed and built in our sandbox, but the run did not validate model serving. Evaluate it when your checkpoint and hardware match the documentation for your chosen release and you can test your workload there. The failed sandbox suite leaves serving suitability unresolved.

The README pinned to the tested checkout describes a text-model server with an OpenAI-compatible API for Apple Silicon and NVIDIA GPUs. It lists specific checkpoints, formats, backends and drafting methods. Choose the checkpoint and release together before installing.

What the sandbox established

Our run was on September 28, 2026, at commit 34bae79 (full SHA: 34bae79ac97da6c3ab3fe10159cf49633ce8112a). The stored environment was a Debian Bookworm Python 3.12 image with 3 CPUs and 8 GB RAM.

Installation succeeded in 22 seconds; the build succeeded in 3 seconds. Installation added 51 packages with a recorded footprint of 129 MB. The test command exited 1 after 192 seconds.

The stored parser fields report 777 passed, 75 failed, 157 skipped and 2 errors, with total stored as 854. These fields are not a verified count of unique or exhaustive tests. No complete-log reconciliation or new execution was performed. Skipped tests were not failures.

The raw pytest footer reports 188.19 seconds, separately from the harness's rounded 192-second test-step duration. Neither measures inference speed. The MrKeyoor testing methodology explains the publisher's measurement approach, but its supplied current text does not establish which methodology revision applied to this run.

This run did not exercise a supported model or GPU deployment, benchmark generation, measure serving memory or validate an agent workload.

What the failures mean

The retained output repeatedly reports missing MLX in memory, checkpoint, completion and HTTP tests. It also reports missing mlx-lm package metadata in test_memory_budget.py. Those observations are consistent with a Debian environment lacking the documented Mac runtime, but they do not explain every failure.

Two named resume-chunk assertions received empty lists where [7] and [4] were expected. The lane-server output also includes a missing 'turn' key, and reasoning tests received HTTP 500 instead of 200. The retained tail does not establish whether these failures share a cause or explain the two recorded errors.

The harness detected a tests directory, no CI workflow files and no Dockerfile in this checkout. That does not establish whether external validation existed.

Pip-audit recorded 0 advisories. Its scan coverage is unknown, so this result cannot support a security assessment.

What exact drafting promises

The pinned README defines exactness against the same engine, weights, runtime and settings. It does not promise identical output across MLX and CUDA, quantizations or tensor-parallel rank counts.

Its suggested check is to compare a request with the same request using "draft": false. We did not perform that comparison. On your intended hardware, keep the configuration fixed and compare the outputs alongside your context, concurrency and restart cases.

The historical memory table leaves fitted-context and peak-memory results as TBD. Its budget ceilings are qualification slots, not measured minimum-memory requirements. Fitting the weights alone does not establish that your prompt, reply and cache will fit together.

Use documentation for the right engine

The supplied current README describes native serving without Python or MLX installation. That differs from the Python checkout tested here. Our historical package results do not assess the current native binary.

The current API documentation describes native token-grammar enforcement for required tool calls on supported engines. It also describes grammar-library requirements and refusal of structured requests where support is unavailable. These are documented capabilities, not behavior validated by our run. The supplied evidence does not establish the current status of the older issue reports, so they cannot support a blanket claim that required tool calls remain defective.

Before adoption, record the exact release, checkpoint revision, backend and applicable recipe. Replay ordinary replies, required tool calls, reasoning limits and context refusals on that configuration, then retain the requests and relevant startup logs.

When to evaluate an alternative

vLLM documents continuous batching of incoming requests. Evaluate it when that scheduling capability is part of your serving requirements. No comparative throughput was measured here.

llama.cpp documents CPU+GPU hybrid inference for models larger than total VRAM capacity. Evaluate it when that execution model fits your hardware plan. Its README also documents an OpenAI-compatible server; request behavior and performance were not compared with TensorFold.

How the ratings are assessed

The numerical ratings apply to the historical evaluation. The evidence rubric runs from 1 to 5: 1 means substantial barriers or weak support, 2 means material limitations requiring qualification, 3 means usable evidence with important gaps, 4 means detailed support with limited gaps, and 5 requires strong validation across the intended scope. An unassessed dimension has no numerical rating.

Setup ease is 2: installation and build succeeded, but serving still required qualification in a supported hardware environment. Documentation is 4: the pinned README specifies checkpoints, formats, backend requirements and exactness boundaries, while leaving fitted-context and peak-memory measurements unfinished. Maturity is 2 within this evaluation: the sandbox suite failed and supported serving was not validated. Those failures do not establish a serving defect.

Community is unassessed. The supplied primary extracts do not corroborate the earlier star and activity rationale, so there is no supported basis for a numerical community rating. This evidence gap does not establish weak adoption or maintenance.

Alternatives

ProjectWhat it isPick it when
vLLM gh↗An LLM inference and serving library that documents continuous batching.Evaluate it when continuous batching is part of your serving requirements; this review supplies no comparative performance measurement.
llama.cpp gh↗A C/C++ inference project with an OpenAI-compatible server and CPU+GPU hybrid inference.Evaluate it when CPU+GPU hybrid execution fits your hardware plan; verify checkpoint support and application behavior separately.

What people are saying

  1. [github-trending] ashhart/TensorFold

Sources

  1. TensorFold README
  2. TensorFold installation runbook
  3. TensorFold API fields
  4. TensorFold v0.3.6.1 release
  5. Issue 52: required tool choice is not enforced
  6. Issue 60: tool call dropped inside thinking

More llm tools reviews

google-ads-mcp · harness2 · mcp-server-guide · memorilla · 12-factor-agents · gemini-api-cli · the whole board →