mrkeyoor.com_
Fri 16 Oct 18:51 UTC
AI Toolsevaluationupdated 14 Oct 2026

interference-search review

Interference Search explores several possible solutions at once, merges repeated states, and uses a judge to decide which branches deserve more work. It is a research codebase for arithmetic puzzles and generated programs, useful for studying how search can reduce repeated reasoning.

+1 / 1dstars / 7d
Verdict

Our Interference Search run installed 64 packages into a 5,380 MB environment and passed its build and test command, making it a workable research checkout with a substantial footprint. Use it to investigate explicit-state search when you can define state equivalence and a judge yourself. Its small coding comparison and Apple-only model experiments do not justify adopting it as a general coding-agent replacement.

We ran it

Lab card: what happened when we ran interference-searchScreenshot of interference-search (github.com/Badtheorylabs/interference-search)
Install✓ · 178s64 packages · 5380 MB
Build✓ · 4s
Tests✓ · 109s96 passed · 0 failed · 5 skipped of 96 (pytest)
Known vulns0(pip-audit)
Repo432 files~18,303 lines of source · 108 MB · 0 CI workflows · Dockerfile · tests dir

Answers from our run

Does interference-search build from source?

Dependencies installed in 178 seconds (64 packages), and the build succeeded in 4 seconds. We cloned commit 3558570 into a clean Debian container with 3 CPUs and no project-specific setup.

Do interference-search's tests pass?

Yes: 96 of 96 passed when we ran the project's own test command (pytest). Some failures need services or credentials a bare container does not have.

Does interference-search have known vulnerabilities in its dependencies?

pip-audit found none in the dependency tree at the time of our run.

Who should not use interference-search?

Linux users expecting the documented language-model experiments to run unchanged: the README says those MLX experiments need Apple Silicon and do not run on Linux yet.

What are the alternatives to interference-search?

Tree of Thoughts, LangGraph. Our Interference Search run installed 64 packages into a 5,380 MB environment and passed its build and test command, making it a workable research checkout with a substantial footprint.

Setup3/5Local checks passed, 5,380 MB footprint, Apple-only model experiments
Docs4/5Clear experiment boundaries, raw results, and disclosed negative findings
Community2/5180 stars, an October push, and only a small visible discussion history
Maturity2/5Passing local checks support research use, not broad agent adoption

Who it’s for

Researchers comparing explicit-state search with a single sequence of model-generated reasoning.
Python developers who can define moves, repeated states, and a reliable goal for their own problem.
Apple Silicon owners reproducing the documented MLX language-model experiments.

Who it’s NOT for

Linux users expecting the documented language-model experiments to run unchanged: the README says those MLX experiments need Apple Silicon and do not run on Linux yet.
Teams seeking established coding-agent gains: the README describes the code result as within noise and limits the reported experiments to one seed.
Developers expecting the bundled arithmetic judge to understand a new domain: custom domains must supply their own proposal, state-key, judging, and goal behavior.
Operators expecting the newer isolated Python runner to work in any ordinary environment: its source invokes sudo, prlimit, and bubblewrap at fixed system paths.

Setup reality

Our sandbox installed commit 3558570 in 178 seconds, adding 64 packages and occupying 5,380 MB. The build passed in 4 seconds and the test step succeeded in 109 seconds. The supplied pytest summary says 96 passed, 0 failed, and 5 skipped, while also listing a total of 96; those counts do not reconcile. Pip-audit reported 0 known vulnerabilities.

The documented search and arithmetic-judge path needs Python and PyTorch, without a hosted model API credential. Language-model experiments use MLX on Apple Silicon and need the relevant model assets. Docker and a Countdown reproduction script are documented.

The Linux sandbox result does not validate the Apple-only experiments. The newer isolated Python runner invokes sudo, prlimit, and bubblewrap, so its operating-system requirements need separate attention. Our repository scan found a tests directory and Dockerfile, but no CI workflow files.

Repeated search states are the problem it addresses

An arithmetic search can reach the same remaining numbers through different sequences of operations. Interference Search keeps explicit states, combines repeats, and advances a group of promising branches together. Its Countdown environment performs the arithmetic while a trained judge ranks the remaining choices. The useful distinction is where work happens: the environment executes moves, and the search controls which possibilities receive attention. A developer considering it needs a problem that can be represented that way.

Our clone contained 432 files and about 18,303 source lines, with a 108 MB checkout before dependencies. Alongside the library are model weights, raw experiment results, and research notes. That gives a researcher more to inspect than a diagram of the idea. It also makes this a repository to read and adapt, rather than an assistant you install and immediately ask to fix a production application.

What happened when we ran it

Our sandbox installed commit 3558570 in 178 seconds, pulling 64 packages and occupying 5,380 MB, then built successfully in 4 seconds. The October 14, 2026 run used an unprivileged Debian container with 3 CPUs, 8 GB of RAM, the uv Python 3.12 Bookworm image, and no secrets. Installation and packaging worked in that environment. The footprint is worth budgeting before keeping several experiment environments on the same machine.

The test command succeeded in 109 seconds. The supplied pytest record reports 96 passed, 0 failed, and 5 skipped, but also labels the total as 96. Those figures don't reconcile, so we retain the reported outcomes without calculating a pass percentage. Pip-audit found 0 known vulnerabilities. Our scan found a tests directory and a Dockerfile, with 0 CI workflow files. None of these results measures search quality on a new task.

A custom domain must define what counts as the same state

The search-loop source asks a domain to supply its starting state, proposals, merge key, judge, and goal or dead-end decisions. These are the substantive parts of an integration. In Countdown, remaining arithmetic possibilities provide a clear state. In a browser or coding task, apparently similar situations may still permit different actions. An incorrect merge key can discard a branch that had a distinct route to success.

The 5,380 MB environment buys you working components, not a ready-made definition of equivalence for your product. The newer frontier selector explicitly separates exact repeats from behavior signatures. Matching visible outputs can help keep a diverse set of candidates, but it does not prove programs will behave identically on unseen inputs. That care makes the source worth studying. You still have to decide which properties survive later revisions and which observations only describe a particular evaluation set.

The arithmetic result does not establish a coding-agent advantage

The README's results discussion says the experiments use a single seed and calls the coding comparison within noise. Its Countdown search uses a small trained judge and environment-generated moves rather than running the language model for every choice. That changes the interpretation of any speed comparison. The project is forthright about the systems differing, which is more useful than treating the result as proof that all model reasoning should be replaced.

Our 109-second test step confirms an available developer check completed. It cannot settle the research claim. The repository also records approaches that did not help, including prompting the model about previous failures and using a prompted judge. Those negative findings are a reason to read the research log before copying a technique. For adoption, I would require a task-specific comparison against a simpler search using the same proposals, budget, and evaluation conditions.

Linux covers the basic search, while MLX experiments need Apple Silicon

The documented arithmetic search and judge run wherever PyTorch does. The language-model experiments use MLX and require Apple Silicon, with Linux explicitly excluded from that documented path. A Linux developer can therefore inspect the algorithm and reproduce the arithmetic workflow without being able to follow every experiment unchanged. Choose the part of the project you actually need before assuming the optional language-model dependencies provide a portable execution route.

Our build took 4 seconds on Linux, which says nothing about the Apple-only experiments. Generated-code execution has another boundary: the newer isolated Python runner calls system sudo, prlimit, and bubblewrap, runs as nobody, and removes network access. Those requirements are visible in the source. The older program-domain runner uses a subprocess with timeouts. Check which runner your experiment invokes before assuming identical isolation or host prerequisites.

October activity supports research use with a narrow recommendation

GitHub recorded a last push on October 3, 2026, with release v1.2.0 on the same day, 180 stars, and no open items in its combined issues and PRs count. The visible issue history includes a closed research pull request. This shows recent work, but little public discussion from which to judge support under unfamiliar workloads. Apache-2.0 covers the project code, while the README separately identifies the sanitized MBPP data's license.

Tree of Thoughts is the more direct comparison for prompt-based branching research. LangGraph fits persistent agent workflows with human intervention. Interference Search deserves a trial when repeated states are wasting effort and you can define them accurately. Keep the 64-package local setup separate from the scientific decision: the useful experiment is whether your state definition preserves good solutions while spending less effort on duplicates.

Alternatives

ProjectWhat it isPick it when
Tree of ThoughtsA research implementation of branching and evaluating language-model reasoning.pick this instead when you want to compare prompt-based thought search using the documented OpenAI API route.
LangGraph gh↗An orchestration framework for stateful agents with persistence and human intervention.pick this instead when your task is operating a durable agent workflow rather than studying a search algorithm.

What people are saying

  1. [velocity-scout] Badtheorylabs/interference-search

Sources

  1. Interference Search README
  2. Measured search-loop source
  3. Exact and observed state selection
  4. Isolated Python runner
  5. Release v1.2.0
  6. Research pull request
  7. Tree of Thoughts
  8. LangGraph

More ai tools reviews

universal-modder · DeepEP-Ascend · DeepGEMM-Ascend · hypoarena · jeeves · faster-whisper · the whole board →