mrkeyoor.com_
Thu 24 Sept 17:23 UTC
LLM Toolsevaluationupdated 24 Sept 2026

llm-wiki-compiler review

llmwiki turns source files and web pages into a local Markdown wiki whose pages retain citations, links, review state, and freshness information. It solves a specific problem for teams that keep asking an LLM to rediscover the same knowledge from raw documents.

Verdict

Our llmwiki build passed in 78 seconds, but its test suite was still running when our 900-second cap stopped it, so adoption should begin with a bounded pilot rather than a team-wide knowledge migration. Use it when compiled, reviewable Markdown is the product you want and repeated raw-document retrieval is the problem. Skip it for Windows-first security work, fast-changing logs, or any workflow that cannot put a person between generated knowledge and trusted knowledge.

We ran it

Lab card: what happened when we ran llm-wiki-compilerScreenshot of llm-wiki-compiler (llmwiki.atomicstrata.ai)
Install✓ · 18s448 packages · 601 MB
Build✓ · 78s
Tests✗ timed out · 900sran, no count parsed
Known vulns130 critical · 6 high · 6 moderate · 1 low (npm audit)
Repo2793 files~361,383 lines of source · 19.6 MB · 3 CI workflows · tests dir

Answers from our run

Does llm-wiki-compiler build from source?

Dependencies installed in 18 seconds (448 packages), and the build succeeded in 78 seconds. We cloned commit 3fa9f37 into a clean Debian container with 3 CPUs and no project-specific setup.

Do llm-wiki-compiler's tests pass?

We could not finish them: the suite was still running after 15 minutes in our container.

Does llm-wiki-compiler have known vulnerabilities in its dependencies?

npm audit flagged 13 known advisories in the dependency tree at the time of our run.

Who should not use llm-wiki-compiler?

Windows teams handling untrusted projects: the README says native Windows validation and CI remain outstanding, and open issue 217 still owns that work.

What are the alternatives to llm-wiki-compiler?

LlamaIndex, Haystack, RAGFlow. Our llmwiki build passed in 78 seconds, but its test suite was still running when our 900-second cap stopped it, so adoption should begin with a bounded pilot rather than a team-wide knowledge migration.

Setup3/518-second install, but Node 24 and provider setup are required
Docs5/5Commands, providers, limits, review policy, and recovery are documented
Community4/52,108 stars with active issues and pull requests in September 2026
Maturity3/5v1.3.0 is active; full tests timed out and Windows work remains

Who it’s for

Teams building a durable research, documentation, or standards wiki from sources that change less often than they are queried.
Developers who want citation-aware context packs for agents through a CLI, TypeScript SDK, or MCP server.
Organizations willing to review generated pages and enforce typed records, evidence rules, or lifecycle gates.
Node.js teams that can choose and fund an LLM provider, or operate a compatible local model service.

Who it’s NOT for

Windows teams handling untrusted projects: the README says native Windows validation and CI remain outstanding, and open issue 217 still owns that work.
Operators who need an out-of-core search engine: the v1.3.0 notes say binary storage removes a JSON limit, but retrieval still loads the embedding index into memory.
High-churn log or event streams: the README names these as a poor fit because compiled structure can become stale faster than people can review it.
Teams seeking deterministic documentation from source alone: compilation and full citation judging require an LLM provider, credentials, and review of generated material.
Buyers who require a complete clean test run before adoption: our suite was still running when the 900-second limit expired.

Setup reality

Our Node sandbox installed 448 packages in 18 seconds and used 601 MB. The build passed in 78 seconds. Tests timed out at 900 seconds while cases were still completing, and npm audit reported 13 known vulnerabilities: 6 high, 6 moderate, and 1 low.

The quick start needs Node.js 24 or newer plus an Anthropic key, another supported provider, or a compatible local service. Embeddings may need separate provider configuration. Read-only MCP tools can run without provider credentials, while compilation, queries, and the full evaluation path cannot.

There is no Dockerfile in the 2,793-file checkout. Windows safety validation remains open, and larger binary embedding stores still load into memory for retrieval. Teams must also decide how review queues, source freshness, and generated-page approval fit their work.

Node 24 turns raw sources into a persistent Markdown wiki

llmwiki asks you to spend model time before the question arrives. It ingests notes, papers, READMEs, transcripts, PDFs, images, or web pages, then compiles them into linked Markdown pages with source references and review state. Later queries work from that maintained wiki instead of reconstructing the same relationships from loose chunks. The useful distinction is persistence: an answer can become a page, changed sources can mark pages stale, and a person can inspect what the model produced.

The repository is much broader than a folder-to-Markdown converter. Version 1.3.0 includes typed profile records, workflow gates, a local viewer, exports, an MCP server, and a TypeScript SDK. The built-in AutoSci and Newsroom templates show how one compiler can enforce different records and transitions. That machinery pays off when the wiki itself is a maintained asset. For a one-off question over a few files, it is a lot of policy and state to own.

Runtime gates make generated pages reviewable, not automatically true

A profile can require fields, relations, evidence, artifacts, and lifecycle transitions before a write is accepted. External Open Knowledge Format bundles enter a review queue by default, and compilation can hold risky pages for approval. Those controls are more useful than a prompt that merely asks the model to cite sources. They give an operator somewhere concrete to reject a bad page and a lint command that can find broken citations, stale ownership, or schema drift later.

The boundary still matters. llmwiki uses an LLM to extract concepts and write pages, so a passing gate does not prove that every claim is correct. Full evaluation can ask another model to judge citation support, which adds cost and another model decision. The product makes review possible and records provenance; it does not remove the need to read important output. Teams with regulated or safety-sensitive knowledge should define who approves pages before they compile the first real corpus.

What happened when we ran it

Our sandbox installed 448 npm packages in 18 seconds and occupied 601 MB on disk. The build succeeded in 78 seconds. This was commit 3fa9f37 in an unprivileged Debian container with 3 CPUs and 8 GB of RAM. The checkout contained 2,793 files and about 361,383 lines of source, with npm workspaces and 3 CI workflow files but no Dockerfile. Setup was quick relative to the size of the codebase.

The test command did not finish before our 900-second limit. Its final lines showed individual cancellation and handoff cases still passing, some taking more than 16 seconds, followed by completed files for 104 identity-path tests and 15 viewer-journey tests. The log tail contains no final suite summary and no stated cause for the timeout. We can say the run exceeded our cap while work continued; we cannot call the suite passing or identify a defect from that output.

The npm audit found 13 known vulnerabilities: 6 high severity, 6 moderate, and 1 low, with none marked critical. That count is a dependency finding for the installed tree, not evidence that the viewer or MCP server is exploitable. Before deployment, inspect the actual advisories and whether affected packages sit on a reachable path. The measured result is still a reason to make dependency review part of evaluation rather than treating the successful 78-second build as the finish line.

Provider choice reaches beyond one API key

Node.js 24 or newer is the minimum. Anthropic is the default, while the README also documents OpenAI-compatible services, Ollama, GitHub Copilot, Atlas Cloud, OrcaRouter, Claude Agent SDK login, and Codex CLI login. Some choices need a separate embedding provider. Read-only MCP operations work without model credentials, but compile, query, and full citation judging do not. A serious trial should price page generation, embedding refreshes, and evaluation against the corpus you will maintain.

Storage has a visible ceiling too. Version 1.3.0 added binary embedding files for stores beyond the earlier 64 MiB JSON limit, yet retrieval still loads the index into memory. The release notes explicitly avoid claiming out-of-core search. Incremental compilation and content hashes reduce repeated work, but a large wiki still needs memory planning. If the source is a fast-moving stream, the README itself recommends raw search because review and repair can lag behind the input.

Linux is the supported choice while Windows validation remains open

The last push was September 23, 2026, and GitHub showed 2,108 stars plus 7 open issues and pull requests. Three open pull requests were receiving updates in the preceding days, while v1.3.0 had shipped on September 11. That is current activity, not an abandoned tag. The open count combines issues and pull requests, so it should not be read as 7 confirmed bugs.

One open item is decisive for platform selection. Issue 217 says native Windows filesystem guards, lock behavior, package launching, and a required Windows CI job still need validation. The release notes advise Linux for untrusted projects. Start there, pin the provider and configuration, compile a representative source set, then inspect the held pages and memory use. The 900-second test timeout makes that pilot a release gate, not a formality.

Alternatives

ProjectWhat it isPick it when
LlamaIndex gh↗A broad framework for indexing data and building retrieval-backed applications.pick this instead when you need programmable retrieval components rather than a Markdown wiki with a fixed compilation model.
Haystack gh↗A Python framework for composing retrieval, generation, and agent pipelines.pick this instead when your main job is assembling an application pipeline and Python is already your platform.
RAGFlow gh↗A document-focused RAG system with a web interface and service stack.pick this instead when users need a hosted document workspace more than a repository of inspectable Markdown pages.

What people are saying

  1. [github-trending] atomicstrata/llm-wiki-compiler

Sources

  1. llmwiki repository and README
  2. llmwiki v1.3.0 release
  3. Native Windows validation issue
  4. Open llmwiki issues and pull requests

More llm tools reviews

claude-skills · Humanizer-zh · agent-beacon · MiMo-Code · pi-claude-bridge · treg · the whole board →