mrkeyoor.com_
Tue 10 Nov 23:48 UTC
LLM Toolsevaluationupdated 01 Nov 2026

OpenKB review

Choose OpenKB if you want a generated Markdown wiki you can inspect and are prepared to review its rewrites. OpenKB compiles documents into an interlinked Markdown wiki. Our run on September 27, 2026, used commit ff54396; installation succeeded, but the test command exited 1. We did not test document ingestion, answer quality, model costs, or a deployed Workbench.

+13stars / 7d
Verdict

Try OpenKB on a small representative collection if you want an inspectable Markdown wiki and can review generated changes. Our run installed successfully, but missing FastAPI imports prevented a clean test result. Treat ingestion quality, costs, retrieval accuracy, and deployment behavior as questions for your own evaluation before relying on the wiki.

We ran it

Lab card: what happened when we ran OpenKBScreenshot of OpenKB (pageindex.ai)
Install✓ · 47s139 packages · 615 MB
Build✓ · 4s
Tests✗ · 148s1075 passed · 0 failed · 4 errors of 1079 (pytest)
Known vulns2(pip-audit)
Repo293 files~54,840 lines of source · 29 MB · 2 CI workflows · tests dir

Answers from our run

Does OpenKB build from source?

Dependencies installed in 47 seconds (139 packages), and the build succeeded in 4 seconds. We cloned commit ff54396 into a clean Debian container with 3 CPUs and no project-specific setup.

Do OpenKB's tests pass?

No. The project's own test command finished in 148 seconds and reported 1075 passed, 0 failed, 4 collection errors (pytest).

Does OpenKB have known vulnerabilities in its dependencies?

pip-audit flagged 2 known advisories in the dependency tree at the time of our run.

Who should not use OpenKB?

Editors who need manual changes to generated pages to survive recompilation.

What are the alternatives to OpenKB?

AnythingLLM, LightRAG, PageIndex. Try OpenKB on a small representative collection if you want an inspectable Markdown wiki and can review generated changes.

Setup3/5On the visible 1-to-5 rubric, successful installation supports a usable foundation, while model configuration and missing FastAPI imports qualify setup readiness.
Docs5/5The supplied README and configuration guide provide concrete installation, model, authentication, wiki, and interface instructions. This assesses documentation detail, not verified compatibility.
Community3/5Limited editorial assessment based on documented issue and pull-request contribution routes. Adoption, maintainer response times, and contribution throughput were not measured.
Maturity3/5The stored parser summaries contain passing results and four collection errors. Ingestion, retrieval quality, and deployment were not tested, limiting conclusions about readiness.

Discussed on

  1. hnOpenKB: A Vectorless Knowledge Base for Long Documents3 points

Who it’s for

Researchers who want summaries, concepts, entities, and cross-links stored as Markdown.
Obsidian users who want to browse a generated wiki as a vault.
Developers willing to configure an LLM and check generated pages against their sources.
Teams evaluating a small representative collection before committing to a larger import.

Who it’s NOT for

Editors who need manual changes to generated pages to survive recompilation.
Teams requiring verified ingestion throughput, retrieval accuracy, or operating costs: our run measured none of these.
Users expecting the documented long-PDF indexing path to cover every supported format.
Operators exposing the Workbench without configuring authentication.

Setup reality

Our sandbox run on September 27, 2026, used commit ff54396. Installation succeeded in 47 seconds, adding 139 packages with a recorded footprint of 615 MB. The build step returned zero in 4 seconds; its saved output tail is empty, so that result does not establish that the CLI or Workbench completed a workload.

The test command exited 1 after 148 seconds. The stored parser summaries record 1,075 passed, 0 failed, 4 errors, and 0 skipped, with a total field of 1,079. These are recorded parser summaries, not verified exhaustive counts of unique tests. The raw tail identifies missing FastAPI imports in four test modules.

A working knowledge base also needs an LLM configuration and the provider's authentication method. The documented Workbench requires the web extra. Pip-audit recorded 2 advisories across 2 packages; scan coverage is unknown because the record has no scannedPackages value.

Should you choose OpenKB?

Choose it when the generated wiki itself is useful to you: summaries and shared concept pages that you can open, inspect, and query. OpenKB compiles documents into an interlinked Markdown wiki. Its README documents ordinary Markdown files with wikilinks, Obsidian integration, query and chat interfaces, and generated agent skills.

The practical trade-off is ownership of generated text. The compiler updates existing concept and entity pages as documents arrive, and the README explicitly says recompilation overwrites manual edits. Keep copies of edits you need to preserve and check generated summaries against the original documents.

What our sandbox established

Our run on September 27, 2026, used commit ff54396. The matching sandbox record specifies Python 3.12 on Debian Bookworm, 3 CPUs, and 8 GB of memory. Installation succeeded in 47 seconds and the build step returned zero in 4 seconds. Neither outcome proves that document ingestion, a query, or a browser session worked.

The harness records each command's outcome, exit code, elapsed time, and parsed test counts. Its stored parser summaries record 1,075 passed, 0 failed, 4 errors, and 0 skipped, with a total field of 1,079. Those figures do not establish exhaustive unique test coverage; we have not reconciled a complete log or performed a new execution.

The test command exited 1 after 148 seconds. The raw log reports missing FastAPI imports in tests/test_api.py, tests/test_api_documents.py, tests/test_api_watch.py, and tests/test_stream_disconnect.py. These were collection errors, not four failed assertions. Unlike the earlier page's explanation, the supplied log does identify the immediate exception: ModuleNotFoundError for fastapi. It does not establish whether installing the optional web dependencies would make the affected tests pass.

Pip-audit recorded 2 advisories across 2 packages. The record does not include advisory identities or scannedPackages, so scan coverage is unknown. This is an advisory result, not a security assessment.

The MrKeyoor testing methodology explains how command outcomes and measurements reach reviews. That page describes the publisher's procedure; its current text does not establish which methodology version governed this September run. This correction uses the saved run, not a new execution.

What setup still requires

The configuration guide separates model settings in .openkb/config.yaml from credentials in the environment or a .env file. Authentication depends on the provider; some documented providers use OAuth rather than an API key. Local model runtimes are supported, but the guide warns that slow compilation calls can require longer timeouts.

Our installation time measures package setup. It says nothing about ingestion duration, token consumption, or the quality of the resulting wiki. We did not test provider authentication, document compilation, retrieval accuracy, generated skills, or deployment.

The README documents PageIndex tree indexing for PDFs of at least 20 pages. Extending long-document handling to other formats remains on its roadmap. Broad input-format support therefore should not be read as identical processing for every format.

What to check before keeping the wiki

Use a small copy of documents whose contents you know. Inspect whether summaries preserve their qualifications, whether concept pages combine sources sensibly, and whether answers point to supporting material. These are suggested evaluation steps, not work completed in our sandbox.

Recompile only after preserving manual changes you need. The documented command regenerates summaries and rewrites concept pages. A readable file format lets you inspect the output; it does not establish its accuracy.

For the Workbench, install the documented web extra and configure authentication before exposing the service. The README says authentication is off by default and identifies OPENKB_API_TOKEN as the setting that requires a bearer token. Our run did not verify this deployment configuration.

When an alternative fits better

AnythingLLM documents a chat interface with document uploads and source citations. Consider it when document chat is your main requirement. Its README also lists desktop downloads and self-hosting options; multi-user permissioning is specifically listed for the Docker version. We did not compare its answer quality or installation with OpenKB.

LightRAG combines knowledge graphs and vector embeddings. Consider its server and REST API when you are building retrieval into an application. Its documentation recommends the REST API for integration and describes the SDK as primarily intended for embedded applications or research. It also warns that its default storage is for small-scale evaluation and recommends configured production backends. This is an architectural alternative, not evidence that it is faster or cheaper for your corpus.

PageIndex is a component OpenKB already uses for long-document retrieval. Evaluating that component separately makes sense if tree indexing is your whole requirement; it is a complement within OpenKB, rather than an equivalent wiki application.

How to read the scores

These editorial scores use a 1-to-5 rubric: 1 means substantial evidenced obstacles, 3 means usable foundations with material qualifications, and 5 means strong evidence for the named dimension. Intermediate scores fall between those anchors. They are judgments about the supplied evidence, not benchmark results or adoption measurements.

Setup ease is 3 because installation succeeded but model configuration remains and the test environment lacked FastAPI. Documentation is 5 for the concrete installation, configuration, provider, wiki, and interface instructions available in the supplied README and configuration guide; that rating does not certify every instruction. Community is 3 as a limited editorial assessment of the repository's documented contribution routes, not a finding about adoption or response times. Maturity is 3 because the recorded run contains passing results alongside collection errors, while important workloads remain untested.

Alternatives

ProjectWhat it isPick it when
AnythingLLM gh↗A document-chat application with agents, desktop downloads, and self-hosting options.Choose it when a chat workspace with uploads and citations is your main requirement. Its documented multi-user permissioning is specific to the Docker version.
LightRAG gh↗A retrieval framework and server combining knowledge graphs with vector embeddings.Choose it when integrating retrieval through a server API matters more than maintaining generated Markdown pages. Plan its storage configuration separately; the documented defaults are intended for evaluation.
PageIndex gh↗The tree-indexing component OpenKB uses for long-document retrieval.Evaluate it separately when document tree retrieval is the whole requirement. Within OpenKB it is a component, not a replacement for the compiler and wiki interfaces.

Sources

  1. OpenKB README
  2. OpenKB v0.4.5 release
  3. OpenKB configuration guide
  4. OpenKB REST API and Workbench guide
  5. OpenKB bulk ingestion issue 203
  6. OpenKB generated brief validation issue 225
  7. OpenKB prompt growth issue 226
  8. OpenKB Python 3.14 install issue 238

More llm tools reviews

mcp-server-guide · memorilla · 12-factor-agents · gemini-api-cli · MCPJungle · octomind · the whole board →