mrkeyoor.com_
Tue 20 Oct 13:43 UTC
AI Toolsevaluationupdated 20 Oct 2026

PilotDeck review

PilotDeck is an AI assistant that organizes ongoing work into projects with their own files, memory, and skills. It provides English and Chinese documentation and lets you inspect and edit remembered information. It targets recurring work that needs more continuity than a single conversation.

Verdict

Our PilotDeck build succeeded in 27 seconds, but the overall test command failed after 124 seconds, leaving reliability unresolved in this sandbox. Try it when inspecting and correcting project memory is a requirement you can evaluate with a bounded task. Keep unattended execution behind your own artifact and permission checks until that workflow earns trust.

We ran it

Lab card: what happened when we ran PilotDeckScreenshot of PilotDeck (pilotdeck.openbmb.cn)
Install✓ · 39s1451 packages · 1126 MB
Build✓ · 27s
Tests✗ · 124sran, no count parsed
Repo2103 files~348,067 lines of source · 20 MB · 9 CI workflows · Dockerfile · tests dir

Answers from our run

Does PilotDeck build from source?

Dependencies installed in 39 seconds (1451 packages), and the build succeeded in 27 seconds. We cloned commit 52660d5 into a clean Debian container with 3 CPUs and no project-specific setup.

Do PilotDeck's tests pass?

No. The project's own test command exited unsuccessfully after 124 seconds, and its output did not expose an individual test count.

Who should not use PilotDeck?

Teams requiring a green complete test command as an adoption gate: our run failed after 124 seconds despite a successful build.

What are the alternatives to PilotDeck?

Goose, gptme. Our PilotDeck build succeeded in 27 seconds, but the overall test command failed after 124 seconds, leaving reliability unresolved in this sandbox.

SetupN/ASandbox installation and build passed, but model onboarding and a supported operating deployment were not reproduced.
DocsN/AThe README details provider and platform setup, but the linked tutorials and runtime behavior were not assessed for correctness.
CommunityN/ACurrent release, push, and issue activity were checked; maintainer responsiveness and sustained support quality remain unassessed.
MaturityN/AThe overall test command failed, and long-running tasks, memory correction, recovery, and permission enforcement were not evaluated.

Who it’s for

Engineers evaluating editable project memory for recurring research, reports, or document tasks.
Users who want separate workspaces and can configure a hosted or local model provider.
Operators willing to define permitted tools and verify saved artifacts before enabling background execution.

Who it’s NOT for

Teams requiring a green complete test command as an adoption gate: our run failed after 124 seconds despite a successful build.
Deployments standardized outside the supported Node 22 range: the source instructions require at least 22.13.0 and below 23.
Operators wanting to leave background work unsupervised immediately: the README describes task discovery and ongoing execution, which require explicit authority and output checks.
Developers relying on filename recovery for paths with spaces or non-ASCII characters without checking issue 662, which reports a defect in that web Git path.

Setup reality

Our sandbox installed commit 52660d5 in 39 seconds, recording 1,451 dependencies and 1,126 MB on disk. The build succeeded in 27 seconds. The test command failed with exit code 1 after 124 seconds. Its tail shows passing entries, then a lifecycle failure, without the diagnostic needed to identify the cause.

The web interface can open onboarding before the Gateway starts. Configure a provider, model, and credentials for a hosted service, or use the documented local Ollama route without an API key. MCP connections and custom tools need their own access decisions.

The README requires Node 22.13.0 or newer within the 22 series, below 23. It describes native-toolchain contingencies on macOS and Windows. Our 2026-10-17 sandbox had 3 CPUs and 8 GB RAM. The lab-node:22 label does not verify actual runtime or operating-system versions. We did not validate model execution or memory behavior.

When an assistant carries the wrong instruction into tomorrow's work, a longer conversation can make the mistake harder to find. PilotDeck's documented answer is a workspace with memory entries you can inspect and edit. That is a useful reason to try it for recurring projects. Our successful build gets the evaluation started, while the failed test command keeps the reliability question open.

Editable project memory is the reason to try it

The PilotDeck README describes separate files, memory, and skills for each workspace. It also describes a visible memory pipeline and a Dream Mode that consolidates stored material with rollback. For someone maintaining several research or document projects, the appeal is being able to correct the remembered instruction instead of restarting every conversation.

Those are documented capabilities, not behavior our sandbox validated. Workspace organization also does not establish a security boundary against a tool that can execute commands. Before granting access to important files, decide which directories and external tools the assistant may use. Separate project folders are helpful organization, but our measurements say nothing about containment.

The project includes a web interface, command-line access, and messaging front ends. English and Chinese documentation are available. I'd assess it through a repeatable project with a known output: a report assembled from a fixed source folder, for example. That makes an incorrect memory or missing artifact easier to notice than an open-ended request to be productive.

What happened when we ran it

Our sandbox installed PilotDeck commit 52660d5 in 39 seconds, recording 1,451 dependencies and 1,126 MB on disk. The build succeeded in 27 seconds. The test command failed with exit code 1 after 124 seconds. We ran it on 2026-10-17 with 3 CPUs and 8 GB of RAM, using the recorded image label lab-node:22.

The supplied test tail contains passing TAP entries about transcript replacement, recovery, session history, and web tool-result handling. Its last visible entry says the web reducer bounds huge live tool-result previews, followed by a lifecycle failure. There is no failing assertion or diagnostic in the excerpt that explains the overall exit. The numbered entries do not establish an overall passing-test count.

The repository scan found monorepo workspaces, a Dockerfile, a Compose file, a tests directory, and 9 CI workflow files. Those signals show supporting machinery around development, without changing the failed command result. The image label does not establish the actual Node or operating-system version. We did not measure task completion, memory accuracy, model quality, or unattended execution.

The browser can start before a model is configured

PilotDeck's README says a missing provider configuration starts the web interface without the Gateway and opens onboarding. Saving a valid provider, API key, and model starts the Gateway. A working page therefore does not by itself establish a working assistant. Hosted providers need the relevant credentials, while the documented Ollama route can use a local model without an API key.

The source instructions require Node.js 22.13.0 or newer within the 22 series, below 23, because of the built-in SQLite runtime. That is a specific compatibility boundary, not a reason to choose whichever Node release is newest. The instructions use the pinned pnpm version and filters that omit Electron packaging dependencies for a web-only setup. Check that distinction before taking on desktop packaging work you do not need.

Platform preparation can extend beyond JavaScript. The macOS installer notes Xcode Command Line Tools and Python with distutils. The Windows FAQ describes C++ build tools and Python when native packages fall back to source compilation. These are documented contingencies. They do not explain our test failure, whose diagnostic is absent from the supplied tail.

Background execution needs a job you can verify

The README describes an always-on mode that discovers candidate tasks, runs monitors, and writes deliverables to local files. That is attractive for recurring work, but it expands the operating commitment. A model provider, retained state, and the process running the agent all become part of the job. Define when it may act and what should make it stop before leaving it unattended.

MCP servers, custom tools, and lifecycle hooks provide extension points. Each connection changes what the assistant can reach. Start with a narrow set and a disposable output directory. The useful acceptance question is whether the expected file appears with correct content and an understandable record of the actions taken, rather than whether a long session stays busy.

Smart Routing is another documented feature, assigning different work to different models. The README publishes cost comparisons, but our run did not measure model spending or output quality. Do not budget around those comparisons without a workload of your own. A cheaper task result only helps if it still meets the requirement that sent the work to an assistant.

Goose and gptme suit different working habits

Goose offers a local desktop app, CLI, and API with MCP extensions. Compare it when your immediate need is a general local assistant across those interfaces.

gptme describes a personal agent that runs wherever a terminal runs, including SSH sessions and headless servers. Prefer that starting point if the terminal is already where you supervise work. PilotDeck earns consideration when visible workspace memory is the feature you specifically want to evaluate. We did not compare these projects' speed or task success.

Active maintenance leaves specific questions open

GitHub recorded a PilotDeck push on 2026-10-20 and a v2026.10.20 release that day. Open issue 662, updated that day, reports filename recovery problems involving spaces or non-ASCII characters in the web Git route. It concerns this repository's file handling, but it is a user report from after our measured commit, not an explanation of our test failure.

Try a disposable workspace with representative filenames and a memory entry you deliberately correct. Restart the service and ask for the same bounded output again. Keep background execution off until you can inspect what it remembers, what it changed, and where the result landed.

Alternatives

ProjectWhat it isPick it when
Goose gh↗A local general-purpose agent with a desktop app, CLI, API, and MCP extensions.pick this instead when a general local assistant across desktop and terminal interfaces is your immediate need.
gptme gh↗A personal agent designed to run in terminals, SSH sessions, and headless environments.pick this instead when you already supervise agent work from a terminal and want that to remain the starting point.

What people are saying

  1. [github-trending] OpenBMB/PilotDeck

Sources

  1. PilotDeck README
  2. Goose README
  3. gptme README
  4. Filename recovery report
  5. PilotDeck repository facts
  6. PilotDeck latest release

More ai tools reviews

rakazo · BeefTV · OpenDots · reelmimic · easyread · motion-video-kit · the whole board →