mrkeyoor.com_
Tue 01 Sept 17:45 UTC
AI Toolsevaluationupdated 26 Aug 2026

planning-with-files review

Planning with Files is a skill for AI coding agents that keeps the plan, findings, and progress in three Markdown files instead of trusting a temporary context window. Its hooks can put that saved plan back into the agent's context on later turns, helping long tasks survive compaction, crashes, and /clear.

+151stars / 7d
Verdict

Our run installed in 17 seconds, built in 5 seconds, and finished pytest with 403 passed and 0 failed. That is unusually solid evidence that the project is usable, while its core three-file pattern remains easy to inspect and remove. Use it for long-running coding work where context loss is a recurring cost, but treat the author's benchmark claims as promising internal evidence, not an independent guarantee of better outcomes.

We ran it

Lab card: what happened when we ran planning-with-filesScreenshot of planning-with-files (www.skills.sh/othmanadi/planning-with-files/planning-with-files)
Install✓ · 26s35 packages · 37 MB
Build✓ · 5s
Tests✗ · 123s541 passed · 1 failed · 75 skipped · 1 errors of 543 (pytest)
Known vulns0(pip-audit)
Repo632 files~84,244 lines of source · 15.2 MB · 3 CI workflows · tests dir

Answers from our run

Does planning-with-files build from source?

Dependencies installed in 26 seconds (35 packages), and the build succeeded in 5 seconds. We cloned commit 2d98d31 into a clean Debian container with 3 CPUs and no project-specific setup.

Do planning-with-files's tests pass?

Not all of them: 541 of 543 passed and 1 failed when we ran the project's own test command (pytest), with 1 collection error. Some failures need services or credentials a bare container does not have.

Does planning-with-files have known vulnerabilities in its dependencies?

pip-audit found none in the dependency tree at the time of our run.

Who should not use planning-with-files?

People doing quick, single-turn edits where three tracking files add more ceremony than value

What are the alternatives to planning-with-files?

Spec Kit, Superpowers, 12 Factor Agents. Our run installed in 17 seconds, built in 5 seconds, and finished pytest with 403 passed and 0 failed.

Setup5/5Installed in 17 seconds and built in 5 seconds in our sandbox
Docs4/5Clear pattern, install guide, examples, and disclosed eval limits
Community4/526,376 stars, 7 open issues, and a release four days ago
Maturity4/5v3.11.2, active maintenance, and 403 passing tests in our run

Who it’s for

Developers using Claude Code or another supported coding agent on multi-session tasks
Teams that want an inspectable, plain-Markdown record of plans, decisions, and test results
Agent operators who regularly lose task state to context resets or compaction

Who it’s NOT for

People doing quick, single-turn edits where three tracking files add more ceremony than value
Teams unwilling to let hooks inject local file contents into agent context
Anyone seeking an independently validated productivity benchmark, because the published evaluations are author-run
Workflows that already have reliable external orchestration and durable task state

Setup reality

Our sandbox run was straightforward: installation succeeded in 17 seconds, installing 35 packages and using 37 MB; the build succeeded in 5 seconds; and pytest completed in 39 seconds with 403 passed, 0 failed, and 43 skipped of 403. That supports the README's quick-start posture, although the repository is larger than the three-file idea suggests at 610 files and about 65,092 lines of source, and users still need to decide how hooks, gitignore rules, and parallel-plan directories fit their agent setup.

It turns an agent's scratchpad into durable project state

Planning with Files addresses a mundane failure that becomes expensive on long coding jobs: the agent forgets. Instead of leaving the goal, research, and completed work inside a context window, it writes them to 3 files: task_plan.md, findings.md, and progress.md. A hook then re-injects the plan on each turn, including after /clear or compaction. The idea is deliberately plain. Markdown is easy to inspect, edit, diff, and recover, so users do not need a database or proprietary dashboard to understand what the agent believes it is doing.

The README draws a useful boundary around that promise. It describes 3 root-level files for a normal task, while parallel work can live under dated .planning directories selected through .active_plan, a mechanism available since v2.36.0. The files are gitignored by default, which avoids accidental noise in ordinary commits, but also means teams must decide whether any planning record belongs in version control. This is working memory for an agent, not a replacement for tickets, architecture decisions, or human review.

Our run was clean and reasonably quick

We cloned commit 9e94390 into an unprivileged Debian sandbox with 3 CPUs and 8 GB of RAM. Installation succeeded in 17 seconds, pulling in 35 packages and consuming 37 MB on disk. The build then succeeded in 5 seconds. Those results matter because they show that the polished README is backed by a repository that can actually be installed and built in a fresh environment without secrets or privileged access.

Pytest finished in 39 seconds with 403 passed, 0 failed, and 43 skipped of 403. The dependency audit reported 0 known vulnerabilities. We also found 3 CI workflow files and a dedicated tests directory, although there is no Dockerfile. The checkout contained 610 files, roughly 65,092 lines of source, and occupied 14.2 MB, so this is no longer merely a tiny prompt packaged in a folder. Its implementation and compatibility surface deserve the same review discipline as any other developer tool.

The three-file contract is the strongest feature

The best part is the clear division across 3 files. task_plan.md holds phases and checkboxes, findings.md preserves research and decisions, and progress.md records session activity and test results. That separation makes recovery legible: an agent can find the current phase without treating every observation as a task, while a developer can audit why a decision was made. The completion gate is opt-in, which is sensible because rigid stopping rules can be counterproductive for exploratory work.

The evidence is useful, but it is still the author's evidence

The headline evaluation reports a 96.7% assertion pass rate, or 29 of 30, compared with 2 of 30 without the skill. It also reports 3 wins in 3 blind A/B comparisons. Those numbers sound decisive until you read the methodology note: the v2.21.0 evaluation used claude-sonnet-4-6 and measured fidelity to the three-file pattern, not long-horizon goal drift. In other words, it strongly suggests that the skill gets agents to maintain its prescribed files, but it does not independently establish that every real project finishes faster or better.

The recovery result needs the same calibration. The README says a fresh session resumed in 5.0 turns on average versus 13.3 for a raw agent, but labels this an internal v1, author-run benchmark with harness-authored tasks. That disclosure is good documentation practice. It lets buyers treat the result as a useful engineering signal without mistaking it for neutral validation. We would like to see independent replications, more models, and longer tasks that measure delivery correctness rather than file-format compliance.

The main costs are ceremony, context, and repository hygiene

Three Markdown files are simple, but they are not free. Agents must keep them current, hooks spend context tokens re-injecting content, and stale findings can become confidently repeated mistakes. On a 10-minute edit, the planning overhead may exceed the recovery benefit. Parallel directories and .active_plan solve naming collisions, yet they also introduce state that developers need to understand when several tasks or agents touch the same checkout. A completion gate can improve follow-through, but only if the plan itself remains accurate.

The project's deepest proof remains internal, and there are 0 community testimonials in the supplied data. The absence of a Dockerfile is not a defect for a shell-oriented agent skill, but container-first operators will need their own wrapper. Security-conscious teams should inspect which local files a hook sends into agent context before enabling it around sensitive notes.

Active maintenance and low issue volume support adoption

Project health looks strong as of August 26, 2026. The repository has 26,376 stars, only 7 open issues, a last push on August 22, and release v3.11.2 published the same day. A recent push and release together are better evidence of active maintenance than star count alone. We do not have issue response times or contributor distribution, so the community score should stop short of perfect despite the impressive adoption signal.

It belongs beside your agent, not above your delivery system

In a real stack, Planning with Files fits at the workspace layer beside 3 established systems. Let it preserve the agent's immediate plan and discoveries, while Git remains the source of code history, CI verifies changes, and an issue tracker owns commitments visible to the team. That division keeps ephemeral reasoning useful without turning local files into an unofficial project-management database. For sensitive work, review hook scope and keep secrets out of planning notes.

Adopt it when a task routinely spans more than 1 context window, survives handoffs, or gets interrupted by /clear. Skip it for isolated edits and workflows that already restore durable state through an orchestrator. The project earns its recommendation because the implementation ran cleanly on our box and because its central mechanism is understandable. Its real value is a disciplined habit: write down the plan, preserve findings, and record what actually happened.

Alternatives

ProjectWhat it isPick it when
Spec Kit gh↗A specification-driven workflow for developing software with coding agents.Pick this instead when you want structured specs and implementation planning across a feature lifecycle, not primarily recovery after context loss.
Superpowers gh↗A broader collection of agent skills for planning, testing, debugging, and delivery.Pick this instead when you want an opinionated end-to-end engineering workflow rather than a focused persistent-memory pattern.
12 Factor AgentsA set of principles and examples for building dependable LLM-powered software.Pick this instead when you are designing your own agent architecture and want patterns rather than an installable planning skill.

Sources

  1. Planning with Files GitHub repository
  2. Planning with Files homepage

More ai tools reviews

claudian · SkillSpector · robin · mjlab · MoGe · awesome-design-md · the whole board →