mrkeyoor.com_
Wed 11 Nov 23:18 UTC
Dev Toolsevaluationupdated 11 Nov 2026

improve review

shadcn/improve is an agent skill for auditing a codebase and writing implementation plans that another agent or a person can follow. It separates deciding what to change from making the change, with a documented execution mode that delegates work to an isolated Git worktree. The advisor writes plans and reviews results while the user keeps the merge decision.

Verdict

shadcn/improve's execution instructions ask the worker to commit, then check scope with an uncommitted diff. Use the planning workflow if you want reviewable handoff documents, and inspect committed changes before trusting an execution approval. We have no measured evidence of agent quality or cost savings, so try one bounded task before adopting the workflow across a backlog.

We ran it

Screenshot of improve (github.com/shadcn/improve)

Answers from our run

Did you run improve yourself?

No. GitHub reports no primary language for it, and it carries no manifest our lab installs from, and no Dockerfile, so there was nothing standard to install, build or test. This review is written from the repository's own documentation.

Who should not use improve?

Users expecting the advisor to implement fixes directly: its hard rules restrict its source-writing role and point implementation to an executor.

What are the alternatives to improve?

GitHub Spec Kit, OpenSpec. shadcn/improve's execution instructions ask the worker to commit, then check scope with an uncommitted diff.

SetupN/AThe lab found no supported ecosystem and did not run installation or an agent-host workflow, so setup effort cannot be scored from execution evidence.
Docs4/5The README and pinned execution reference explain planning, drift checks, review and merge ownership in detail. The committed-change scope gap limits confidence in the review instructions.
CommunityN/ADated issue discussion exists, but the inspected sample cannot establish maintainer responsiveness, adoption or available support.
MaturityN/ASource instructions and a reported review gap were inspected, but no agent session or generated implementation was executed and evaluated in our lab.

Who it’s for

Maintainers who want to review evidence and scope before allowing an agent to edit source.
Teams handing work between agent sessions that need file paths, verification commands and stop conditions in a portable plan.
Developers willing to inspect both generated plans and the committed changes produced by an executor.

Who it’s NOT for

Users expecting the advisor to implement fixes directly: its hard rules restrict its source-writing role and point implementation to an executor.
Teams treating an execution approval as proof that all changed files were checked: the pinned instructions use a bare diff after requesting a commit, a gap reported in issue #30.
Buyers relying on guaranteed model-cost savings: the README's cheaper-executor premise has no measured cost result here, and actual model selection depends on the agent host.
Teams expecting unattended merges: the documented workflow leaves merging to the user.

Setup reality

We did not run shadcn/improve at commit cac56e1 on November 11, 2026. Our lab found no supported ecosystem, recorded language as null and found no Dockerfile. There are no installation, build, test or cost measurements for this skill; that is a limit of this run, not evidence that the skill cannot work.

The README documents npx skills add shadcn/improve and an agent that supports the Agent Skills format. You supply the agent host and its model access. Delegated execution requires a Git repository for worktree isolation. Publishing plans as issues additionally uses an authenticated GitHub CLI, and is an optional action.

The pinned execution reference names host-specific subagent and isolation settings. Verify those capabilities in your chosen host before assuming the same workflow or model selection. The advisor can read a repository without proving that its executor can provision and verify that repository in a fresh worktree.

The worker commits before the documented scope check

shadcn/improve's execution reference tells the worker to commit its changes, then tells the advisor to check scope with a bare git diff --stat. Those instructions leave a concrete review gap: a clean working tree can contain committed changes that the bare diff does not show. Before treating an execution approval as evidence that scope was respected, compare the worker's final commit with its starting point.

That concern affects the execution handoff, while the planning idea remains useful. Improve asks an advisor agent to inspect a codebase, identify changes worth making and write portable Markdown plans. You choose the findings that become work. A developer who wants to understand and approve the proposed change before code moves has a clear reason to try that workflow.

What happened when we ran it

We did not run shadcn/improve: our November 11, 2026 lab record for commit cac56e1 found no supported ecosystem, recorded language as null and found no Dockerfile. There is no install duration, passing suite or completed agent task to report. This result describes a mismatch with our automated runner's supported paths, without establishing that the skill fails in an agent host.

The distinction matters because the product is a set of agent instructions. Its useful output would be a plan that survives another session and leads to a correct, bounded change. Repository language detection cannot evaluate that. Neither can reading an example establish that a different model will follow it. Our judgment here rests on public instructions and a specific reported review weakness, with execution quality still unmeasured.

A plan can carry the context another session lacks

The README's handoff format calls for exact file paths, current code excerpts and commands with expected results. It also calls for scope boundaries, stop conditions and a recorded Git commit for checking drift. Those requirements address a common handoff problem: the executor may have none of the conversation that made the advisor's recommendation sound reasonable.

For the maintainer, the useful question is whether the plan carries enough evidence to challenge it. A path points you to the code. A command makes a completion claim inspectable. A stop condition tells the executor when an assumption has failed. These are good properties to request, although our review contains no evaluation showing that generated plans consistently satisfy them.

The documented audit covers several categories and has a vetting stage before findings reach you. The advisor is supposed to reread cited locations and reject false positives. I would still start with one problem whose consequences you understand. If its evidence does not survive your own inspection, distributing that finding to an executor only adds another handoff to repair.

Issue #30 concerns committed executor changes

Issue #30 reports the same scope problem in the single-plan execution path. The reporter describes committing a file outside the permitted scope and then seeing empty working-tree diff and status output. We did not reproduce that example. Reading the pinned instructions does confirm the relevant sequence: the worker is told to commit, and the advisor's scope check uses an unqualified diff.

The proposed correction is understandable: record the executor's starting commit and inspect the changes through its final HEAD. Check remaining working-tree changes separately. This is a review recommendation based on the instructions and report, not a shipped fix or a tested patch. A plan can specify excellent boundaries while its review procedure fails to inspect the changes that crossed them.

Host capabilities decide how delegation works

The README supports agents using the Agent Skills format, while the execution reference names a general-purpose subagent, worktree isolation and a default executor model. Those are instructions for the host to interpret. They do not establish that every compatible host exposes identical delegation controls. Confirm that your chosen environment can isolate work and select the executor you intend to pay for.

The headline economics also remain unmeasured. Improve proposes using a more capable advisor and a cheaper executor, but no billing comparison accompanies our evidence. Planning, execution and revision all consume model work. Judge a trial by the quality of the accepted change and the actual usage record, rather than assuming the word "cheaper" in a dispatch instruction settles the total cost.

Specifications may be the better starting point

GitHub Spec Kit provides structured processes and reusable templates for coding agents, with separate entry points for feature work, bug fixing and idea assessment. Evaluate it when the process itself needs to be shared and adapted. Improve is more directly pitched at inspecting existing code and deciding which findings deserve plans. We have no comparative task result establishing a winner.

OpenSpec demonstrates a workflow with proposal, specification, design and task documents, followed by applying and archiving a change. Choose that direction when explicit requirements and a change record are the main need. Both alternatives still leave you responsible for checking whether the code satisfies the written intent.

The last repository push was September 12, 2026; issue #30 shows discussion activity on November 11. Neither an absent latest-release response nor that gap between dates proves abandonment. Our documentation rating is 4/5 on an editorial scale where 1 means a documented major obstacle, 3 a usable path with caveats and 5 independent validation across the assessed task. Setup, community and maturity remain unassessed. Try one plan, inspect its evidence, and review the committed diff before accepting the executor's work.

Alternatives

ProjectWhat it isPick it when
GitHub Spec Kit gh↗A toolkit of structured processes and templates for AI coding agents.Evaluate it when you want a reusable specification process, or distinct entry points for building a feature, fixing a bug and assessing an idea.
OpenSpec gh↗A specification workflow that records proposed changes, requirements, design and implementation tasks.Evaluate it when maintaining explicit specifications and a change archive is the main goal, rather than starting with a codebase improvement audit.

What people are saying

  1. [github-trending] shadcn/improve
  2. [hackernews] The 'Astra can read and write weights to improve Qwen' post is misleading
  3. [hackernews] Astra can read and write weights to improve Qwen
  4. [theverge] Microsoft has a new machine learning tool to improve weather forecasts

Sources

  1. shadcn/improve README
  2. Execution reference pinned to cac56e1
  3. Issue #30: committed changes omitted from scope check
  4. shadcn/improve repository metadata
  5. GitHub Spec Kit README
  6. OpenSpec README

More dev tools reviews

modern-web-guidance-src · folly · universal-android-debloater-next-generation · OpenSandbox · You-Dont-Know-JS · evilginx2 · the whole board →