mrkeyoor.com_
Fri 16 Oct 18:52 UTC
Dev Toolsevaluationupdated 15 Oct 2026

mcp-audit-tool review

mcp-audit-tool reads Model Context Protocol client configuration files and flags risky settings, such as embedded credentials, unpinned launch packages, and broad filesystem access. It produces terminal, JSON, or SARIF reports so you can review those settings locally or in a code-review pipeline.

trackingstars / 7d
Verdict

Our mcp-audit-tool run passed all 8 tests in 5 seconds after a 29-second install, but its current rules miss some argument secrets and nested tool descriptions. Use it for an initial review of MCP configuration hygiene. Keep server-source and runtime review in the approval process, because a clean static report cannot answer those questions.

We ran it

Lab card: what happened when we ran mcp-audit-toolScreenshot of mcp-audit-tool (github.com/graygnatconsole/mcp-audit-tool)
Install✓ · 29s41 packages · 65 MB
Build✓ · 2s
Tests✓ · 5s8 passed · 0 failed of 8 (pytest)
Known vulns0(pip-audit)
Repo28 files~1,308 lines of source · 0.3 MB · 0 CI workflows · tests dir

Answers from our run

Does mcp-audit-tool build from source?

Dependencies installed in 29 seconds (41 packages), and the build succeeded in 2 seconds. We cloned commit 94fec3b into a clean Debian container with 3 CPUs and no project-specific setup.

Do mcp-audit-tool's tests pass?

Yes: 8 of 8 passed when we ran the project's own test command (pytest). Some failures need services or credentials a bare container does not have.

Does mcp-audit-tool have known vulnerabilities in its dependencies?

pip-audit found none in the dependency tree at the time of our run.

Who should not use mcp-audit-tool?

Teams expecting live server interrogation: tools/list probing and definition-hash comparisons are unchecked roadmap items.

What are the alternatives to mcp-audit-tool?

Snyk Agent Scan, APIsec MCP Audit, Gitleaks. Our mcp-audit-tool run passed all 8 tests in 5 seconds after a 29-second install, but its current rules miss some argument secrets and nested tool descriptions.

Setup4/529-second install and passing build and tests via Python
Docs3/5Useful rule table, with contradictory npm and Node guidance
Community2/5September 26 push and one open report of detection gaps
Maturity2/58 passing tests, with live probing and broader traversal absent

Who it’s for

Developers maintaining MCP configurations for desktop agents and editors.
Teams that want static configuration findings in JSON or GitHub code-scanning reports.
Reviewers who need an inspectable Python rule set as an initial check before approving a server.

Who it’s NOT for

Teams expecting live server interrogation: tools/list probing and definition-hash comparisons are unchecked roadmap items.
Users relying on complete credential detection: issue 2 reports missed bearer tokens in launcher arguments, and the secret rules inspect env blocks.
Reviewers expecting nested tool descriptions to be scanned: issue 2 reports this gap and the metadata helper reads selected top-level fields.
Teams expecting automated repair or drift baselines: both appear as unchecked roadmap items in the README.

Setup reality

Our run of commit 94fec3b installed 41 packages in 29 seconds, using 65 MB on disk. The build succeeded in 2 seconds, and pytest passed all 8 tests with 0 failures in 5 seconds. Pip-audit reported 0 known vulnerabilities.

The documented Python route uses pipx or pip and needs Python 3.9 or newer. Static scanning reads local configuration files and needs no LLM API key or live MCP service credential. Supply explicit paths when you need a particular project checked.

Our fresh Python 3.12 Debian container had 3 CPUs and 8 GB of RAM, without secrets or elevated privileges. The README also gives an npm-based one-line command while claiming Node is unnecessary, so the direct Python instructions are clearer. No CI workflow or Dockerfile appeared in our scan.

Scan the configuration before approving the server

An MCP launcher can give a server a broad filesystem path, a credential, or permission to run without another confirmation. mcp-audit-tool reads those client settings and reports patterns worth reviewing. That is a useful intervention before you connect an agent to a new server. Its clearest value is making risky configuration visible, with a named rule and a suggested correction you can assess against the actual job the server needs to do.

Our measured checkout was 0.3 MB, containing 28 files and about 1,308 source lines. That makes the Python implementation approachable for a team that wants to inspect the rules it adopts. The README documents terminal output, JSON, and SARIF for GitHub code-scanning integration. I would start with an explicit configuration path and review the findings manually before making a severity threshold block changes across an entire development team.

What happened when we ran it

Our sandbox installed mcp-audit-tool commit 94fec3b in 29 seconds and built it in 2 seconds on October 14, 2026. Installation added 41 packages and used 65 MB on disk. Pytest passed all 8 tests with 0 failures in 5 seconds. The run used a fresh Python 3.12 Debian container with 3 CPUs, 8 GB of RAM, no secrets, and no elevated privileges.

Pip-audit reported 0 known vulnerabilities for that installed environment. The checkout had a tests directory, but our scan found 0 CI workflow files and no Dockerfile. These are encouraging local execution results for a small command-line program, with limited evidence about detection quality. Passing the available suite does not measure recall against malicious configurations or establish how often a rule incorrectly flags an acceptable setting.

The rule boundaries matter more than the grade

The README's rule table covers secrets in environment blocks, unpinned package launchers, shell wrappers, broad filesystem paths, and insecure remote transport. Those are concrete settings a reviewer can change. A severity grade makes the output easy to scan, but the useful decision happens at the individual finding: why is this server receiving that credential or directory, and is that access necessary? The grade cannot answer the application's permission requirements for you.

The 8 passing lab tests leave an important question open: which inputs do the rules never inspect? Issue 2 reports missed bearer tokens in launcher arguments and missed poisoning text in nested tool descriptions. The inspected secret rules work through env blocks. The metadata helper reads description, instructions, systemPrompt, and prompt directly on the supplied server object. That source structure supports the reported scope limits without requiring an invented detection benchmark.

Live tool discovery remains a roadmap item

The README lists live tools/list probing and comparison with pinned definition hashes as unchecked roadmap work. That boundary is especially relevant to a product advertised around tool poisoning and rug pulls. Reading a saved client configuration cannot establish what descriptions a live server returns later. The present scanner can flag configured text and launch risks, while a review of changing server behavior needs evidence from somewhere else.

Our 5-second successful test step gives no result for live discovery, runtime enforcement, or server-definition drift. The README also leaves baseline mode and automatic repair unchecked. Treat each of those as an aspiration recorded by the project, rather than a committed delivery promise. If your approval process requires detecting a server that changes after onboarding, include a separate control that observes the server instead of assigning that responsibility to this static scanner.

Follow the Python instructions and name the files

The README requires Python 3.9 or newer and documents direct pipx and pip routes. It also presents an npm-based one-line command while saying Node is unnecessary. That contradiction makes the direct Python guidance easier to trust as an instruction set. It is a documentation finding, separate from the lab: our successful installation does not establish whether that advertised npm command works on a fresh workstation.

The 65 MB environment we measured is small enough for a deliberate local evaluation. The more consequential setup choice is which configuration files reach the scan. Auto-discovery documents different locations across clients and operating systems, and explicit paths let a reviewer state exactly what was checked. A passing report on a checked-in project file tells you nothing about an additional personal configuration the scanner was never given or did not discover.

A small active discussion exposes useful limits

GitHub recorded the last push on September 26, 2026, with 298 stars and 1 open issue or PR. That open issue was updated October 9 and describes the argument-secret and nested-description gaps. No latest published release was available. The combination shows a recently pushed project with a current technical report, rather than evidence of abandonment. It also gives an adopter a specific limitation to follow before widening reliance on the scanner.

After our 29-second install, the tool cleared its build and available tests. That earns it a place in a supervised configuration review. APIsec MCP Audit is worth examining for inventory and its separate source scan, while Snyk Agent Scan addresses a broader agent-security scope. Keep this tool's report beside the configuration you approved, and record why each remaining permission is needed. That record is more useful than retaining only a letter grade.

Alternatives

ProjectWhat it isPick it when
Snyk Agent ScanA security scanner for agents, MCP servers, and agent skills.pick this instead when your review extends beyond the static client settings covered here.
APIsec MCP AuditAn MCP configuration inventory with a separate source-code scan.pick this instead when endpoint inventory or source-level shell-injection checks are part of the job.
Gitleaks gh↗A dedicated scanner for secrets in development workflows.pick this instead when the main requirement is finding exposed credentials across a repository.

What people are saying

  1. [velocity-scout] graygnatconsole/mcp-audit-tool

Sources

  1. Rule table, setup, and roadmap
  2. Reported detection blind spots
  3. Metadata rule scope
  4. Secret rule scope
  5. Repository activity

More dev tools reviews

compose-samples · librepods · sqlmap · coucou · world-execute-me-dsh-pv · mcp-extensions · the whole board →