mrkeyoor.com_
Fri 25 Sept 15:57 UTC
AI Toolsevaluationupdated 25 Sept 2026

skills review

pashov/skills is a set of three AI-agent workflows for reviewing Solidity projects, mapping their attack surface, and generating fuzz tests. It gives Claude Code, Codex, Cursor, Copilot, and Windsurf detailed instructions plus scripts and templates, but it does not replace a human smart-contract audit.

Verdict

Our lab did not run pashov/skills because the JavaScript repository had no supported execution ecosystem and no Dockerfile, so there is no build or test result to support a reliability claim. Use its 3 workflows as a supervised head start for Solidity review and fuzzing, especially before a human audit. Avoid treating the generated report or harness as a security sign-off, and macOS users should resolve the open x-ray enumeration problem first.

We ran it

Screenshot of skills (github.com/pashov/skills)

Answers from our run

Did you run skills yourself?

No. Its code is JavaScript, and it carries no manifest our lab installs from, and no Dockerfile, so there was nothing standard to install, build or test. This review is written from the repository's own documentation.

Who should not use skills?

Teams seeking a deterministic scanner with a conventional test binary: this repository is primarily agent instructions, scripts, and templates.

What are the alternatives to skills?

Slither, Echidna, Mythril. Use its 3 workflows as a supervised head start for Solidity review and fuzzing, especially before a human audit.

Setup3/5Agent install is short; Solidity tools and host scripts add work
Docs4/5Each of the three workflows explains its output and intended use
Community3/51,202 stars and five open issues or PRs with recent activity
Maturity2/5Active releases, but no lab run and an open portability defect

Who it’s for

Solidity teams preparing a codebase before a paid security audit.
Smart-contract auditors who want a structured first pass over entry points and invariants.
Foundry or Hardhat users willing to inspect and maintain generated fuzz harnesses.
Claude Code and other coding-agent users who can supervise security work instead of accepting findings on faith.

Who it’s NOT for

Teams seeking a deterministic scanner with a conventional test binary: this repository is primarily agent instructions, scripts, and templates.
Anyone treating an AI report as approval to deploy contracts: the project's own Solidity Auditor page says it is not a substitute for a formal audit.
macOS users who need x-ray's current enumeration to be dependable: open pull request 47 reports that BSD grep can turn several measurements into false zeros.
Developers without Echidna, Medusa, Foundry, or Hardhat experience: Fizz generates editable harness code, and the user still has to judge the properties and violations.

Setup reality

We did not run pashov/skills because our lab has no supported execution ecosystem for this JavaScript repository and the repo has no Dockerfile. There are no install, build, test, dependency, or audit results from our sandbox for this review.

The advertised install is a prompt to a supported coding agent, followed by a request to run x-ray, Solidity Auditor, or Fizz. Useful work needs an existing Solidity project and an agent that can read the skill files, run shell or Node scripts, and write reports or test scaffolds into that project.

Fizz assumes a Foundry or Hardhat codebase and works with Echidna or Medusa. Its output is editable Solidity, property documentation, reproductions, and a campaign report. x-ray also relies on local command-line behavior, and an open macOS portability fix shows why host tools need verification.

Three skills divide preparation, auditing, and fuzzing

pashov/skills contains 3 main workflows for Solidity security work. x-ray maps a protocol before deeper review. Solidity Auditor sends agents through contract code and combines their findings. Fizz builds a fuzzing suite for Foundry or Hardhat projects. That separation is sensible: inventory, bug hunting, and property testing are different jobs, and each produces artifacts a developer can inspect rather than one long chat response.

x-ray writes a protocol overview, entry-point map, invariant map, and architecture diagram. Its 10-file directory includes shell and Python scripts for source enumeration, Git history, and SVG generation. The result is meant to expose trust boundaries and missing test categories before an audit begins. This is useful preparation, provided the source measurements are correct and the reported invariants are checked against the contracts.

Fizz writes Solidity that your team must own

Fizz is the largest of the 3 packages, with 65 files in its directory at the fetched revision. It can create a harness, handlers, invariants, a plain-English property list, deterministic reproduction tests, and a campaign report. The supporting scripts invoke Echidna or Medusa and help select functions, extract ABIs, estimate cost, and keep the generated suite synchronized after contract changes.

Generated fuzz code is only useful when its properties describe the protocol. A harness may compile while omitting a privileged path, using an unrealistic actor, or asserting a weak invariant. The Fizz documentation asks users to review entry points and properties in guided mode on the first run. That review is the job. The agent saves setup time, while the protocol team remains responsible for knowing what must never happen.

What happened when we ran it

Our lab did not execute pashov/skills. The repository's detected language was JavaScript, but the review runner had no supported ecosystem for this project and found no Dockerfile to supply one. We therefore have no measured package count, disk use, install time, build result, test count, or dependency-audit result. Any claim that the three skills ran successfully in our sandbox would be false.

This matters because the repository is a collection of instructions and helper scripts rather than one application with a single start command. A meaningful test would need a suitable Solidity target, one of the 5 named coding-agent platforms, and the local contract toolchain required by the chosen workflow. We inspected the documented process and repository contents, but that is not evidence that an end-to-end audit or fuzz campaign completes on a reader's machine.

macOS can turn x-ray measurements into zeros

Open pull request 47 documents a sharp portability failure in x-ray's first step. Its shell script uses GNU grep's -P option in 15 places, while the BSD grep shipped with macOS does not support that option. According to the report, the script can still exit successfully and reduce failed measurements to zero. A protocol with tests may then be described as having none. The proposed fix replaces those expressions with portable extended regular expressions.

The pull request remained open when we fetched the repository, so its diagnosis and patch were not part of the reviewed main branch. This is more serious than a noisy error because a believable zero can steer the later agent analysis. macOS users should apply or verify the fix, then compare file and test counts against an independent command before using x-ray's gap analysis. Linux users should still read stderr and spot-check the generated inventory.

Solidity Auditor is a lead generator, not an approval stamp

Solidity Auditor can scan named files or run several passes in loop mode. The README suggests targeting 2 to 5 hot contracts so each agent gets denser context, and says 3 passes are a reasonable default. Later passes receive earlier findings and seek different ground, after which one report collects the results. This can surface leads quickly, yet repeated model output is not independent proof that a contract is safe.

A competent reviewer still has to reproduce each finding, trace reachable state, verify privilege assumptions, and reject duplicates or impossible paths. The project says this directly by positioning the skill as a check before formal review. That limit is especially important for deployed-value decisions, where a confident false negative costs far more than the minutes an agent may save. Use the report to choose where humans look next.

September activity is current, while release notes are thin

GitHub showed 1,202 stars, 5 combined open issues and pull requests, and a last push on September 23, 2026. Release v23092026 was published the same day, though its release page contained no notes. Current pull requests discuss x-ray portability, Fizz generator behavior, coverage shutdown timing, and optional symbolic verification. That is active technical work, but the open queue also contains changes that affect correctness.

The best use of pashov/skills is bounded: let x-ray organize the first reading, let Solidity Auditor produce candidates, and let Fizz draft properties and harness code. Then verify every artifact with the contract's own tests and a human security review. The 3-part structure is practical, and the MIT license makes adaptation easy. The missing lab run and open false-zero report keep it out of the unattended-security category.

Alternatives

ProjectWhat it isPick it when
SlitherA static-analysis framework for Solidity and Vyper with detector-based findings.pick this instead when you need deterministic detectors, CI integration, and results that do not depend on an AI agent's interpretation.
EchidnaA property-based smart-contract fuzzer used directly by Solidity security teams.pick this instead when you already know the properties to test and want direct control of the fuzz campaign.
MythrilA symbolic-execution security analyzer for EVM bytecode.pick this instead when symbolic analysis of compiled contracts matters more than an agent-led review workflow.

What people are saying

  1. [github-trending] pashov/skills
  2. [github-trending] alirezarezvani/claude-skills
  3. [velocity-scout] kerpopule/hermes-jev-skills
  4. [openai] Grab and OpenAI bring practical AI skills to Southeast Asia
  5. [github-trending] mukul975/Anthropic-Cybersecurity-Skills
  6. [hackernews] Jev – a curation of Jev demos on X, tools, skills, and integrations

Sources

  1. Pashov Audit Group Skills repository
  2. Fizz documentation
  3. Solidity Auditor documentation
  4. Pull request 47: BSD grep false-zero measurements
  5. Release v23092026

More ai tools reviews

nobodywho · desktop-cc-gui · langextract · openrig · awesome-grokbot · monty · the whole board →