mrkeyoor.com_
Thu 12 Nov 20:00 UTC
AI Toolsevaluationupdated 30 Sept 2026

scientific-agent-skills review

Scientific Agent Skills is a library of instructions, references, and helper scripts that teaches coding agents how to use scientific packages, databases, and research workflows. Its 177 current skills work with Claude Code, Codex, Cursor, and other Agent Skills hosts across biology, chemistry, medicine, engineering, data analysis, and scientific writing.

+520stars / 7d
Verdict

Our scientific-agent-skills run installed 120 packages and built in 10 seconds, but the test command exited 4 after 8 seconds because 106 skill suites cannot share one pytest process. Use the collection as a shelf: choose a small pinned subset, run each skill's isolated checks, and verify its scientific output against known data. Do not treat installation, a clean pip audit, or an agent's fluent answer as scientific validation.

We ran it

Lab card: what happened when we ran scientific-agent-skillsScreenshot of scientific-agent-skills (arxiv.org/abs/2609.00065)
Install✓ · 58s120 packages · 495 MB
Build✓ · 10s
Tests✗ · 8sran, no count parsed
Known vulns0(pip-audit)
Repo2484 files~225,955 lines of source · 281.4 MB · 5 CI workflows · tests dir

Answers from our run

Does scientific-agent-skills build from source?

Dependencies installed in 58 seconds (120 packages), and the build succeeded in 10 seconds. We cloned commit 065b734 into a clean Debian container with 3 CPUs and no project-specific setup.

Do scientific-agent-skills's tests pass?

No. The project's own test command exited unsuccessfully after 8 seconds, and its output did not expose an individual test count.

Does scientific-agent-skills have known vulnerabilities in its dependencies?

pip-audit found none in the dependency tree at the time of our run.

Who should not use scientific-agent-skills?

Anyone expecting a repo-wide pytest command to pass: our test step exited 4 because 106 skill suites reuse import names and must run in separate processes.

What are the alternatives to scientific-agent-skills?

Anthropic Skills, K-Dense BYOK, Superpowers. Our scientific-agent-skills run installed 120 packages and built in 10 seconds, but the test command exited 4 after 8 seconds because 106 skill suites cannot share one pytest process.

Setup3/558-second install; testing and dependencies stay per skill
Docs5/5Clear host, isolation, security, licensing, and safety guidance
Community5/547,367 stars, an October 1 release, and 27 open PRs
Maturity3/5v2.72.0 is active, but one-process test collection fails

Who it’s for

Researchers who already use a coding agent and want a starting procedure for a named scientific package or database.
Labs prepared to install a small, pinned subset and review every instruction and script before use.
Claude Code, Codex, or Cursor users who can manage Python environments, credentials, network access, and domain checks.
Developers building repeatable research workflows that still end with scientific review by a qualified person.

Who it’s NOT for

Anyone expecting a repo-wide pytest command to pass: our test step exited 4 because 106 skill suites reuse import names and must run in separate processes.
Teams that install agent instructions without code review: the project's security warning says skills may execute code, install packages, contact networks, and modify files.
Labs wanting one shared Python environment for every workflow: the README tells users to isolate skills with incompatible Python versions or package pins.
Clinical users seeking diagnosis or treatment decisions: the documented health workflows are limited to research, aggregate analysis, and drafts for qualified review.
Commercial users assuming the root MIT license covers every included skill: the FAQ says each skill has its own license metadata and may carry different terms.

Setup reality

Our fresh Debian sandbox installed commit 065b734 in 58 seconds, pulling 120 packages and using 495 MB on disk. The build passed in 10 seconds. The test step failed with exit 4 after 8 seconds. Pip-audit reported 0 known vulnerabilities.

The failure message said 106 skills could not be collected in one process because their scripts/ directories share module names such as _common.py. It instructed users to run one skill at a time. The README documents an isolated runner for that purpose; the log does not show individual skill failures.

Current repository tooling calls for Python 3.13+ and uv, while each chosen skill may need separate packages, system tools, credentials, reference data, or network permission. There is no Dockerfile. Installing the skill files does not install every scientific dependency.

The 177 skills supply procedures, not scientific proof

Scientific Agent Skills is a catalog of 177 current skill packages. Each SKILL.md tells a compatible agent how to approach a package, database, or workflow, sometimes with references, templates, and executable helpers. The subjects range from bioinformatics and drug discovery to physics, lab automation, statistics, figures, and evidence-bound writing. Claude Code, Codex, Cursor, and other compatible hosts can discover the same format.

This is useful when an agent knows a library's vocabulary but misses the right order of operations, current endpoint, or validation check. A procedure can reduce that wandering. It cannot prove a result. The README limits clinical material to research, aggregate work, and drafts for qualified review. It also keeps physical lab execution behind operator approval and equipment-specific safety controls.

Release v2.72.0 removed 4 document skills that were vendored from another repository and now lists 177 skills. The catalog changes quickly enough that a lab should record the release tag or commit beside every analysis. Citing the skill version is sensible provenance, but the scientific package, database, data snapshot, and actual analysis code also belong in that record.

What happened when we ran it

We measured a 58-second install at commit 065b734 in a fresh Debian container with 3 CPUs, 8 GB of RAM, Python 3.12, no secrets, and no elevated privileges. It pulled 120 packages and occupied 495 MB. The build completed successfully in 10 seconds, and pip-audit reported 0 known vulnerabilities.

The test step failed with exit code 4 after 8 seconds. Its final message was direct: pytest could not collect 106 skills in one process because their scripts/ directories reuse module names such as _common.py. An import could therefore resolve to another skill's helper. The message instructed the operator to run one skill at a time.

That failure does not show 106 broken workflows. It shows that the all-at-once command cannot produce a valid repo-wide result. Our measured checkout contained 2,484 files, about 225,955 lines of source, 5 CI workflow files, and a tests directory, but no Dockerfile. The repository's own testing instructions confirm that isolation is required.

The supported test path starts with one skill

The README provides a metadata and structural suite, a command for one named skill, and tests/run_all.py --isolated for broader checking. Each isolated run gets the packages and Python version declared for that skill. This matters because a single environment can hide dependency conflicts or load the wrong helper before a test reaches any scientific assertion.

Current repository tooling requires Python 3.13 or newer and uv. Individual workflows can support other Python ranges, but their compatibility fields decide that. The base uv sync installs development and validation tools, not the scientific world. A Scanpy workflow, an Opentrons integration, and a cloud database lookup can need very different packages, system programs, credentials, and network rules.

CI also has a stated boundary. Relevant changes run structural checks and standard-library-only skill suites. The README says the full sweep of scientific dependencies is not run in CI and should be run before releases or shared-contract changes. A green pull request therefore supports a narrower claim than end-to-end scientific correctness across all 177 skills.

Installing a subset cuts both risk and noise

The project warns users not to install everything at once. Skills can direct an agent to execute code, install packages, make network requests, read credentials, and modify files. Maintainers run security scans and publish the results, but their policy says the automated report is neither an audit nor a certification. Read the selected SKILL.md, inspect its scripts and history, then grant only the network and secret access it needs.

The September 28 published report covered 162 skills, while v2.72.0 lists 177 after its October 1 release. That date and inventory difference is another reason to review the exact commit you install. It does not establish that the unlisted skills are unsafe. It establishes that a collection-level badge cannot substitute for checking the selected folder and the report evidence attached to it.

Licensing also works at skill level. The repository root uses MIT, but the FAQ says individual SKILL.md files carry their own license metadata and may impose different terms. A commercial lab should record those terms with the same care it applies to a Python dependency or dataset license.

The October 1 release is active, with a large review queue

GitHub showed 47,367 stars and 28 combined issues and pull requests on October 2, 2026. The split was 1 open issue and 27 open pull requests. The repository was pushed on October 1, the same date as v2.72.0. Several open contributions add new scientific domains, while others correct commands, validation behavior, and compatibility details.

That activity is healthy, but 27 open pull requests also mean prospective additions and fixes are waiting for review. Pinning a tag prevents tomorrow's merge from changing an analysis without notice. Moving the pin later should be an explicit upgrade with isolated tests and a known-data check for the workflows the lab actually uses.

Scientific Agent Skills earns a place beside a researcher's agent when it saves the first hour of documentation hunting. The buying decision is narrower than the 177-skill headline suggests: select the few procedures tied to the current project, inspect them like code, and test their outputs like science. The failed 8-second collection run is a useful warning against treating the whole catalog as one tested appliance.

Alternatives

ProjectWhat it isPick it when
Anthropic Skills gh↗Anthropic's public Agent Skills collection for general document and workflow tasks.pick this instead when you need a smaller general-purpose set rather than scientific domain coverage.
K-Dense BYOKA desktop research workspace that packages these skills with model and file tools.pick this instead when you want an integrated application and can supply your own model keys.
Superpowers gh↗A general agent skill system centered on software planning, testing, debugging, and delivery.pick this instead when software-engineering process matters more than scientific package guidance.

Sources

  1. Scientific Agent Skills repository
  2. Scientific Agent Skills v2.72.0 release
  3. Scientific Agent Skills testing guide
  4. Scientific Agent Skills security policy
  5. Scientific Agent Skills security report

More ai tools reviews

pocketpal-ai · ohmygame · ooosplat · dexter · oh-my-ppt · Agentero · the whole board →