mrkeyoor.com_
Sun 01 Nov 19:50 UTC
AI Toolsevaluationupdated 29 Sept 2026

academic-research-skills review

Academic Research Skills is an English-documented set of Claude Code skills for literature research, paper drafting, citation checks, revision, and simulated peer review. It turns those jobs into staged workflows with human approval points, but it does not validate that experiments happened or that underlying data are genuine.

+726stars / 7d
Verdict

Our npm install finished in 11 seconds with 0 packages, but there was no build or test target, so the clean audit says little about the 10-stage research workflow. Use Academic Research Skills if you already work in Claude Code, accept the noncommercial license, and want checkpoints that slow down paper drafting. Do not use its simulated review or integrity gates as proof that a study is sound, reproducible, or ready to submit.

We ran it

Lab card: what happened when we ran academic-research-skillsScreenshot of academic-research-skills (buymeacoffee.com/crucify020v)
Install✓ · 11s0 packages · 60 MB
Buildn/ano build script
Testsn/ano test script
Known vulns00 critical · 0 high · 0 moderate · 0 low (npm audit)
Repo2776 files~275,033 lines of source · 39.2 MB · 14 CI workflows · tests dir

Answers from our run

Does academic-research-skills build from source?

Dependencies installed in 11 seconds (0 packages), and the project has no separate build step. We cloned commit e79085d into a clean Debian container with 3 CPUs and no project-specific setup.

Does academic-research-skills have tests you can run?

Not through a standard command: the project exposes no test script or target that our harness could run.

Does academic-research-skills have known vulnerabilities in its dependencies?

npm audit found none in the dependency tree at the time of our run.

Who should not use academic-research-skills?

Commercial labs, consultants, or hosted services: the project uses CC BY-NC 4.0 and its positioning page says it is source-available, not open source.

What are the alternatives to academic-research-skills?

Claude Code Skills for Academics, PaperQA, GPT Researcher. Our npm install finished in 11 seconds with 0 packages, but there was no build or test target, so the clean audit says little about the 10-stage research workflow.

Setup3/511-second npm step; real setup depends on Claude Code and output tools
Docs5/5Setup, control gaps, data flows, risks, and limits are explicit
Community5/549,900 stars and a September 29 push with 32 issues and PRs
Maturity3/5v3.22.2 is active, but reviewer calibration remains unmeasured

Discussed on

  1. hnAcademic Research Skills for Claude Code82 points

Who it’s for

Noncommercial researchers already using Claude Code for literature work, drafting, or revision.
Graduate students who want explicit checkpoints instead of a single paper-generation prompt.
Research groups willing to inspect citations, methods, and every final claim themselves.
Authors who need Markdown first and can add Pandoc or Tectonic for finished document formats.

Who it’s NOT for

Commercial labs, consultants, or hosted services: the project uses CC BY-NC 4.0 and its positioning page says it is source-available, not open source.
Researchers who need proof that an experiment ran or that raw data are authentic: the documented boundary says a consistently reported fabrication can pass every gate.
Teams demanding a measured reviewer error rate: issue 653 says the reviewer has no measured error profile, and issue 828 says the first frozen calibration corpus leaked accept labels through its PDFs.
People expecting the full workflow in claude.ai Projects or Cowork: the control matrix says Projects are read-only knowledge and Cowork lacks the designed subagent pipeline.
Windows-only groups that require a tested support promise: CI runs on Ubuntu, Windows is best-effort, and several controls need Git Bash plus a real Python interpreter.

Setup reality

Our npm run on commit e79085d finished in 11 seconds, installed 0 packages, and occupied 60 MB. There was no build script and no test script, so both steps were skipped. Npm audit found 0 known vulnerabilities. The checkout held 2,776 files, about 275,033 lines of source, and used 39.2 MB.

The useful setup happens in Claude Code, not npm: install the plugin, sign in or provide an Anthropic API key, then choose one of the four skills. Markdown needs no extra formatter. Direct DOCX needs Pandoc, while PDF output needs Tectonic and the documented fonts.

The repository has 14 CI workflows and a tests directory, but npm does not expose either as a runnable test target. Plugin installs carry the intended hooks and agent wiring. Other install channels lose controls or orchestration, and Windows support is best-effort.

Four Claude Code skills cover research through revision

Academic Research Skills groups its work into deep research, academic paper writing, paper review, and a pipeline that coordinates them. The README lists 8 research modes, 11 paper modes, 6 reviewer modes, and a staged orchestrator. You can ask for a literature review, build an outline, check citations, revise against reviewer comments, or run the longer research-to-paper flow. Its best idea is friction: the pipeline stops for decisions instead of racing toward a finished manuscript.

That scope can look like a paper factory until you read the boundaries. Version 3.22.2 describes a 10-stage orchestrator with mandatory integrity checkpoints at stages 2.5 and 4.5. The project still assigns authorship and responsibility to the researcher. Its simulated reviewers produce author-facing feedback only. They do not make publication decisions, and the software does not submit anything. This is a structured Claude Code working method, with Python checks around selected artifacts, rather than an independent research system.

The 11-second npm install installs no dependencies

Our sandbox cloned commit e79085d into an unprivileged Node 22 container with 3 CPUs, 8 GB of RAM, and no secrets. The 39.2 MB checkout contained 2,776 files and about 275,033 lines of source. Npm finished in 11 seconds, installed 0 packages, and left 60 MB on disk. Npm audit reported 0 known vulnerabilities across every severity level. The package file is private and mainly declares the Pi wrapper, its four skills, and prompts.

There was no npm build target, so we skipped build. There was also no npm test target, so we skipped tests. That distinction matters because the repository itself contains a tests directory and 14 CI workflow files. The lab result does not say those checks failed, and it does not say they passed. It says npm gives a new evaluator no standard command for running them. Reviewers must inspect the project-specific scripts and GitHub workflows if they want to reproduce maintainer checks.

What happened when we ran it

Our run measured repository setup, not academic output. commit e79085d installed 0 packages in 11 seconds, with no build or test script to execute. We did not give Claude a paper, call bibliographic indexes, generate a manuscript, or score a review. The 0-vulnerability npm audit covers the package state npm could see. It cannot assess prompt behavior, Python scripts outside npm's dependency graph, citations returned by a model, or the quality of a drafted argument.

The missing npm targets make the README's own evidence labels especially useful. Release v3.22.2 separates deterministic script checks from prompt-level behavior and repeatedly marks the latter unmeasured. That is unusually candid. It also means adoption should start with one bounded job, such as checking citations in an existing draft, while you retain the inputs and compare every finding against the source. A green dependency audit cannot carry that judgment for you.

Plugin installation keeps controls that other channels lose

The setup guide recommends the Claude Code plugin route. Minimum use needs Claude Code and Anthropic access. Markdown output works without Python. Direct DOCX generation requires Pandoc, and PDF output requires Tectonic plus the listed fonts. A real Python interpreter activates the optional write-scope guard and several commands. Windows support is best-effort, has no Windows CI job, and needs Git Bash for the shell-based hook.

Install choice changes the product. The control availability matrix says the plugin is the reference channel. A skills copy or repository clone does not wire plugin hooks. Cowork runs skills separately without the designed subagent pipeline. A claude.ai Project exposes files as knowledge but executes no routing, hooks, scripts, or orchestration. Claude Science imports only a point-in-time methodology layer. If you want the advertised 10-stage workflow, use the plugin and verify which controls announce themselves.

Its integrity gates cannot prove the study happened

The project's positioning statement draws the most important line on the page. ARS can check citation existence, claim-to-source alignment, reported methods, figures, tables, and package conformance. It cannot establish that procedures were performed, raw data are authentic, or results reproduce. The maintainer gives the blunt consequence: a fabricated study can pass when its false story is internally consistent.

Reviewer confidence is also unfinished. Issue 653 says the reviewer skill has no measured error profile. A planned 12-paper ICLR 2026 calibration set then exposed accept labels through headers, author names, and line-number differences, so issue 828 records a decision to wait for submission-time ICLR 2027 papers before publishing the first profile. That restraint is good science. Until the measurement exists, treat every simulated review as a list of questions to investigate, never a verdict.

CC BY-NC makes it source-available for noncommercial work

GitHub showed 49,900 stars, 31 open issues, 1 open pull request, and a last push on September 29, 2026. Release v3.22.2 arrived four days earlier. Those dates show active maintenance, while the small pull-request count suggests most open work is tracked as issues. The license matters more than the star count: CC BY-NC 4.0 permits sharing and adaptation with attribution for noncommercial use, and the project explicitly says it is not open source.

For a student or noncommercial lab already committed to Claude Code, ARS is worth trying on one paper because it records checkpoints and states where its evidence stops. The 2,776-file checkout is still a large body of instructions to trust. Read the data-flow map, keep cross-model transport off unless you approve the content leaving your machine, and compare every citation with the paper itself. The tool can organize skepticism. It cannot supply the skepticism on your behalf.

Alternatives

ProjectWhat it isPick it when
Claude Code Skills for AcademicsA collection of Claude Code skills for academic reading, analysis, and writing tasks.pick this instead when you want smaller academic skills without adopting ARS's full staged pipeline.
PaperQAA Python system for answering questions and writing from a corpus of scientific papers.pick this instead when grounded literature questions matter more than paper drafting and review orchestration.
GPT Researcher gh↗An autonomous research agent that gathers web sources and produces cited reports.pick this instead when general web research and report generation matter more than an academic publication workflow.

What people are saying

  1. [github-trending] Imbad0202/academic-research-skills

Sources

  1. Academic Research Skills repository and README
  2. ARS setup guide
  3. ARS control availability by install channel
  4. ARS positioning and empirical-work boundary
  5. ARS v3.22.2 release
  6. Issue 653: reviewer calibration has no measured error profile
  7. Issue 828: calibration PDFs leaked accept labels

More ai tools reviews

skills · anarlog · pr-agent · agent-sprite-forge · KiroCrew · Orkas · the whole board →