mrkeyoor.com_
Sun 01 Nov 09:10 UTC
AI Toolsevaluationupdated 29 Sept 2026

Auto-claude-code-research-in-sleep review

ARIS is an English-first collection of agent skills and a standalone CLI for machine-learning research, with separate Chinese documentation available. It gives Claude Code, Codex, and other coding agents repeatable steps for finding papers, planning experiments, reviewing results, and preparing a paper.

+253stars / 7d
Verdict

Our Feishu bridge run installed 43 packages in 19 seconds and built successfully, but pytest found 0 tests and exited 5. ARIS is a credible choice for an ML researcher who wants structured overnight work and will audit the morning output. Start with selected skills, human checkpoints, and a branch you can discard; the full 83-skill, auto-proceed setup asks for more trust than our measured test evidence supports.

We ran it

Lab card: what happened when we ran Auto-claude-code-research-in-sleepScreenshot of Auto-claude-code-research-in-sleep (github.com/wanshuiyin/Auto-claude-code-research-in-sleep)
Install✓ · 19s43 packages · 96 MB
Build✓ · 5s
Tests✗ · 4s0 passed · 0 failed of 0 (pytest)
Known vulns0(pip-audit)
Repo712 files~50,251 lines of source · 38.1 MB · 4 CI workflows · tests dir

Answers from our run

Does Auto-claude-code-research-in-sleep build from source?

Dependencies installed in 19 seconds (43 packages), and the build succeeded in 5 seconds. We cloned commit 341f914 into a clean Debian container with 3 CPUs and no project-specific setup.

Do Auto-claude-code-research-in-sleep's tests pass?

No. The project's own test command finished in 4 seconds and reported 0 passed, 0 failed (pytest).

Does Auto-claude-code-research-in-sleep have known vulnerabilities in its dependencies?

pip-audit found none in the dependency tree at the time of our run.

Who should not use Auto-claude-code-research-in-sleep?

Researchers who cannot review generated code, experiments, and claims: the documented loop can write scripts, run experiments, revise a paper, and continue automatically when AUTO_PROCEED=true.

What are the alternatives to Auto-claude-code-research-in-sleep?

PaperQA, GPT Researcher, OpenHands. Our Feishu bridge run installed 43 packages in 19 seconds and built successfully, but pytest found 0 tests and exited 5.

Setup3/5Bridge installs quickly; full workflows need agents, tools, and credentials
Docs4/5Detailed English guides, though 83 skills make the main README dense
Community5/516,820 stars, a September 29 push, and active issue and PR work
Maturity3/5v0.4.28 is active, but our measured bridge exposed no tests

Who it’s for

ML researchers who already use Claude Code or Codex and want a repeatable workflow around papers, experiments, and review.
Teams with a disposable branch, bounded compute, and a researcher who will inspect every generated claim.
Researchers who want one model to do the work and a different model to challenge it.
Codex or Claude Code users willing to install selected skill groups instead of the entire catalog.

Who it’s NOT for

Researchers who cannot review generated code, experiments, and claims: the documented loop can write scripts, run experiments, revise a paper, and continue automatically when AUTO_PROCEED=true.
Teams that require an approval before every write: the overnight example grants Write, Edit, and the review-loop skill without prompts, while human checkpoints default to off.
Users with a tight model budget: open issue 451 reports that a short request can trigger an Astra-backed skill before the user notices the quota cost.
Codex users who want a small skill menu: ARIS ships 83 skills, and open issue 433 asks for explicit-only routing to reduce context overhead and incorrect selection.
Release processes that require discovered tests for every installed component: pytest found 0 tests in the Feishu bridge project we ran and exited 5.

Setup reality

Our fresh Debian sandbox ran mcp-servers/feishu-bridge/ at commit 341f914, not all of ARIS. Installation succeeded in 19 seconds, adding 43 packages and using 96 MB. The build succeeded in 5 seconds. Pytest exited 5 after 4 seconds because it discovered 0 tests: 0 passed and 0 failed. Pip-audit reported 0 known vulnerabilities. The full checkout had 712 files, about 50,251 source lines, and occupied 38.1 MB.

The wider product needs an agent host such as Claude Code or Codex, plus a configured reviewer route for cross-model checks. Paper writing adds LaTeX and pdfinfo; experiments may add local, SSH, or rented GPU access. The measured Feishu bridge itself needs FEISHU_APP_ID, FEISHU_APP_SECRET, usually a user ID, and a Lark app.

Project-local installation uses symlinks, so new or removed skills require another installer run after git pull. The repository had 4 CI workflow files and a tests directory, but no Dockerfile. Overnight permissions and AUTO_PROCEED=true make an isolated branch, narrow credentials, and fixed compute limits part of setup rather than optional cleanup.

ARIS ships 83 skills for one research workflow

ARIS ships 83 Markdown skills that a coding agent can follow. They cover literature search, idea selection, experiment planning, code review, result analysis, paper writing, rebuttals, talks, and a persistent research wiki. Claude Code is the main executor in the documented path, while Codex provides an independent review pass. There are also routes for Codex-native use, Cursor, Copilot CLI, OpenClaw, and other hosts.

This is a large methods kit rather than one Python application. The commit we measured contained 712 files, roughly 50,251 lines of source, and a 38.1 MB checkout. That breadth is useful when a lab wants common records such as experiment plans and review state. It also raises the reading cost. A new user must decide which workflow owns a task, which model may judge it, and which files the agent may change.

Auto-proceed can run 4 review rounds without a checkpoint

AUTO_PROCEED defaults to true, while human checkpoints default to false. The workflow can search for ideas, implement experiments, monitor results, revise a paper, and repeat its review cycle. It stops at a score threshold or after 4 rounds by default, and proposed experiments above 4 GPU-hours are skipped for manual follow-up. Those bounds help, but they do not validate the code or the scientific claim.

The optional overnight permission block allows model review calls plus Write and Edit without asking each time. Effort can rise from a 0.4x lite mode to a documented 5 to 8x beast mode. Open issue 451 describes the practical cost: a short request may invoke an Astra-backed skill before the user realizes it. Use explicit skill selection, fixed compute limits, and a branch whose generated changes can be reviewed line by line.

What happened when we ran it

Our sandbox tested commit 341f914 in the Python project under mcp-servers/feishu-bridge/. It had 3 CPUs, 8 GB of RAM, Python 3.12 on Debian, no secrets, and no elevated privileges. Installation succeeded in 19 seconds, pulled 43 packages, and left a 96 MB environment. The build completed in 5 seconds. Pip-audit found 0 known vulnerabilities in that installed dependency set.

The test step failed after 4 seconds with exit code 5. Pytest reported no tests ran in 0.00s, which means 0 passed and 0 failed out of 0. The repository had a tests directory and 4 CI workflow files, yet the command in this measured subproject discovered nothing. The log does not show a missing package, import failure, or broken assertion, so claiming any of those causes would be guesswork.

This run says something narrow and useful. The Feishu bridge's environment installs and its build path works in a fresh unprivileged container. It does not show that notifications reach Lark, that replies resume a waiting research loop, or that the other 82 skills work together. Those paths need credentials, model access, external services, and tests that our command never found.

The 96 MB bridge is the easy part of setup

The 96 MB environment belongs to a small Python HTTP service with a lark-oapi requirement. It reads a Feishu app ID and secret, can target a user's open ID, and listens on port 5000 by default. The integration guide sends interactive users through Lark app creation, 5 permissions, event configuration, and an external feishu-claude-code bridge. Push-only mode is simpler and needs a group webhook.

ARIS adds setup across its 83-skill catalog. The recommended project install creates one symlink per skill and a manifest of managed entries. Existing linked skills update with git pull, while added or removed skills need the installer again. Paper generation requires LaTeX, latexmk, and pdfinfo. Review skills need a second model route. Experiment automation may need GPU and SSH details. The absence of a Dockerfile leaves teams to define their own reproducible runtime.

A September 29 push followed the v0.4.28 release

GitHub showed 16,820 stars and 68 combined open issues and pull requests on September 29, 2026. The open list contained 55 issues and 13 pull requests. The repository was pushed that day, one day after v0.4.28 shipped. Recent changes fixed paper-verification behavior, concurrent watchdog writes, reviewer configuration, and proxy handling. This is active maintenance, not a repository coasting on old attention.

Fast movement has a cost. Open issue 433 argues that the Codex mirror's many specialized skills remain eligible for implicit selection, adding context overhead and routing competition. The README recommends project-local and selective installation, which is the sensible response today. Install the research stages you can name and supervise. ARIS earns a pilot for a lab that wants structured overnight progress, but 0 discovered bridge tests are too little evidence for unattended use on the only copy of valuable research work.

Alternatives

ProjectWhat it isPick it when
PaperQAA literature assistant focused on answering research questions from papers with citations.pick this instead when evidence-backed literature questions matter more than running experiments or rewriting a paper.
GPT Researcher gh↗An agent for web research and source-backed report generation.pick this instead when your deliverable is a researched report rather than an ML experiment loop.
OpenHands gh↗A general software-development agent platform with its own runtime and integrations.pick this instead when coding tasks are the main job and you want to design the research process yourself.

Sources

  1. ARIS README
  2. ARIS v0.4.28 release
  3. ARIS Feishu integration guide
  4. ARIS Feishu bridge at measured commit
  5. Issue 433: Codex skill routing and context overhead
  6. Issue 451: unexpected Astra skill invocation

More ai tools reviews

anarlog · pr-agent · agent-sprite-forge · KiroCrew · Orkas · hypit · the whole board →