mrkeyoor.com_
Sun 06 Sept 17:32 UTC
AI Toolsevaluationupdated 06 Sept 2026

open-science review

AIPOCH Open Science is a local-first desktop workbench where researchers can ask AI agents to search, run Python or R, use scientific data connectors, and produce files with provenance. It keeps projects, conversations, tool activity, notebooks, and generated artifacts together instead of scattering a research task across a chat app and separate scripts.

trackingstars / 7d
Verdict

Our Open Science install pulled 1,682 packages and 2,220 MB, while its test command still had not finished after 900 seconds, so adopting it from source is a serious workstation commitment. It is worth a trial for an individual researcher who values visible tool activity, local project records, and scientific connectors. Teams needing exact environment replay, live collaboration, directory-level controls, or a clean dependency audit should wait or choose narrower components.

We ran it

Lab card: what happened when we ran open-scienceScreenshot of open-science (aipoch.com/open-science)
Install✓ · 113s1682 packages · 2220 MB
Build✓ · 238s
Tests✗ timed out · 900sran, no count parsed
Known vulns50 critical · 5 high · 0 moderate · 0 low (npm audit)
Repo3679 files~1,341,907 lines of source · 60.9 MB · 23 CI workflows · tests dir

Answers from our run

Does open-science build from source?

Dependencies installed in 113 seconds (1682 packages), and the build succeeded in 238 seconds. We cloned commit c6e835a into a clean Debian container with 3 CPUs and no project-specific setup.

Do open-science's tests pass?

We could not finish them: the suite was still running after 15 minutes in our container.

Does open-science have known vulnerabilities in its dependencies?

npm audit flagged 5 known advisories in the dependency tree at the time of our run.

Who should not use open-science?

Teams that require exact reruns from locked environments: the v0.25.1 notes say portable environment locks and full-fidelity session replay are still ahead.

What are the alternatives to open-science?

PaperQA, STORM, GPT Researcher. Our Open Science install pulled 1,682 packages and 2,220 MB, while its test command still had not finished after 900 seconds, so adopting it from source is a serious workstation commitment.

Setup2/52,220 MB install and a test suite that exceeded 900 seconds
Docs5/5Setup, permissions, providers, limits, and source commands are detailed
Community4/53,734 stars and same-day push activity in September 2026
Maturity3/5v0.25.1 is usable, but several trust and replay controls remain open

Who it’s for

Individual researchers who want AI-assisted literature, data, and notebook work in one desktop application.
Labs that need to inspect agent commands, approvals, source files, and artifact history after a run.
Users who want a choice of Claude Code, OpenCode, Codex, or CodeBuddy as the agent runtime.
Developers extending a scientific workspace with file-based skills or MCP connectors.

Who it’s NOT for

Teams that require exact reruns from locked environments: the v0.25.1 notes say portable environment locks and full-fidelity session replay are still ahead.
Labs needing live multi-user editing: the published limitations call Open Science a single-researcher product and direct teams to export, share, and import instead.
Security programs that require user-configurable directory grants today: the roadmap says directory-level controls and automated credential rotation remain open.
Researchers who need a local GPU backend, Slurm submission, or a bring-your-own R interpreter: v0.25.1 lists all three as unavailable.
Headless users who must import Specialist ZIPs through the browser: issue 2119 reports that this action calls an Electron-only file picker in Remote Web mode.

Setup reality

Our sandbox installed 1,682 npm packages in 113 seconds and used 2,220 MB. The build succeeded in 238 seconds. Tests timed out at 900 seconds, so there is no passing total; the final log lines showed successive analyzer sidecar tests passing. Npm audit found 5 high-severity vulnerabilities and none in the other severities.

The packaged app has a five-step onboarding flow for storage, an agent runtime, a model provider, and optional notebooks. Cloud providers and custom gateways need their own credentials; Claude or Codex subscription login can replace an API key. Source development requires Node.js 22, while Python is needed only for Notebook execution.

Release packages target macOS 12+, Windows 10/11 x64, and Linux x64. Windows builds are unsigned, and its notebook network sandbox needs a one-time administrator setup. The repository has no Dockerfile, so source users should expect an Electron workstation setup rather than a container-first service.

Open Science v0.25.1 combines agents, notebooks, and provenance

Open Science v0.25.1 is an Electron desktop application built around research projects rather than isolated chat threads. A session can ask an agent to read files, search, call connectors, run code, and create reports or figures. Generated artifacts are stored as immutable, checksummed versions tied to available inputs, execution history, environment details, and the conversation branch that produced them. Missing evidence is labeled unavailable instead of being filled in, a sensible boundary for scientific work.

The application supports Python and R notebooks, but notebook execution is optional during its 5-step onboarding. Projects retain uploads, generated files, previews, tool calls, and message branches across restarts. The preview panel understands scientific data, office documents, images, source code, molecular structures, and notebook history. These pieces make Open Science more useful than a generic chat window when the task creates files that someone must inspect later. They do not establish that the scientific conclusion is correct.

Twenty-four connectors widen access and the data-exposure surface

The current catalog lists 24 built-in research connectors and 22 featured skills. Connectors cover literature, genetics, proteins, clinical sources, chemistry, structures, expression data, and an offline molecule viewer. Custom MCP servers can use stdio, HTTP, or SSE, while connector and tool policies can require approval, allow a call, or block it. File-based skills can also arrive from GitHub or user packages after preview and confirmation.

Every external model, web search, and connector creates its own data boundary. Open Science stores projects and configured credentials locally by default, yet the README says content needed for provider or connector calls can leave the machine. Three approval profiles range from asking before edits and network calls to full access. Researchers handling patient data or unpublished results should map each provider and connector before turning on broad approval, regardless of the local-first label.

What happened when we ran it

Our sandbox installed 1,682 npm packages in 113 seconds and occupied 2,220 MB on disk. The build completed successfully in 238 seconds. This was a large checkout even before dependencies: commit c6e835a contained 3,679 files, about 1,341,907 source lines, and 60.9 MB. We found 23 CI workflow files and a tests directory, but no Dockerfile.

The test command did not complete within our 900-second cap. Its final lines showed multiple tests passing around analyzer sidecars, missing metadata, receiver calls, and Python AST dependency detection, but there was no final suite summary. We therefore cannot report a pass count or call the suite successful. Npm audit found 5 known high-severity vulnerabilities, with 0 critical, moderate, or low findings, so adopters should identify the affected packages before approving a shared deployment.

Five onboarding steps stand between download and a first research task

Packaged users go through 5 guided stages: environment checks, a data location, an agent runtime, a model provider, and optional notebooks. Open Science can manage Claude Code, OpenCode, Codex, or CodeBuddy runtimes without asking the user to install Node.js. A cloud provider or custom gateway needs a credential and network access. Claude and Codex users can instead connect an existing subscription through the documented login paths.

Building from source is less friendly. Development requires Node.js 22 and npm, while the install runs Prisma generation, patch checks, and Electron native dependency setup. Our 113-second install and 238-second build passed, yet the 2,220 MB dependency footprint is larger than many complete desktop applications. The repository provides platform packaging commands for macOS, Windows, and Linux. It provides no Dockerfile, which fits its desktop focus and complicates disposable review environments.

Reproducibility in v0.25.1 records evidence without exact replay

Open Science preserves immutable artifact bytes and available production evidence, but v0.25.1 does not promise deterministic reruns. Its release notes say environment inventory is not a solver lock, portable environment restoration remains open, and code reconstruction is generated by a language model. Open issue 2016 also requests a complete portable session package containing transcripts, intermediate outputs, provenance, and reviewer results. The current export surface does not satisfy that issue's requested package.

The permission story has a similar boundary. Scoped allow grants, encrypted credential storage, workspace containment, and notebook network rules exist, while user-configurable directory grants and automated credential rotation remain open. Windows requires a one-time administrator setup before notebook and compute traffic falls under the network sandbox. A lab with formal isolation requirements should test those boundaries on each of its 3 supported desktop operating systems before approving sensitive datasets.

September 2026 activity is high, and unfinished surfaces remain visible

GitHub recorded a push on September 6, 2026, with 3,734 stars and 47 combined issues and pull requests. Release v0.25.1 had arrived 3 days earlier with Windows kernel, export, preview, session, and provider fixes. Same-day pull requests covered storage recovery, credentials, session performance, and a proposed v0.26.0 bump. The pace shows active maintenance, though the combined open count should not be read as 47 defects.

Fresh bugs still touch workflows beyond the main Electron window. Issue 2119 reports that Remote Web cannot choose a Specialist ZIP because the button calls a desktop-only file dialog. Issue 2184 reports failed plan creation alongside unresolved artifact reconciliation. The useful project and provenance model remains intact. These reports argue for a scoped pilot with non-sensitive data, narrow approvals, and a separate record of the chosen model and environment. The 900-second test timeout should also fit your maintenance budget.

Alternatives

ProjectWhat it isPick it when
PaperQAA focused system for answering questions over scientific papers with citations.pick this instead when literature retrieval and cited answers matter more than a full desktop research workspace.
STORMA research system that gathers sources and produces long-form reports with citations.pick this instead when the main output is a sourced topic report rather than notebooks, scientific connectors, and local artifact management.
GPT Researcher gh↗An autonomous research agent for web and local-data reports across model providers.pick this instead when you want a narrower report-generation agent that can sit inside your own application.

What people are saying

  1. [github-trending] aipoch/open-science

Sources

  1. AIPOCH Open Science repository and README
  2. Open Science v0.25.1 release
  3. Open Science roadmap and capability map
  4. Remote Web Specialist ZIP import bug
  5. Portable session package request
  6. Session Plan and artifact reconciliation report

More ai tools reviews

whisper · METATRON · openmed · VoxCPM · mlx · onnx · the whole board →