mrkeyoor.com_
Thu 17 Sept 22:01 UTC
AI Toolsevaluationupdated 26 Aug 2026

openscience review

OpenScience is a local browser workbench where an AI agent can search scientific sources, write code, run experiments, and assemble results in one project. It combines a research chat, files, terminal access, scientific viewers, provider routing, and a large library of domain instructions.

+30stars / 7d
Verdict

Our OpenScience test command was still running at the 900-second cap after an 81-second successful build, so adopting this workbench means budgeting for a large and slow-moving verification surface. It is worth a controlled trial for a technical lab that wants literature, code, compute, and provenance in one local interface. Keep a human responsible for scientific claims, review the data-sharing setting before the first real project, and do not treat its sandbox as a VM.

We ran it

Lab card: what happened when we ran openscienceScreenshot of openscience (openscience.sh)
Install✓ · 91s799 packages · 870 MB
Build✓ · 81s
Tests✗ timed out · 900sran, no count parsed
Repo4776 files~463,014 lines of source · 84.5 MB · 9 CI workflows

Answers from our run

Does openscience build from source?

Dependencies installed in 91 seconds (799 packages), and the build succeeded in 81 seconds. We cloned commit 2ecaa76 into a clean Debian container with 3 CPUs and no project-specific setup.

Do openscience's tests pass?

We could not finish them: the suite was still running after 15 minutes in our container.

Who should not use openscience?

Anyone requiring a completely account-free first launch: the README says normal use links a free Synthetic Sciences account and stores a revocable device credential.

What are the alternatives to openscience?

PaperQA, Agent Laboratory, AI-Researcher. Our OpenScience test command was still running at the 900-second cap after an 81-second successful build, so adopting this workbench means budgeting for a large and slow-moving verification surface.

Setup3/591-second install; model access and account linking remain
Docs4/5Clear architecture, provider, platform, and sandbox guidance
Community4/53,342 stars, current pushes, and an active issue queue
Maturity3/5Rapid v2 releases, but our tests exceeded 900 seconds

Discussed on

  1. hnOpenScience: Workbench for scientific research using custom LLMs13 points

Who it’s for

Researchers who want one observable workspace for literature, code, experiments, and written results.
Labs willing to supply model access, review agent actions, and verify every scientific conclusion.
Developers who need local files, scientific database connectors, MCP servers, and custom skills in one agent interface.
Teams with Linux, macOS, or Windows machines that meet the published binary requirements.

Who it’s NOT for

Anyone requiring a completely account-free first launch: the README says normal use links a free Synthetic Sciences account and stores a revocable device credential.
Labs that cannot permit research-trajectory uploads without a configuration review: the README says Use my data is enabled after sign-in and includes prompts, responses, tool calls, and results until disabled.
People treating the execution sandbox as protection from hostile code: the security guide says it is not a full VM, and Windows has no sandbox backend.
Researchers who need unattended completion to prove a result exists: issue 334 reports a workflow stopping after one continuation and missing evidence already registered in ArtifactStore.

Setup reality

Our sandbox installed 799 packages in 91 seconds and used 870 MB. The build succeeded in 81 seconds. Tests were still running when the 900-second limit expired; the last logged session-compaction cases were passing, including cases that took about 3 to 5 seconds each.

Source development requires Bun 1.3 or newer. Actual research also needs a free Synthetic Sciences account plus a model route: your provider key, eligible ChatGPT access, a local model, or optional Ace credits. Scientific runtimes and remote compute bring their own credentials and dependencies.

The 84.5 MB monorepo contains 4,776 files and about 463,014 source lines. Linux needs kernel 5.1 or newer; separate glibc and musl builds are published. The local agent can execute code, so users should verify sandbox containment and use a container or VM for hostile inputs.

One workspace covers papers, code, and experiments

OpenScience starts a local server and opens a browser workspace with files, an editor, terminal access, sessions, and scientific previews. Its Research agent can query literature and scientific databases, write programs, run them on permitted compute, inspect outputs, and prepare a written result. The README lists 311 bundled skills and around 30 database integrations, spanning machine learning, biology, physics, and chemistry.

The application is broader than a paper chatbot. A Hono backend runs the agent loop and tool layer, while a SolidJS front end presents the project. Provider routing supports hosted keys, eligible ChatGPT access, local models, and optional paid Ace routes. MCP servers, plugins, custom agents, commands, and project skills can extend it. That breadth makes OpenScience attractive for mixed work, though each added runtime or connector enlarges the environment a lab must understand.

A free account is required even with your own model key

The install command is simple: install the npm package globally or launch it through npx synsci. First launch links a free Synthetic Sciences account and leaves a revocable device credential on the machine. A model still has to come from somewhere. Users can provide API keys, connect eligible ChatGPT or Codex access, use a local model, or fund the optional Ace wallet.

Account linking matters to a local-first evaluation. The current README says local sessions continue without managed services after the device is connected, while enhanced search, managed models, synced credentials, and private research graphs depend on Synthetic Sciences. It also says Use my data is enabled after sign-in and uploads the full research trajectory, including prompts, model responses, tool calls, and results, with credentials redacted. A lab should inspect and set that control before opening confidential work.

What happened when we ran it

Our sandbox installed commit 2ecaa76 in 91 seconds, adding 799 packages and occupying 870 MB. The build completed successfully in 81 seconds. The checkout was already 84.5 MB, with 4,776 files and roughly 463,014 lines of source. We found 9 CI workflow files and workspace configuration, but no root Dockerfile or tests directory.

The test command did not finish within the 900-second limit. Its last output showed passing session usage and compaction cases. Several persistence cases took about 3 to 5 seconds apiece, including managed handoff-file behavior and preservation of command controls. The log tail contained no failing assertion, and it also did not provide a completed total. The accurate result is a timeout, not a pass or a failure count.

That long run changes the maintenance calculation. A clean install and build prove the monorepo can be assembled in our 3-CPU, 8 GB Debian container. They do not prove every workspace flow, model provider, scientific connector, sandbox backend, or platform binary. Teams should identify a smaller pre-merge set for their own deployment while retaining a scheduled full run with enough time to finish.

The sandbox limits commands but does not make code safe

OpenScience can run shell commands, edit files, access scientific services, and launch compute. New local installs use an approval mode with native containment where available. On macOS that means Seatbelt, and on Linux it means bubblewrap. The documented sandbox test checks whether containment is working. Host and Origin allowlists protect the localhost server, which is not designed for remote exposure.

The security guide draws firm limits. Windows has no sandbox backend, and neither native backend is a full virtual machine. External MCP servers sit outside the stated trust boundary. The README advises a container or VM for hostile code, which is the right standard for downloaded repositories, untrusted datasets with active formats, or model-generated commands that reach unfamiliar tools. Human approval remains a policy control rather than proof that execution is harmless.

Research contracts can stop before evidence is reconciled

Issue 334 describes a concrete workflow failure in v2.0.31. One automatic contract continuation can be followed by a stop even when work remains repairable or a compute job is still active. The report also says artifacts registered directly through the ArtifactStore API may be missing from the session trace, causing a required result to appear absent despite durable storage.

That issue does not show that every research run loses evidence. It does show why the workspace cannot be the final scientific arbiter. A finished answer should point to immutable artifacts, executable code, source papers, environment details, and review results that a person can inspect outside the conversation. For costly experiments, add explicit checkpoints before the agent moves from computation to interpretation.

Active releases favor current users over frozen deployments

GitHub recorded a push on August 26, 2026, and release v2.0.45 was published the same day. The repository had 3,342 stars and 18 combined issues and pull requests when fetched. Nine CI workflows cover areas including code scanning, end-to-end work, package tests, catalog checks, and publishing. This is an active project with a fast release pace, rather than a settled scientific instrument.

OpenScience earns a trial when a lab already expects to supervise an agent and wants its papers, programs, terminals, and artifacts visible together. The 900-second test timeout and 870 MB dependency footprint make casual source maintenance less appealing. Pin a release, verify the sandbox on each host, disable unwanted sharing, and define what evidence a human must accept before a generated result leaves the workspace.

Alternatives

ProjectWhat it isPick it when
PaperQAA focused system for answering questions from scientific papers with citations.pick this instead when literature retrieval and cited answers are the job, without a full coding and experiment workspace.
Agent LaboratoryAn agent workflow that helps researchers move from an idea toward experiments and a report.pick this instead when you want a research workflow to study or adapt and do not need OpenScience's browser workspace.
AI-ResearcherA research codebase aimed at autonomous scientific idea generation and experimentation.pick this instead when autonomous research methods are the object of study rather than a general daily workbench.

Sources

  1. OpenScience README
  2. OpenScience architecture
  3. OpenScience security policy
  4. OpenScience v2.0.45 release
  5. Issue 334: research contract continuation

More ai tools reviews

rowboat · skills · superpowers-zh · yolov5 · eve · MemOS · the whole board →