mrkeyoor.com_
Thu 24 Sept 20:01 UTC
LLM Toolsevaluationupdated 26 Aug 2026

open_deep_research review

Open Deep Research is a configurable LangGraph agent that searches, summarizes sources, coordinates research work, and writes a report. It can use several model providers, native web search, Tavily, or MCP tools, but the GitHub repository is now archived and read-only.

-4stars / 7d
Verdict

Our Open Deep Research build took 4 seconds, but its only test failed on a LangSmith HTTP 401 and the upstream repository is archived with 73 issues and pull requests open. Read it as a useful LangGraph reference or fork it if you can own maintenance. For a new production research service, choose an active project unless this exact agent design is worth inheriting along with its provider costs and unresolved failure paths.

We ran it

Lab card: what happened when we ran open_deep_researchScreenshot of open_deep_research (github.com/langchain-ai/open_deep_research)
Install✓ · 91s224 packages · 795 MB
Build✓ · 4s
Tests✗ · 21s0 passed · 1 failed of 1 (pytest)
Known vulns0(pip-audit)
Repo45 files~7,112 lines of source · 6.5 MB · 2 CI workflows · tests dir

Answers from our run

Does open_deep_research build from source?

Dependencies installed in 91 seconds (224 packages), and the build succeeded in 4 seconds. We cloned commit 1b7d2e8 into a clean Debian container with 3 CPUs and no project-specific setup.

Do open_deep_research's tests pass?

Not all of them: 0 of 1 passed and 1 failed when we ran the project's own test command (pytest). Some failures need services or credentials a bare container does not have.

Does open_deep_research have known vulnerabilities in its dependencies?

pip-audit found none in the dependency tree at the time of our run.

Who should not use open_deep_research?

Teams that require upstream fixes or accepted pull requests: GitHub marks the repository archived, with 73 issues and pull requests still open.

What are the alternatives to open_deep_research?

GPT Researcher, Local Deep Researcher, PaperQA. Our Open Deep Research build took 4 seconds, but its only test failed on a LangSmith HTTP 401 and the upstream repository is archived with 73 issues and pull requests open.

Setup2/591-second install, several credentials, and the only test failed
Docs4/5Quick start, providers, evaluation, deployment, and legacy paths covered
Community2/512,673 stars, but the repository is archived with 73 open items
Maturity2/5Published evaluation work, but archived with unresolved agent failures

Discussed on

  1. hnShow HN: Open-source deep-research agent3 points

Who it’s for

Researchers studying how a LangGraph research agent plans, searches, compresses notes, and writes reports.
Python teams that want a readable starting point for an internal research workflow.
Developers comparing model and search-provider combinations with the supplied evaluation path.
LangGraph users who can maintain a fork now that the upstream repository is archived.

Who it’s NOT for

Teams that require upstream fixes or accepted pull requests: GitHub marks the repository archived, with 73 issues and pull requests still open.
Users expecting research without paid model or search access: the default configuration names OpenAI models and Tavily, while evaluation requires LangSmith authentication.
Anyone treating the generated report as verified fact: the workflow summarizes search output and uses model judgment, so source checking remains part of the job.
Operators who need child-agent failures surfaced reliably on the archived code: issue 283 shows an exception path that could turn a failed child run into an apparently completed research phase.
Teams avoiding deprecated LangGraph APIs: our only test emitted 11 warnings from legacy graph code before failing on LangSmith authentication.
Budget-sensitive users planning the full benchmark: the README estimates $20 to $100 for 100 evaluation examples, depending on model choice.

Setup reality

Our sandbox install at commit 1b7d2e8 succeeded in 91 seconds, adding 224 packages and using 795 MB. The build passed in 4 seconds. The only pytest case failed after 21 seconds because LangSmith returned HTTP 401 for /datasets; 11 deprecation warnings also came from the legacy LangGraph code.

A useful run needs credentials for the chosen chat models and a search route. The defaults use OpenAI models and Tavily; native OpenAI or Anthropic search and MCP servers are alternatives. Evaluation needs LangSmith access.

The README starts the agent through LangGraph Studio on Python 3.11. Models must support structured output and tool calling. The repository has no Dockerfile, and its archived status means production users should expect to own dependency and API migrations in a fork.

The repository is archived after an August 10 push

Open Deep Research is easy to understand as a reference implementation. A LangGraph supervisor breaks a question into research work, search tools collect material, models summarize and compress it, and another model writes the final report. Configuration separates summarization, research, compression, and report models. Search can come from Tavily, native OpenAI or Anthropic tools, or MCP servers. That separation makes the code useful for learning and experimentation.

The maintenance status changes the buying decision. GitHub marks the repository archived and read-only, despite a last push on August 10, 2026. It had 12,673 stars and 73 combined open issues and pull requests when fetched. There is no latest GitHub release. Recent code activity before archival shows that people were still proposing provider additions and fixes, but those dates do not restore an upstream path for merging them. A production adopter now needs a fork strategy.

Four model roles let cost and quality move independently

The default configuration assigns one model to search-result summaries and separate choices to research, compression, and final writing. Every selected model must support tool calling and structured output. This is a practical design because a cheaper summarizer can process search pages while a stronger model handles the report. It also creates 4 places where provider behavior, context limits, credentials, and pricing can differ.

Tavily is the default search API, while native web search is documented for OpenAI and Anthropic. MCP configuration opens the door to private or specialist sources. None of those choices makes source quality automatic. A model still chooses queries, compresses what it found, and writes conclusions from partial material. The resulting citations and claims need inspection, especially for legal, medical, financial, or rapidly changing subjects.

What happened when we ran it

Our sandbox installed commit 1b7d2e8 in 91 seconds. The Python environment added 224 packages and occupied 795 MB. The build completed successfully in 4 seconds, and pip-audit found 0 known vulnerabilities. The checkout contained 45 files, about 7,112 lines of source, and 6.5 MB before dependencies, so most of the disk cost came from the environment rather than project code.

The only pytest case failed after 21 seconds with exit code 1. Its final error was LangSmithAuthError: the request to /datasets received HTTP 401 Unauthorized. The run used no secrets, so this result establishes that the supplied test path was not self-contained in our fresh environment. It does not establish whether correct LangSmith credentials would make the report-quality assertion pass.

Pytest also reported 11 warnings from src/legacy/multi_agent.py. The visible messages say config_schema, input, and output are deprecated in LangGraph and point to replacement schema arguments. Those warnings did not cause the HTTP 401, but they identify migration work a fork will eventually face. Our run used Python 3.12 in an unprivileged Debian container with 3 CPUs and 8 GB of RAM.

The benchmark uses 100 judged research tasks

The README documents Deep Research Bench, a set of 100 tasks split between English and Chinese across 22 fields. Reports are scored by an LLM judge against expert-written references. The published table includes model combinations, token totals, costs, and RACE scores from 2025 runs. That is better evidence than a few handpicked demos, but it is still a model-judged benchmark with provider versions and prompts tied to specific commits.

Running the full evaluation is not a casual smoke test. The README estimates $20 to $100 for the 100 examples depending on model selection, and the extraction workflow relies on a LangSmith dataset and experiment. Our HTTP 401 confirms that authentication is load-bearing in the current test path. Teams comparing forks should pin the dataset, model identifiers, prompts, and judge configuration, then save the report artifacts rather than comparing one headline score across changed conditions.

Child failures could still produce a final report

Issue 283 describes a serious main-graph failure path. The shown exception handler contains or True, so any child ConductResearch exception can be treated like a normal end to research. The graph may then continue to final report generation with only the notes collected before the failure. Pull request 286 proposes removing that unconditional branch and surfacing non-token-limit errors, but an archived repository cannot merge it through the usual route.

Legacy code has another coordination report. Issue 284 says one completed section can send the supervisor forward before every parallel section returns; pull request 299 proposes waiting for all planned workers. These reports concern named paths and include proposed regression coverage. A team using the current main graph should prioritize issue 283, while anyone borrowing src/legacy/multi_agent.py should inspect both the early join and the deprecation warnings our test emitted.

LangGraph Studio is convenient, but deployment is yours

The quick start creates an environment, copies .env, and launches a LangGraph development server with a Studio UI. The documented local API listens on port 2024. Hosted use points to LangGraph Platform, while Open Agent Platform is presented as a configurable interface for nontechnical users. The repository contains no Dockerfile, so self-hosters must define their own image, secret handling, persistence, limits, and network policy.

Open Deep Research remains a useful code reading exercise because the workflow is compact enough to follow and broad enough to expose real research-agent problems. Our 224-package install and 795 MB environment are manageable for experimentation. The archived state, the authenticated single test, and the unresolved child-error path make it a poor default dependency for a new service. Fork it with explicit ownership, or start from an active alternative and use this repository for design ideas.

Alternatives

ProjectWhat it isPick it when
GPT Researcher gh↗An actively developed autonomous research agent with report generation and several deployment paths.pick this instead when you want an active upstream and a product-oriented research application.
Local Deep ResearcherA LangGraph research example designed around local models and configurable search.pick this instead when local model use matters more than this project's multi-provider benchmark setup.
PaperQAA research system focused on answering questions from scientific papers with citations.pick this instead when the source set is academic literature rather than the open web.

What people are saying

  1. [github-trending] langchain-ai/open_deep_research

Sources

  1. Open Deep Research repository
  2. Deep Research Bench leaderboard
  3. Child research error report
  4. Child research error fix
  5. Legacy partial completion report
  6. Legacy section join fix

More llm tools reviews

llm-wiki-compiler · claude-skills · Humanizer-zh · agent-beacon · MiMo-Code · pi-claude-bridge · the whole board →