mrkeyoor.com_
Sun 08 Nov 21:56 UTC
LLM Toolsevaluationupdated 01 Nov 2026

open_deep_research review

Use Open Deep Research as a LangGraph reference or a fork you are prepared to maintain. Open Deep Research is archived and read-only. It is a configurable research agent with separate models for summarization, research, compression and report writing, plus configurable search tools and MCP servers. Our run on October 13, 2026 tested commit 1b7d2e8 in our sandbox; it did not establish that the agent could complete a research report.

-5stars / 7d
Verdict

Open Deep Research is worth studying if you want a configurable LangGraph research workflow and can own its maintenance. Our sandbox installed and built commit 1b7d2e8, but the recorded test stopped at LangSmith authentication. Before adopting a fork, complete an authenticated research request, inspect its sources and test how it reports a failed research branch.

We ran it

Lab card: what happened when we ran open_deep_researchScreenshot of open_deep_research (github.com/langchain-ai/open_deep_research)
Install✓ · 74s230 packages · 896 MB
Build✓ · 6s
Tests✗ · 20s0 passed · 1 failed of 1 (pytest)
Known vulns0(pip-audit)
Repo45 files~7,112 lines of source · 6.5 MB · 2 CI workflows · tests dir

Answers from our run

Does open_deep_research build from source?

Dependencies installed in 74 seconds (230 packages), and the build succeeded in 6 seconds. We cloned commit 1b7d2e8 into a clean Debian container with 3 CPUs and no project-specific setup.

Do open_deep_research's tests pass?

No. The project's own test command finished in 20 seconds and reported 0 passed, 1 failed (pytest).

Does open_deep_research have known vulnerabilities in its dependencies?

pip-audit found none in the dependency tree at the time of our run.

Who should not use open_deep_research?

Teams that need upstream maintenance: GitHub marks this repository archived and read-only.

What are the alternatives to open_deep_research?

GPT Researcher, Local Deep Researcher, PaperQA2. Open Deep Research is worth studying if you want a configurable LangGraph research workflow and can own its maintenance.

Setup2/5Substantial constraints: the 74-second installation succeeded, but the recorded test stopped at LangSmith authentication and no completed research workload was validated.
Docs4/5Broad documented provision: the supplied README covers quick start, model roles, search configuration, evaluation, deployment options and legacy implementations; those instructions were not all validated.
Community2/5Substantial support constraint: GitHub marks the upstream repository archived and read-only. The supplied evidence does not establish response times or the availability of maintained forks.
Maturity2/5Substantial operational constraints: our run did not validate report generation, upstream is archived, and issue 283 reports a child-failure path at another commit that adopters should investigate.

Discussed on

  1. hnShow HN: Open-source deep-research agent3 points

Who it’s for

Python developers studying how a configurable research workflow separates search, note compression and report writing.
LangGraph teams prepared to maintain a fork and investigate error handling before deployment.
Researchers who can supply model, search and evaluation credentials and inspect the resulting sources themselves.

Who it’s NOT for

Teams that need upstream maintenance: GitHub marks this repository archived and read-only.
Users expecting a verified research service from a successful installation or build.
Operators who require evidence that child-agent failures surface correctly: our sandbox did not test that behavior.
Teams seeking an evaluated local-model setup without doing their own compatibility checks.

Setup reality

Our run on October 13, 2026 tested commit 1b7d2e8 in our sandbox. Installation succeeded in 74 seconds, and the recorded build step succeeded in 6 seconds. The environment contained 230 packages occupying 896 MB. The test command exited with code 1 after 20 seconds.

The stored parser summary records 0 passed, 1 failed, 0 skipped and 0 errors. These are parser results, not verified exhaustive counts of unique tests. The raw log identifies a legacy report-quality test that stopped at a LangSmith authentication error for /datasets.

The README quick start launches a local LangGraph server and Studio interface using Python 3.11; our stored environment used Python 3.12.12. Selected models must support structured output and tool calling. Configure the required credentials before attempting a research request or evaluation. We did not verify Studio startup, a completed report, hosted deployment or provider compatibility.

Should you adopt it?

Open Deep Research is archived and read-only. GitHub's notice on issue 283 dates the archival to August 21, 2026. Adopt it when you want this research-agent design and can maintain a fork. For a new service, first establish that its workflow, failure handling and operating requirements fit your application.

The README at our tested commit separates summarization, research, compression and final report writing into configurable model roles. Tavily is the default search API; the documentation also describes native OpenAI and Anthropic search and MCP configuration. These are documented capabilities, not combinations we validated in our sandbox.

What our sandbox established

Our run on October 13, 2026 tested commit 1b7d2e8 in our sandbox. Installation succeeded in 74 seconds, and the recorded build step succeeded in 6 seconds. The installed environment contained 230 packages occupying 896 MB.

Our harness records each command step's outcome, exit code and elapsed wall-clock time, alongside parsed test counts and retained log tails. The test command returned exit code 1 after 20 seconds. Its stored parser summary records 0 passed, 1 failed, 0 skipped and 0 errors. That summary does not establish exhaustive unique test coverage; we performed no new execution or complete-log reconciliation for this correction.

The raw failure names src/legacy/tests/test_report_quality.py::test_response_criteria_evaluation. LangSmith rejected the request to /datasets with HTTP 401 and an Invalid token response. This establishes an authentication blocker in that test path. It does not show whether a correctly authenticated run would satisfy the report-quality assertion.

The raw pytest footer separately reports 1 failed and 11 warnings in 10.74 seconds. That is pytest's reported duration; the attached harness records 20 seconds for the command step. The warnings span src/legacy/graph.py, src/legacy/utils.py and src/legacy/multi_agent.py. They include deprecated LangGraph imports and schema arguments, plus a warning about langchain-community maintenance. The warnings are separate from the authentication failure.

The audit record contains 0 reported pip-audit advisories. Scan coverage is unknown: the supplied record does not establish how many packages were scanned. This result is not a security assessment.

The successful build step does not establish that Studio started, a research workload completed or a deployment worked. We did not measure report accuracy, research latency, model costs or failure recovery. The testing-methodology page explains the publisher's approach and limitations; its current text does not establish which methodology version governed this older run.

Check child failures before trusting completion

Issue 283 reports that a child ConductResearch exception can end the research phase normally and allow final report generation to continue with empty or partial findings. Its reproduction identifies a different commit, 1f24f1142db24f81e29eb88751985a00ec8ed580, so it is a reported failure path to investigate, not a result reproduced by our run at 1b7d2e8.

Before deploying a fork, test what happens when one research branch fails while another succeeds. Require the application to expose the failure and make the status of partial findings clear. Our authentication-blocked legacy test provides no evidence that the main graph handles that case correctly.

Setup and evaluation are separate decisions

The pinned README starts with an environment file and a local LangGraph development server. Its default model roles use OpenAI models, and its default search route uses Tavily. Model selection must account for structured output and tool calling; a provider name alone is not a compatibility test.

The README describes Deep Research Bench evaluation through LangSmith and warns that running its 100 examples can cost approximately $20 to $100 depending on model selection. That is the project's estimate, not our measured cost. Its published benchmark results belong to their named configurations and commits; we did not reproduce them, and the supplied leaderboard fetch was inaccessible.

A useful next step is a single authenticated research request whose sources you can check, followed by a deliberate child-failure test. Save the configuration and output before committing to a larger evaluation or deployment.

Which alternatives fit a different requirement?

GPT Researcher documents research reports using web and local documents. Consider it as a replacement candidate when those source types and its documented frontend or export options matter. Its README establishes those capabilities, not superior accuracy or reliability in our environment.

Local Deep Researcher documents local LLM use through Ollama or LMStudio. Consider it as a replacement candidate when local model hosting is the priority. It still performs web search, so local inference does not mean offline research.

PaperQA2 focuses on retrieval augmented generation over documents, with an emphasis on scientific literature. Choose it for questions grounded in a document collection. It can also complement an open-web workflow by handling a separate literature corpus; it is not evidence of a drop-in replacement for this agent.

How to read the scores

These are editorial ratings, not measured product performance. The scale is 1 for severe obstacles, 2 for substantial constraints, 3 for workable provision with gaps, 4 for broad documented provision and 5 for broad provision corroborated by successful validation. Each dimension uses its own evidence: setup considers the recorded installation and prerequisites; docs considers the supplied documentation; community considers upstream support availability; maturity considers validation and operational limitations. Stars do not establish support quality, and a documentation score does not certify runtime behavior.

Alternatives

ProjectWhat it isPick it when
GPT Researcher gh↗A research agent whose documentation covers web and local-document reports, frontends and report exports.Consider it as a replacement candidate when web and local-document research belong in the same application; compare its behavior yourself before choosing.
Local Deep ResearcherAn iterative web research assistant using local models hosted through Ollama or LMStudio.Consider it as a replacement candidate when local model hosting matters most; web search remains a separate network dependency.
PaperQA2A document question-answering package focused on scientific literature.Choose it for questions over a document collection, or use it alongside an open-web workflow for a separate literature corpus.

What people are saying

  1. [github-trending] langchain-ai/open_deep_research

Sources

  1. Open Deep Research repository
  2. Deep Research Bench leaderboard
  3. Child research error report
  4. Child research error fix
  5. Legacy partial completion report
  6. Legacy section join fix

More llm tools reviews

gemini-api-cli · MCPJungle · octomind · kimi-k3-in-c · nanochat · FreeToken · the whole board →