mrkeyoor.com_
Sat 31 Oct 13:10 UTC
LLM Toolsevaluationupdated 15 Oct 2026

autogen review

AutoGen is a framework for building AI assistants that exchange messages, call tools, and delegate work to other assistants. It handles the coordination code behind those applications, but it is now in maintenance mode and directs new projects to Microsoft Agent Framework.

+81stars / 7d
Verdict

Our AutoGen run installed 35 packages in 13 seconds and built in 2 seconds, but pytest reported 0 passing tests and 96 collection/setup errors. Keep it for an existing application whose integrations justify maintaining it, with checks around the packages you actually use. For new projects, follow the README's recommendation and evaluate Microsoft Agent Framework first.

We ran it

Lab card: what happened when we ran autogenScreenshot of autogen (microsoft.github.io/autogen)
Install✓ · 13s35 packages · 38 MB
Build✓ · 2s
Tests✗ · 5s0 passed · 1 failed · 1 skipped · 96 errors of 97 (pytest)
Known vulns0(pip-audit)
Repo1837 files~189,959 lines of source · 48.3 MB · 12 CI workflows

Answers from our run

Does autogen build from source?

Dependencies installed in 13 seconds (35 packages), and the build succeeded in 2 seconds. We cloned commit 027ecf0 into a clean Debian container with 3 CPUs and no project-specific setup.

Do autogen's tests pass?

No. The project's own test command finished in 5 seconds and reported 0 passed, 1 failed, 1 skipped, 96 collection errors (pytest).

Does autogen have known vulnerabilities in its dependencies?

pip-audit found none in the dependency tree at the time of our run.

Who should not use autogen?

Teams choosing a foundation for a new agent product: the README says AutoGen will receive no new features and recommends Microsoft Agent Framework.

What are the alternatives to autogen?

Microsoft Agent Framework, LangGraph. Our AutoGen run installed 35 packages in 13 seconds and built in 2 seconds, but pytest reported 0 passing tests and 96 collection/setup errors.

Setup3/513-second install and 2-second build, but the suite failed
Docs4/5Layered API examples, migration guidance, and explicit Studio limits
Community3/5Recent reports, but support is now community-managed
Maturity3/5Established APIs in maintenance mode; no passing suite in our run

Discussed on

  1. hnAutogen: Enable next-gen large language model applications163 points
  2. hnAutoGen: Enabling next-generation large language model applications17 points
  3. hnMicrosoft AutoGen: possible plagiarism/academic misconduct?8 points
  4. hnMicrosoft's AutoGen – Guide to code execution by LLMs7 points
  5. hnAutoGen: Enable Next-Gen Large Language Model Applications4 points

Who it’s for

Teams maintaining an existing AutoGen application whose working model clients and agent handoffs make an immediate migration costly.
Python developers studying AgentChat delegation and group conversations who can work within a maintenance-only feature set.
Engineers building their own application around AutoGen's message runtime, with responsibility for credentials, tool permissions, and deployment controls.

Who it’s NOT for

Teams choosing a foundation for a new agent product: the README says AutoGen will receive no new features and recommends Microsoft Agent Framework.
Buyers expecting AutoGen Studio to be a deployable internal app: the README explicitly calls it a prototype and leaves authentication and security to developers.
Organizations needing assured maintainer responses: the README says support is community-managed and responses may be limited.
Python-only environments that require the README's Playwright MCP example: that workflow launches a separate server through npx and needs a Node runtime.

Setup reality

Our sandbox installed commit 027ecf0 in 13 seconds, adding 35 packages and using 38 MB on disk. The build passed in 2 seconds. Tests exited with code 1 after 5 seconds: 0 passed, 1 failed, 1 skipped, and 96 collection/setup errors. Pip-audit reported 0 known vulnerabilities.

The README's assistant examples need an OpenAI account and OPENAI_API_KEY. Other providers require their corresponding client configuration. The Playwright MCP example also launches a separate server through npx, so Python packages alone do not supply its whole runtime.

The run used Python 3.12 on fresh Debian, unprivileged and without secrets; the README requires Python 3.10 or later. The log names Studio collection/setup errors without their causes and a template example whose async function pytest could not run natively. Studio itself is documented as a prototype, with authentication and deployment protections left to developers.

Maintenance mode makes AutoGen a difficult choice for new work

Choose AutoGen today and you inherit a framework whose maintainers have stopped adding features. The current README directs new projects to Microsoft Agent Framework and encourages existing users to migrate. That changes the recommendation before you write an agent: keeping a working application running can justify AutoGen, while starting a fresh dependency on it needs a reason beyond familiarity with the name.

The package footprint alone would not put me off. Our sandbox added 35 packages occupying 38 MB, a manageable environment for exploring the Python API. The harder commitment is owning code against a community-managed framework with a published exit route. An existing team can weigh migration against its working integrations. A new team gets little benefit from taking on that decision immediately.

AgentChat gives you assistants and delegation without writing the message runtime

AutoGen's Python code lives under ./python/; our checkout contained 1,837 files and roughly 189,959 source lines. AgentChat supplies assistant and group-conversation patterns, while Core handles message delivery and agent runtimes. Extensions connect those agents to model providers and tools. For an application that already separates work between assistants, those layers give each responsibility a place to live.

The README's delegation example wraps specialist assistants in AgentTool objects so another assistant can call them. That is a concrete reason to use the framework: you can express which assistant handles which task without building the message plumbing yourself. It does not establish that several assistants answer better than one. Decide what handoff your application needs before adding more participants to its conversations.

What happened when we ran it

Our run installed AutoGen at commit 027ecf0 in 13 seconds, adding 35 packages and using 38 MB on disk. The build passed in 2 seconds. We cloned and ran it on October 14, 2026, in an unprivileged Debian container using ghcr.io/astral-sh/uv:python3.12-bookworm, with 3 CPUs, 8 GB of RAM, and no secrets. Those steps establish that the measured installation and build completed in that environment.

The test command exited with code 1 after 5 seconds. Pytest reported 0 passed, 1 failed, 1 skipped, and 96 collection/setup errors. The log tail names AutoGen Studio modules covering MCP connections, database management, and teams, but omits the exception details for those errors. It cannot tell us whether missing packages, configuration, or defects caused them. It gives no passing-suite evidence to rely on.

The separate failure was a cookiecutter template example at templates/new-package/{{cookiecutter.package_name}}/tests/test_example.py::test_example. Pytest said async functions were not natively supported. That identifies the reported failure without explaining how the template entered the run. Pip-audit reported 0 known vulnerabilities. Neither the audit nor the successful build establishes whether an agent can complete a useful task with a configured model.

Our scan found 12 CI workflow files and flagged no Dockerfile or tests directory. The same log lists nested test paths, so the directory signal cannot support a claim that AutoGen has no tests. Read that flag as a limitation of the scan. The actionable result is that the broad command we ran did not produce a green suite.

The quickstart needs a model credential, and browser tools add another runtime

The lab used Python 3.12; AutoGen's README specifies Python 3.10 or later. Its assistant example needs an OpenAI account and OPENAI_API_KEY, with model calls going through OpenAIChatCompletionClient. The code creates an assistant, awaits its result, and closes the model client. Copying the package command gets you the software. You still need an authorized model endpoint before that example can answer.

The Playwright MCP example launches a separate server through npx, adding a Node runtime to the Python application. Our 13-second install does not measure readiness of that browser workflow. The README also warns that MCP servers can execute local commands or expose sensitive information. Pick the server and its access deliberately, especially when moving a local experiment onto a machine holding application credentials.

Studio is explicitly a prototype interface

AutoGen Studio's README warning says developers must supply authentication and other deployment protections in their own applications. The visual editor is useful for trying agent workflows, but it does not relieve you of building the surrounding service. If your requirement is a browser app you can expose to colleagues immediately, this limitation is a good reason to choose something else.

The 0 known vulnerabilities in our pip-audit result cover the dependency environment we measured. They do not assess Studio access control or the permissions granted to an MCP server. Keep those decisions separate when evaluating a deployment. A team maintaining AutoGen should review the particular tools it exposes, rather than treating a clean dependency report as approval for the whole application.

Recent reports coexist with an older push and release

GitHub's API reported the last push as April 15, 2026, and 1,115 open issues and PRs. The latest release endpoint returned python-v0.7.5, published September 30, 2025. Recent discussion still exists: issue 8346, updated October 13, reports that the experimental conversation recorder fails with a bare relative filename while an explicit relative path works. That is a user report, separate from our sandbox findings.

These dates fit the README's maintenance policy more closely than a claim of abandonment. For new work, start by evaluating Microsoft Agent Framework, the documented successor. Choose LangGraph when explicit workflow state, persistence, and human intervention are your main requirements. Keep AutoGen when existing integrations justify it, and require checks around those integrations before shipping. Our 2-second build passed. The test run did not.

Alternatives

ProjectWhat it isPick it when
Microsoft Agent Framework gh↗Microsoft's successor framework for agents and workflows in Python and .NET.pick this instead when starting new work or migrating an AutoGen application along Microsoft's documented route.
LangGraph gh↗A workflow framework with persistent agent state and human intervention points.pick this instead when explicit state transitions and resuming interrupted workflows matter more than adopting AutoGen conversation patterns.

Sources

  1. AutoGen repository and README
  2. AutoGen documentation
  3. AutoGen python-v0.7.5 release
  4. AutoGen recorder relative filename report, issue 8346
  5. Migration from AutoGen to Microsoft Agent Framework
  6. Microsoft Agent Framework repository
  7. LangGraph repository

More llm tools reviews

ironclaw · infinity · Claude-Code-Game-Studios · OmniRoute · harnessrouter · pi-subagents · the whole board →