mrkeyoor.com_
Wed 16 Sept 10:17 UTC
LLM Toolsevaluationupdated 27 Aug 2026

autogen review

AutoGen is a Python and .NET framework for building agents that exchange messages, call tools, and divide work across a team. Microsoft has put it in maintenance mode and directs new projects to Microsoft Agent Framework, so AutoGen now makes most sense for existing deployments and migration work.

+100stars / 7d
Verdict

Our AutoGen build passed in 10 seconds, but its test run produced 96 collection or setup errors and no passing tests, while Microsoft now labels the project maintenance-only. Keep it for an existing application that cannot move yet, with targeted tests around the packages you use. For new work, follow Microsoft's own advice and start with Microsoft Agent Framework.

We ran it

Lab card: what happened when we ran autogenScreenshot of autogen (microsoft.github.io/autogen)
Install✓ · 24s33 packages · 36 MB
Build✓ · 10s
Tests✗ · 16s0 passed · 1 failed · 1 skipped · 96 errors of 97 (pytest)
Known vulns0(pip-audit)
Repo1837 files~189,959 lines of source · 48.3 MB · 12 CI workflows

Answers from our run

Does autogen build from source?

Dependencies installed in 24 seconds (33 packages), and the build succeeded in 10 seconds. We cloned commit 027ecf0 into a clean Debian container with 3 CPUs and no project-specific setup.

Do autogen's tests pass?

Not all of them: 0 of 97 passed and 1 failed when we ran the project's own test command (pytest), with 96 collection errors. Some failures need services or credentials a bare container does not have.

Does autogen have known vulnerabilities in its dependencies?

pip-audit found none in the dependency tree at the time of our run.

Who should not use autogen?

New production projects choosing a Microsoft agent stack: the README explicitly sends new users to Microsoft Agent Framework.

What are the alternatives to autogen?

Microsoft Agent Framework, LangGraph, CrewAI. Our AutoGen build passed in 10 seconds, but its test run produced 96 collection or setup errors and no passing tests, while Microsoft now labels the project maintenance-only.

Setup2/5Build passed, but 96 test collection or setup errors followed
Docs4/5Clear quick starts, safety notes, and two migration paths
Community3/560,645 stars and active issue discussion, now community managed
Maturity3/5Established APIs, but maintenance mode changes the adoption case

Discussed on

  1. hnAutogen: Enable next-gen large language model applications163 points
  2. hnAutoGen: Enabling next-generation large language model applications17 points
  3. hnMicrosoft AutoGen: possible plagiarism/academic misconduct?8 points
  4. hnMicrosoft's AutoGen – Guide to code execution by LLMs7 points
  5. hnAutoGen: Enable Next-Gen Large Language Model Applications4 points

Who it’s for

Teams maintaining an existing AutoGen application while they plan a migration.
Python developers who need its Core API, AgentChat patterns, model clients, or MCP support for a current system.
Researchers reproducing work built on AutoGen before Microsoft changed its recommended framework.
Developers evaluating agent orchestration who are willing to treat the project as maintained legacy software.

Who it’s NOT for

New production projects choosing a Microsoft agent stack: the README explicitly sends new users to Microsoft Agent Framework.
Teams expecting new AutoGen features or enhancements: Microsoft says maintenance is limited to fixes, security patches, and documentation.
Anyone planning to expose AutoGen Studio as a finished application: its own warning says Studio lacks the authentication and security expected in production.
Developers wanting a small repository with a clean fresh-container test run: our checkout held about 189,959 source lines and produced 96 collection or setup errors.
Operators who connect arbitrary MCP servers: the README warns that an MCP server can execute local commands or expose sensitive information.

Setup reality

Our sandbox installed commit 027ecf0 in 24 seconds, adding 33 packages and 36 MB. The build passed in 10 seconds. Tests failed after 16 seconds: 0 passed, 1 failed, 1 skipped, and 96 collection or setup errors were reported across 97 collected items.

The README quick start needs Python 3.10 or later, an OpenAI account, and OPENAI_API_KEY. Other providers, distributed runtimes, Studio, code execution, and MCP tools add their own packages, services, credentials, and trust decisions.

The Python project lives under python/, not the repository root. AutoGen Studio runs locally on port 8080 but is described as a prototype UI, not a production app. Existing v0.2 users also have a separate migration guide for the newer API and another guide for moving to Microsoft Agent Framework.

Maintenance mode makes AutoGen an existing-system choice

AutoGen lets developers assemble agents that exchange typed messages, call model clients and tools, and hand work to other agents. The Python stack is layered: Core handles messaging and local or distributed runtimes, AgentChat supplies higher-level conversation patterns, and Extensions connects providers and tools. The repository also contains .NET code, AutoGen Studio, and a benchmarking package. That range once made it a broad place to begin agent experiments.

The decision changed when Microsoft placed the project in maintenance mode. The README says it will receive fixes, security patches, and documentation changes, but no new features or enhancements. New users are directed to Microsoft Agent Framework, described there as the supported successor. Existing AutoGen users get migration documentation, which is useful, but the message is unambiguous: adopting AutoGen in 2026 means accepting a legacy path from day one.

The 3-layer Python API still covers serious agent work

Core, AgentChat, and Extensions address different levels of control. Core is for event-driven agents, message passing, and distributed execution. AgentChat provides opinionated teams and common conversational patterns. Extensions includes model clients and capabilities such as code execution. A team maintaining a deployed system can therefore stay near the convenience layer or replace parts with lower-level runtime code without leaving the project.

The quick start uses Python 3.10 or later and installs autogen-agentchat with the OpenAI extension. Its example exports an OpenAI API key and calls a current model through OpenAIChatCompletionClient. That is a small first program, but real cost and reliability depend on the provider, chosen model, tool calls, retry policy, and message history. Our sandbox did not call a model, so it says nothing about answer quality or token use.

What happened when we ran it

Our sandbox installed commit 027ecf0 in 24 seconds. It added 33 packages and occupied 36 MB, then completed the build in 10 seconds. The checkout contained 1,837 files, roughly 189,959 lines of source, and 48.3 MB before installation. Pip-audit reported 0 known vulnerabilities in the installed Python dependencies.

The test step failed after 16 seconds with exit code 1. Pytest reported 0 passed, 1 failed, 1 skipped, and 96 collection or setup errors out of 97. The log tail names failures across MCP workbench and client tests, Python code execution, Studio data models, database management, and team management. It does not show a shared exception or enough detail to assign one cause, so we cannot claim a missing system package explains the run.

Twelve CI workflow files were present, while our scan found no Dockerfile and no top-level tests directory. The Python packages do contain tests under their own package paths, as the failure list demonstrates. The useful conclusion is limited but important: install and build worked in the fresh Debian container, while the broad test command did not reach a trustworthy passing baseline.

Studio on port 8080 is a prototype, not an application shell

AutoGen Studio offers a visual way to compose and run teams, and the README starts it on localhost port 8080. Microsoft also warns that Studio is intended for rapid prototypes and demonstrations. It is not presented as a production-ready app, and teams are told to build authentication, security, and other deployment controls themselves. That warning should rule out putting the default UI on a public route.

Code execution and MCP integrations deserve the same caution. The README's MCP example installs the Playwright MCP server through npm and gives it to an agent as a workbench. A nearby warning says only trusted MCP servers should be connected because they may execute commands locally or expose sensitive information. Treat tool permissions, network access, filesystem mounts, and secrets as application design, not framework defaults.

Recent issue activity cannot reverse Microsoft's support decision

GitHub showed 60,645 stars, 1,004 combined open issues and pull requests, and a last push on April 15, 2026. Open issues were still being updated in August 2026, including proposals and security examples, so people continue to use and discuss the code. The combined count is not a defect total, and activity from users does not amount to a promise of new framework development.

The latest GitHub release was Python v0.7.5, published September 30, 2025. Its notes include model-client fixes, MCP failure handling, security warnings around code execution, and support for then-new provider options. Those are relevant fixes for pinned installations. They do not outweigh the current README, which tells new adopters to choose the successor.

Existing users should migrate package by package

A current AutoGen deployment may still be expensive to replace. Agent definitions, message types, team behavior, provider adapters, memory, MCP tools, and Studio workflows can all create migration work. The practical response is to inventory which of those layers the application actually uses, add focused tests around them, and compare the successor on those exact paths. Our run's 96 setup or collection errors make targeted verification more useful than assuming the whole checkout is healthy.

AutoGen remains readable, licensed for code use under MIT, and supported by detailed documentation. It is still the wrong default for a new agent system because its own maintainer has made that call. Keep a stable version where migration risk is higher than short-term maintenance risk, but do not build fresh architecture around an API family Microsoft has already superseded.

Alternatives

ProjectWhat it isPick it when
Microsoft Agent Framework gh↗Microsoft's supported successor for single-agent and multi-agent applications.pick this instead when starting a new Microsoft-based agent project or when long-term support matters.
LangGraph gh↗A graph runtime for stateful agents with explicit control over execution and persistence.pick this instead when you want workflow state and branching to be the main programming model.
CrewAI gh↗A Python framework centered on role-based agent crews and task flows.pick this instead when a higher-level crew metaphor suits a new Python project and you can validate its runtime separately.

Sources

  1. AutoGen README
  2. AutoGen Python v0.7.5 release
  3. AutoGen to Microsoft Agent Framework migration guide
  4. AutoGen issue activity

More llm tools reviews

headcount · useagent · claude-skills · RAG_Techniques · ux-ui-agent-skills · dictionary-of-ai-coding · the whole board →