mrkeyoor.com_
Mon 02 Nov 01:15 UTC
AI Toolsevaluationupdated 31 Oct 2026

AutoGPT review

Evaluate AutoGPT Platform for new automation work; keep AutoGPT Classic for study. AutoGPT Classic is unsupported, and its dependencies will not be updated. The current Platform combines specialists coordinated through conversation with a visual workflow builder. Our September 28, 2026, Classic run at c035ab1 recorded pytest exiting 1. It did not test the Platform.

+80stars / 7d
Verdict

Choose a Platform trial if conversational specialists or visual workflows fit the job, then test the deployment intended for use. The September 28, 2026, Classic run at c035ab1 does not validate that choice. Classic's maintainers recommend educational use, and its recorded test command failed; keep it for study rather than a new production dependency.

We ran it

Lab card: what happened when we ran AutoGPTScreenshot of AutoGPT (agpt.co)
Install✓ · 80s175 packages · 786 MB
Build✓ · 7s
Tests✗ · 56s277 passed · 65 failed · 4 skipped · 48 errors of 390 (pytest)
Known vulns108(pip-audit)
Repo7325 files~1,197,977 lines of source · 225.6 MB · 34 CI workflows

Answers from our run

Does AutoGPT build from source?

Dependencies installed in 80 seconds (175 packages), and the build succeeded in 7 seconds. We cloned commit c035ab1 into a clean Debian container with 3 CPUs and no project-specific setup.

Do AutoGPT's tests pass?

No. The project's own test command finished in 56 seconds and reported 277 passed, 65 failed, 4 skipped, 48 collection errors (pytest).

Does AutoGPT have known vulnerabilities in its dependencies?

pip-audit flagged 108 known advisories in the dependency tree at the time of our run.

Who should not use AutoGPT?

Teams seeking a maintained Classic deployment.

What are the alternatives to AutoGPT?

Dify, Langflow. Choose a Platform trial if conversational specialists or visual workflows fit the job, then test the deployment intended for use.

Setup2/5Assesses the recorded Classic environment: installation completed, but pytest exited 1. Current Platform setup was not tested.
Docs4/5Supplied documentation explains product status, licensing and setup. Current and commit-pinned instructions differ, requiring readers to match instructions to their checkout.
Community5/5Assesses public attention and participation routes only: the pinned README advertises 185,000+ GitHub stars and lists Discord, issue reporting and contribution routes. Adoption and support quality were not measured.
MaturityN/AThe run covered unsupported Classic and validated no Platform workload. No supplied primary release extract establishes the claimed Platform version or beta status, leaving insufficient evidence for a numerical maturity judgment.

Discussed on

  1. hnUser-Agent: AutoGPT3 points

Who it’s for

Teams evaluating conversational specialists and visual workflows for recurring internal work.
Organizations choosing between a paid hosted Platform and a deployment they operate with their own model credentials.
Researchers studying Classic with the maintainers' educational-use warning in mind.

Who it’s NOT for

Teams seeking a maintained Classic deployment.
Buyers who need a verified Platform workload before committing: the recorded run did not test one.
Vendors planning a competing hosted service without checking the Platform's Polyform Shield restrictions.

Setup reality

The September 28, 2026, sandbox run tested commit c035ab1 in classic/. Installation returned zero after 80 seconds, and the recorded build step returned zero after 7 seconds. The installed environment contained 175 packages and occupied 786 MB. The harness recorded pytest exiting 1 after 56 seconds.

The stored parser summaries report 277 passed, 65 failed, 4 skipped, 48 errors and a total field of 390. These fields do not establish exhaustive unique test coverage and should not be converted into a pass rate. The raw footer separately reports 14 xfailed and 42.38 seconds; its timing differs from the harness wall-clock duration. No new execution or complete-log reconciliation was performed.

Pip-audit recorded 108 advisories. Scan coverage is unknown because scannedPackages is absent; the recorded packages field of 5 does not establish how many packages were scanned. This was not a security review.

For Platform setup, the current repository README advertises a single-container Docker image and installers for Linux, macOS and Windows. The guide pinned to the tested commit says the appliance release was not live then and directs users to manual source setup. Those statements describe different repository states. Neither Platform installation path was tested.

Evaluate the Platform; keep Classic for study

AutoGPT Classic is unsupported, and its dependencies will not be updated. Its README at the tested commit recommends educational use and directs prospective users to the Platform. That maintenance warning is sufficient reason to avoid choosing Classic for a new deployment, regardless of whether installation completes.

The current AutoGPT README describes specialists whose instructions, context, skills and connected apps can be configured, with Otto coordinating work. AutoGPT's visual builder lets you connect blocks, branch logic and control workflow steps. These are documented capabilities, not outcomes demonstrated by the sandbox.

What the September 28 run establishes

Our September 28, 2026, Classic run at c035ab1 recorded pytest exiting 1. The matching sandbox record identifies the classic subdirectory, 3 CPUs, 8 GB of memory and a Python 3.12 container image; the install tail identifies Python 3.12.12.

Installation returned zero in 80 seconds. The build step returned zero in 7 seconds, but its retained tail is empty. Neither result demonstrates that an autonomous agent, CLI workload or Platform deployment completed useful work. The installed environment contained 175 packages and occupied 786 MB.

Pytest exited 1 after 56 seconds according to the harness. Its stored parser summaries report 277 passed, 65 failed, 4 skipped, 48 errors and a total field of 390. These are recorded parser summaries, not verified exhaustive counts of unique tests. Skipped tests are separate from failures.

The raw footer also lists 14 xfailed, 277 warnings and 42.38 seconds. These remain separate from the harness values; they are not combined into a new total or pass rate. No new execution or complete-log reconciliation was performed.

The retained log names local file-storage rename and copy tests, browser-component tests, and original AutoGPT configuration and permission-feedback tests. Their repeated failure message is "async def functions are not natively supported." The evidence does not establish why async support was unavailable or whether those tests would pass in another environment.

The publisher's testing methodology explains command recording and sandbox limits. It supplies provenance context, but does not establish that its current procedure was used unchanged for this older run.

Read the audit as an advisory record

Pip-audit recorded 108 advisories in the Classic environment. The record does not include scannedPackages, so scan coverage is unknown. Its packages field of 5 must not be treated as scan coverage.

The result supports investigating the installed dependencies, alongside Classic's explicit warning about known dependency vulnerabilities. It does not establish exploitability, identify a new security finding or assess the Platform's security. Classic's documented workspace permissions and interactive approvals do not resolve those dependency questions.

Match setup instructions to the checkout

The current README advertises the significantgravitas/autogpt single-container image, followed by account creation and administrator promotion. It also describes installers for Linux, macOS and Windows. Self-hosters provide model credentials and manage updates and operation; the hosted Platform supplies infrastructure and model access as a paid service.

By contrast, the guide pinned to c035ab1 says the appliance endpoint and image tags were not public. Its manual path requires Git, Node.js, NPM, Docker and Docker Compose. It documents make init-env for generating installation secrets, plus Postgres, Redis and RabbitMQ services.

The older release warning describes the pinned checkout, not the current installer's status. Neither Platform installation path was tested in the recorded run. For a Platform trial, follow the instructions matching the selected release, then verify a representative workflow, credential access, recovery and upgrades before relying on it.

Check licensing before embedding the Platform

The current repository's license table assigns Polyform Shield to autogpt_platform/ and MIT to classic/ and everything else. It describes Platform use as free for personal and internal business work, with a restriction against selling a competing hosted service. Check the license against the intended distribution and service model before building around it.

Alternatives for retrieval and application integration

Dify combines visual AI workflows with a RAG pipeline. Its README describes document ingestion and retrieval, making it a relevant alternative when retrieval is central to the application. This evidence does not establish that Dify is faster, safer or easier to operate than AutoGPT.

Langflow supports visual authoring and exposes workflows through API and MCP servers. Its README makes it relevant when a flow needs to become a tool inside another application. Evaluate it for that integration need; the supplied evidence does not establish equivalence with AutoGPT's specialist experience.

Neither alternative was tested in this AutoGPT run.

What the ratings assess

The ratings are editorial judgments within the scopes below. They are not a Platform benchmark or a security assessment. Setup uses installation and verification outcomes; documentation uses the supplied explanations of status, setup and licensing; community uses documented attention and participation routes. On the five-point scale, 1 indicates severe obstacles or little support within the assessed scope, 3 indicates mixed evidence, and 5 indicates strong support. Intermediate scores reflect the balance described in each note. An unassessed dimension receives no number.

Setup ease is 2/5 for the tested Classic environment: installation completed, but pytest exited 1. This does not rate current Platform setup.

Documentation is 4/5 because the supplied sources explain product status, setup and licensing. Readers still need to distinguish current instructions from those pinned to the tested commit.

Community is 5/5 for the narrow dimension of public attention and available participation routes. The README pinned to c035ab1 advertises 185,000+ GitHub stars and lists Discord, issue reporting and contribution routes. This rating does not measure adoption, response times or support quality.

Maturity is unassessed. The recorded run covered Classic, which is unsupported, and did not validate a Platform workload. The supplied primary-source extracts do not establish the claimed Platform release version or beta status, so those assertions cannot support a numerical maturity rating.

Alternatives

ProjectWhat it isPick it when
Dify gh↗A platform combining visual AI workflows, document retrieval and agent capabilities.Evaluate it when document ingestion and retrieval are central to the application. Its supplied README establishes that role, not a lower operating burden.
Langflow gh↗A visual agent and workflow builder with API and MCP servers.Evaluate it when a workflow needs to become a tool inside another application. The supplied evidence supports that integration use, but does not establish equivalence with AutoGPT's specialists.

What people are saying

  1. [github-trending] Significant-Gravitas/AutoGPT

Sources

  1. AutoGPT README
  2. AutoGPT Classic README at tested commit
  3. AutoGPT self-hosting guide
  4. AutoGPT Platform README
  5. AutoGPT Platform v0.8.1 release

More ai tools reviews

kornia · skills · anarlog · pr-agent · agent-sprite-forge · KiroCrew · the whole board →