mrkeyoor.com_
Sat 31 Oct 13:10 UTC
LLM Toolsevaluationupdated 17 Oct 2026

ComfyUI review

ComfyUI is a visual node editor and execution engine for reusable AI media workflows. Its README documents image, video, audio, 3D and text workflows, JSON workflow files, and a local API. It suits people who want to inspect and change the processing steps as well as the prompt.

+1,270stars / 7d
Verdict

ComfyUI is worth evaluating when saved, editable graphs are part of the work you need to deliver. Its documented workflow reuse and local API give that choice a concrete purpose. Our October 14, 2026 run at e0a32bc provides limited setup evidence: package-build attempts failed inside an install step marked successful, a separate build step returned exit 0, and tests timed out after 900 seconds. Start with the documented installation route for your hardware, choose a stable release, and verify one representative workflow with its required models and extensions before depending on it.

We ran it

Lab card: what happened when we ran ComfyUIScreenshot of ComfyUI (www.comfy.org)
Install✓ · 115s126 packages · 6713 MB
Build✓ · 14s
Tests✗ timed out · 900sran, no count parsed
Known vulns0(pip-audit)
Repo1297 files~335,653 lines of source · 49 MB · 29 CI workflows · tests dir

Answers from our run

Does ComfyUI build from source?

Dependencies installed in 115 seconds (126 packages), and the build succeeded in 14 seconds. We cloned commit e0a32bc into a clean Debian container with 3 CPUs and no project-specific setup.

Do ComfyUI's tests pass?

We could not finish them: the suite was still running after 15 minutes in our container.

Does ComfyUI have known vulnerabilities in its dependencies?

pip-audit found none in the dependency tree at the time of our run.

Who should not use ComfyUI?

People who want to avoid managing model components and dependencies. The README recommends its desktop app for new Windows and macOS users, but manual setups require model placement and hardware-specific instructions.

What are the alternatives to ComfyUI?

InvokeAI, Stable Diffusion WebUI, Diffusers. ComfyUI is worth evaluating when saved, editable graphs are part of the work you need to deliver.

Setup3/5The README provides desktop and hardware-specific routes, but manual setup requires model placement. Our 115-second install step contains package-build errors and does not verify application installation.
Docs4/5The supplied README explains model folders, hardware setup, offline flags and stable-tag compatibility warnings. We did not execute each documented route.
Community4/5The October 17, 2026 snapshot shows recent repository activity, and issue 15314 contains detailed follow-up reports and corrections. This does not establish support response times.
Maturity3/5The documentation and v0.40.0 release show developed workflow and API capabilities, alongside explicit custom-node stability warnings. Our run leaves installation, application operation and the complete test suite unverified.

Discussed on

  1. hnComfyUI – A powerful and modular Stable Diffusion GUI4 points
  2. hnComfyUI: Modular Diffusion Model GUI, API and Back End3 points
  3. hnComfyUI: Powerful and modular Stable Diffusion GUI with a graph/nodes interface3 points
  4. hnStable Diffusion GUI with a graph/nodes interface3 points

Who it’s for

Artists who want to save a workflow with its model choices and seeds, then adjust individual steps.
Developers who want to integrate saved graphs through a local API.
Technical creators willing to manage model files, hardware-specific PyTorch packages and custom-node compatibility.

Who it’s NOT for

People who want to avoid managing model components and dependencies. The README recommends its desktop app for new Windows and macOS users, but manual setups require model placement and hardware-specific instructions.
Teams that expect development commits to preserve custom-node compatibility. The README explicitly warns otherwise.
Buyers who need verified GPU performance, output quality or a passing complete test suite from this review. Our recorded run establishes none of those.

Setup reality

In our recorded run on October 14, 2026, at commit e0a32bc, the harness marked its install step successful after 115 seconds and recorded 126 dependency packages occupying 6,713 MB. However, the raw install tail shows failed editable and wheel build attempts for ComfyUI because setuptools discovered multiple top-level packages. The successful step status therefore does not establish that ComfyUI itself was installed or launched.

The separate build step returned exit 0 after about 14 seconds, with an empty output tail. Its command is not supplied, so this is a harness build-step result, not confirmation of a distributable package or working application. The test command timed out after 900 seconds with exit 124. No passing-test count is available.

The pip-audit summary records zero findings and zero packages. It does not establish meaningful dependency audit coverage or a clean security result.

The README documents checkpoints in models/checkpoints, VAEs in models/vae, additional model locations through extra_model_paths.yaml, and separate hardware setup paths. It also documents offline local operation and optional paid API nodes. We did not verify application startup, an installed CLI, API requests, media generation or GPU performance.

When the graph is worth maintaining

ComfyUI makes sense when you want to keep and revise the steps behind an AI-generated result. The ComfyUI README documents a visual node graph for image, video, audio, 3D and text workflows, along with JSON workflow files and a local API. Those are documented capabilities; our recorded container run did not exercise them.

For an artist, the useful artifact can include the model choices, processing steps and seeds alongside the output. The README says loading a generated PNG can recover its workflow and seeds, and describes workflow recovery from supported generated media. For a developer, a saved graph can become an input to an application through the local API.

That control also creates work. You need the models and any custom nodes the graph expects. If you mainly want a generation form, maintaining a graph may add decisions you do not need.

What our recorded run establishes

Our run took place on October 14, 2026, at commit e0a32bc (full SHA e0a32bce84f4603f2b61b16b50f8958e68fd6171). The sandbox record specifies 3 CPUs, 8 GB of RAM and the ghcr.io/astral-sh/uv:python3.12-bookworm image. The raw install tail identifies Python 3.12.12. No new execution was performed for this correction.

The checkout scan recorded 1,297 files, approximately 335,653 lines and 49 MB of source. It detected 29 CI workflow files and a tests directory, with no Dockerfile or Compose file. These describe the scanned checkout, not successful execution of its workflows.

Recorded step Observation What it establishes
Install Marked successful, exit 0, 115 seconds; 126 dependency packages and 6,713 MB recorded The harness completed this step, but its raw tail contains failed editable and wheel build attempts for ComfyUI. Installation of the application remains unverified.
Build Exit 0 after about 14 seconds; empty output tail The separate harness build step completed. The supplied record does not identify its command or artifact.
Tests Exit 124 after 900 seconds; timed out The test command did not complete within the limit. There is no supported passing-test total.
Audit pip-audit, zero findings, zero packages The summary does not establish dependency audit coverage.

The install errors report that setuptools found multiple top-level packages in a flat layout and would not proceed. That conflicts with treating the overall install-step flag as proof of a successful ComfyUI installation. The recorded dependency footprint also does not establish a model download or provide a storage budget for a model collection.

The test tail contains SQLite asset-schema upgrades and downgrades. It does not identify the cause of the timeout. A timeout leaves the suite unverified; it does not establish that media generation is broken. The record contains no application startup check, installed-binary check, API exercise, image-quality assessment or GPU workload measurement.

Choose setup instructions for your hardware

The README recommends the desktop app for new Windows and macOS users. Its manual instructions cover NVIDIA, AMD, Intel and Apple Silicon, among other hardware paths. Our Python container check does not validate those individual routes.

For manual setup, the README places checkpoints in models/checkpoints and VAEs in models/vae. Larger models can require several components in different folders. extra_model_paths.yaml lets you configure additional model locations, which can help reuse an existing collection.

Start with one workflow whose model files and hardware requirements you understand. Confirm that it loads, executes and produces the result you need. Save the workflow together with the model references and extension versions needed to repeat that check.

Reuse is documented; speed remains unmeasured here

The README describes partial graph re-execution: changing the end of a workflow reruns the changed portion and the steps that depend on it. That is a useful reason to evaluate ComfyUI when you repeatedly adjust output processing while retaining earlier generation steps.

We did not measure that behavior or its performance. The roughly 14-second build-step result is not an inference benchmark, and the README's speed claims are not findings from our run.

The release documentation also warns that commits outside stable release tags may be unstable and break custom nodes. Core, desktop and frontend have interconnected release processes. The supplied release page lists v0.40.0 on October 13; its release commit is 3541246, distinct from our measured checkout. Do not treat our run as validation of that release.

The AMD report includes later working configurations

Issue 15314 began with an August 5, 2026 report of MiniMax H3 noise output on an RX 7900 XTX using the official template. Reading only the opening report gives an incomplete account.

Later comments describe working configurations and revise earlier explanations. An August 9 commenter reported ten clean runs with ComfyUI 0.31.0 and torch 2.14.0.dev20260807+rocm7.14, withdrawing an earlier attribution to ComfyUI's partial eviction itself. An August 21 comment reported clean RX 7900 XTX output using a ROCm 10.1 nightly setup.

On October 15, another commenter reported successful official int8 image-to-video output on an RX 7900 XT with ComfyUI 0.40.0 and torch 2.14.1+rocm7.2. That is a different card and software configuration from the opening report. These are users' reports, not our measurements or a universal fix. They support checking the exact model, hardware, packages and launch settings rather than treating the open issue as evidence that AMD support generally fails.

Check whether imported nodes use local models or services

The README says core can run fully offline. It documents --offline to disable optional paid Comfy API nodes and force built-in functionality to stay offline, and --disable-partner-nodes to disable the API nodes alone. This is the project's documented behavior, which our run did not test.

Inspect an imported workflow before executing it. Local model nodes and nodes that call paid services can appear in the same editor, with different network and billing requirements.

The supplied GitHub snapshot records a push on October 17, 2026, 138,000 stars and 5,220 open issues and pull requests combined. Those figures describe activity and attention, not reliability, support response times or output quality.

Choose ComfyUI when maintaining the workflow itself helps you do repeatable work. The next useful check is a representative graph on your intended machine, with pinned models and extensions and an output you can inspect.

Alternatives

ProjectWhat it isPick it when
InvokeAI gh↗A visual media application with a Unified Canvas and node workflow tools.Choose it when canvas editing, brush tools and inpainting or outpainting are central to your image work. Its README also documents reusable node workflows.
Stable Diffusion WebUI gh↗A Gradio web interface for Stable Diffusion generation and editing.Choose it when txt2img, img2img and settings controls fit your workflow better than arranging nodes. Its README documents those modes, inpainting and generation-parameter recovery.
Diffusers gh↗A Python library with diffusion pipelines, models and interchangeable schedulers.Choose it when you want to express the pipeline in Python and integrate its components directly into application code.

Sources

  1. ComfyUI README and hardware setup
  2. ComfyUI repository facts
  3. ComfyUI v0.40.0 release
  4. MiniMax H3 noise output report on AMD
  5. InvokeAI
  6. Stable Diffusion WebUI
  7. Diffusers

More llm tools reviews

ironclaw · infinity · Claude-Code-Game-Studios · OmniRoute · harnessrouter · pi-subagents · the whole board →