mrkeyoor.com_
Wed 16 Sept 07:02 UTC
LLM Toolsevaluationupdated 27 Aug 2026

ComfyUI review

ComfyUI is a local visual workspace for building image, video, audio, 3D, and text generation pipelines as node graphs. It solves the problem of reproducing a complicated generative workflow without hiding models, parameters, or processing steps behind a single prompt box.

+1,130stars / 7d
Verdict

Our ComfyUI checkout installed 124 packages and used 5,903 MB, then 44 tests failed and 65 hit collection or setup errors, so adopting it means accepting a large environment whose tested commit was not clean on our box. Use it when graph-level control, repeatable visual pipelines, and broad model support justify the learning and maintenance. Choose a simpler interface if one person mainly wants to generate images, or a managed service if your team cannot secure Python extensions and remote access.

We ran it

Lab card: what happened when we ran ComfyUIScreenshot of ComfyUI (www.comfy.org)
Install✓ · 131s124 packages · 5903 MB
Build✓ · 21s
Tests✗ · 441s1397 passed · 44 failed · 10 skipped · 65 errors of 1506 (pytest)
Known vulns0(pip-audit)
Repo1062 files~285,875 lines of source · 45.1 MB · 28 CI workflows · tests dir

Answers from our run

Does ComfyUI build from source?

Dependencies installed in 131 seconds (124 packages), and the build succeeded in 21 seconds. We cloned commit 82f839f into a clean Debian container with 3 CPUs and no project-specific setup.

Do ComfyUI's tests pass?

Not all of them: 1397 of 1506 passed and 44 failed when we ran the project's own test command (pytest), with 65 collection errors. Some failures need services or credentials a bare container does not have.

Does ComfyUI have known vulnerabilities in its dependencies?

pip-audit found none in the dependency tree at the time of our run.

Who should not use ComfyUI?

Anyone who wants a simple prompt box with no graph to learn: ComfyUI exposes the pipeline as connected nodes and expects the user to manage models and inputs.

What are the alternatives to ComfyUI?

InvokeAI, AUTOMATIC1111 Stable Diffusion WebUI, Fooocus. Our ComfyUI checkout installed 124 packages and used 5,903 MB, then 44 tests failed and 65 hit collection or setup errors, so adopting it means accepting a large environment whose tested commit was not clean on our box.

Setup2/55,903 MB install and the full test run did not pass
Docs4/5Hardware paths, model folders, API, and release policy are documented
Community5/5130,176 stars with pushes and issue activity on August 27, 2026
Maturity4/5Frequent releases and broad support, with backend-specific defects

Discussed on

  1. hnComfyUI – A powerful and modular Stable Diffusion GUI4 points
  2. hnComfyUI: Modular Diffusion Model GUI, API and Back End3 points
  3. hnComfyUI: Powerful and modular Stable Diffusion GUI with a graph/nodes interface3 points
  4. hnStable Diffusion GUI with a graph/nodes interface3 points

Who it’s for

Visual AI developers who need reusable workflows with explicit model and parameter control.
Studios that want to expose a carefully built graph through App Mode or a local API.
Tinkerers with compatible GPU hardware who are willing to manage model files and Python dependencies.
Teams that need an offline core and can vet every custom node before installing it.

Who it’s NOT for

Anyone who wants a simple prompt box with no graph to learn: ComfyUI exposes the pipeline as connected nodes and expects the user to manage models and inputs.
Teams that plan to expose the default server directly to the internet: the security policy assumes localhost and says operators must add their own firewall, proxy, and authentication for remote access.
Users who install community nodes as if they were harmless presets: the security policy says custom nodes are arbitrary Python code.
Studios that require the same workflow to behave identically across every GPU backend: current issue 15914 reports a repeatable warm-run failure on one ROCm setup that did not reproduce on CUDA.
Developers who track the master branch while depending on a fixed custom-node stack: the README warns that commits outside stable tags may break many custom nodes.

Setup reality

Our sandbox install succeeded in 131 seconds, adding 124 packages and using 5,903 MB. The build passed in 21 seconds. Tests then failed after 441 seconds: 1,397 passed, 44 failed, 10 were skipped, and 65 ended in collection or setup errors out of 1,506. Pip-audit found 0 known vulnerabilities.

A useful run still needs model weights placed in the expected folders. Manual setup also requires a PyTorch build matched to NVIDIA CUDA, AMD ROCm, Intel XPU, Apple Silicon, or CPU use. Paid partner nodes can add service credentials, while the local core can stay offline with API nodes disabled.

The desktop app is the easiest documented route for Windows and macOS. Linux and specialized hardware use manual package choices, and the README warns that Python 3.14 can trip custom-node compatibility. Remote access is an operator task because the default security model trusts anyone who can reach the URL.

A node graph makes the generation recipe visible

ComfyUI turns a generative pipeline into boxes and wires. A graph can load a checkpoint, encode a prompt, apply ControlNet or LoRA inputs, sample, upscale, and save the result while preserving every setting. Workflows can be stored as JSON or recovered from supported generated media. That helps when an image must be reproduced or handed to another operator, because the recipe is inspectable instead of living in screenshots and remembered settings.

The scope now stretches beyond Stable Diffusion. The README lists image editing, video, audio, 3D, vision, and text model families, while App Mode can hide a finished graph behind a smaller interface. A local API queues those workflows. This breadth is the main reason to choose ComfyUI, but model files, node versions, memory use, and backend compatibility become part of the system you maintain.

The 5,903 MB environment is only the starting cost

Our fresh Debian checkout contained 1,062 files, about 285,875 lines of source, and 45.1 MB before installation. Installing commit 82f839f took 131 seconds, pulled 124 packages, and left 5,903 MB on disk. The repository had 28 CI workflow files and a tests directory, though it had no Dockerfile. Pip-audit found 0 known vulnerabilities in the installed Python packages.

Model weights are separate from that 5,903 MB result. Users place checkpoints, VAEs, text encoders, LoRAs, and other files into named model directories, or point ComfyUI at shared locations through extra_model_paths.yaml. The core stays offline unless requested, and --disable-api-nodes turns off optional paid API nodes. Partner nodes call outside services, changing the privacy and credential picture.

What happened when we ran it

Our sandbox install succeeded in 131 seconds and the build completed in 21 seconds. The test command ran for 441 seconds before exiting with failure. Pytest reported 1,397 passed, 44 failed, 10 skipped, plus 65 collection or setup errors out of 1,506. A passing build did not mean the checked-out commit was clean in the same environment.

The log tail named security tests for preview path traversal, null bytes in filenames, user-data content types, and inline SVG response caching. Those lines were errors, not assertion messages that establish a product vulnerability. The log does not show their cause, so we cannot say whether code, fixtures, services, or the fresh container caused them. The 3-CPU, 8 GB Python 3.12 run did not complete its full suite successfully.

Hardware support comes with backend-specific choices

Manual installation branches by accelerator. The README gives separate PyTorch routes for NVIDIA CUDA, AMD ROCm, Intel XPU, Apple Silicon, Huawei Ascend, and CPU use. The Windows portable builds split NVIDIA, AMD, and Intel hardware, and the current general NVIDIA package uses Python 3.13 with CUDA 13.0. This coverage makes a generic installation guide impossible for a mixed fleet.

An open August 27 issue describes Z-Image Turbo producing non-finite output on the first warm rerun on an AMD RX 9070 XT with ROCm 7.14. The reporter reproduced it twice across independent clones and did not reproduce the same graph on CUDA. Another report shows MiniMax H3 video encoding exhausting a 16 GB GPU while trying to allocate 7.17 GiB. These specific reports show why teams should qualify exact models on exact drivers.

Custom nodes carry the same trust as Python packages

ComfyUI binds to 127.0.0.1 by default. Its security policy assumes that anyone who can reach the URL is trusted, and it assigns firewall, reverse-proxy, and authentication duties to users who enable network exposure. A studio server needs an access layer, especially when workflows or model directories contain private material.

The same policy says custom nodes are arbitrary Python code. Installing one gives it the trust of other software on the machine, so a popular workflow can carry a dependency that the core maintainers do not audit. Pin node revisions, record their sources, and test upgrades away from production. The README warns that master commits outside stable tags may break many custom nodes, a direct reason to follow releases instead of updating every checkout automatically.

App Mode helps operators, while graph authors still need the graph

The canvas has shortcuts for queuing, bypassing, muting, grouping, and reconnecting nodes. Partial graph re-execution avoids repeating unchanged work, and memory management can offload models between RAM and VRAM. Those controls suit a technical artist debugging a pipeline. They are a poor first interface for a colleague who only needs to change a prompt, upload an image, and collect an output.

App Mode exposes selected inputs and outputs after a workflow is stable. The API plays a similar role for software integration. Neither removes the authoring cost. Someone still owns model placement, version compatibility, error handling, and the graph. If nobody wants that job, a narrower UI is likely to produce fewer support requests.

August 2026 activity is high, and the queue is large

GitHub showed 130,176 stars, 4,721 open issues and pull requests, and a last push on August 27, 2026. The combined count includes pull requests, so it is not a defect total. Release v0.34.0 arrived on August 26 with model additions, frontend and template updates, HDR video saving work, and fixes. Activity at this scale also means frequent compatibility movement.

ComfyUI earns its place when a node graph is the asset your team wants to preserve. Our 1,397 passing tests show a substantial exercised codebase, while the 44 failures and 65 setup or collection errors block an unqualified reliability claim for commit 82f839f. Adopt a stable tag, qualify the hardware and models, treat every custom node as code, and authenticate any remote instance.

Alternatives

ProjectWhat it isPick it when
InvokeAI gh↗A local creative interface centered on image generation, editing, and a canvas workflow.pick this instead when artists need a more guided image workspace and less graph plumbing.
AUTOMATIC1111 Stable Diffusion WebUI gh↗A widely used browser interface for Stable Diffusion with a large extension ecosystem.pick this instead when familiar form controls and extensions matter more than explicit node graphs.
FooocusA simpler local image generator designed to reduce manual model and sampler decisions.pick this instead when fast image prompting matters more than constructing reusable pipelines.

What people are saying

  1. [github-trending] WhatDreamsCost/WhatDreamsCost-ComfyUI
  2. [velocity-scout] LeonQ8/ComfyUI-ALLinONE-MinimaxH3
  3. [hf-trending] drbaph/MiniMax-H3-Turbo-Lora-ComfyUI (trending model on Hugging Face)
  4. [github-trending] Comfy-Org/ComfyUI
  5. [hf-trending] ethanfel/Qwen3-VL-32B-Ultra-Heretic-H3-ComfyUI-INT8-ConvRot (trending model on Hugging Face)
  6. [hf-trending] ethanfel/Qwen3-VL-32B-Ultra-Heretic-MiniMax-H3-ComfyUI-INT8-ConvRot (trending model on Hugging Face)

Sources

  1. ComfyUI README
  2. ComfyUI security policy
  3. ComfyUI v0.34.0 release
  4. ROCm warm-rerun issue 15914
  5. MiniMax H3 memory issue 15312

More llm tools reviews

headcount · useagent · claude-skills · RAG_Techniques · ux-ui-agent-skills · dictionary-of-ai-coding · the whole board →