mrkeyoor.com_
Sun 08 Nov 11:34 UTC
LLM Toolsevaluationupdated 31 Oct 2026

PraisonAI review

Choose PraisonAI for a bounded trial if you want agent tools, memory and workflow orchestration together. Our Node installation establishes installation cost and recorded dependency advisories; it does not establish that an agent can complete your workflow. PraisonAI documents separate Python core, CLI and JavaScript packages.

+13stars / 7d
Verdict

Try PraisonAI on one bounded workflow if its combined capabilities fit your application. Our Node installation completed, while build and tests were skipped and no agent workload ran. Review the recorded audit advisories and verify the exact package, tool execution locations and denied-action behavior before production use. The closed safety issue supplies an upstream fix report, not independent validation from our sandbox.

We ran it

Lab card: what happened when we ran PraisonAIScreenshot of PraisonAI (praison.ai/docs)
Install✓ · 86s807 packages · 241 MB
Buildn/ano build script
Testsn/ano test script
Known vulns624 critical · 40 high · 17 moderate · 1 low (npm audit)
Repo6865 files~1,468,549 lines of source · 95.9 MB · 48 CI workflows · tests dir

Answers from our run

Does PraisonAI build from source?

Dependencies installed in 86 seconds (807 packages), and the project has no separate build step. We cloned commit 6dd94ca into a clean Debian container with 3 CPUs and no project-specific setup.

Does PraisonAI have tests you can run?

Not through a standard command: the project exposes no test script or target that our harness could run.

Does PraisonAI have known vulnerabilities in its dependencies?

npm audit flagged 62 known advisories in the dependency tree, including 4 critical at the time of our run.

Who should not use PraisonAI?

Buyers requiring demonstrated agent execution or application test results from this review.

What are the alternatives to PraisonAI?

LangGraph, CrewAI. Try PraisonAI on one bounded workflow if its combined capabilities fit your application.

Setup3/5Under the visible rubric, installation is a workable starting point: it completed in 86 seconds, but agent setup was not exercised and build and tests were skipped.
Docs4/5Under the visible rubric, the supplied README provides strong evidence through package distinctions, examples and troubleshooting; linked guides were not comprehensively checked.
Community4/5Under the visible rubric, the supplied issue contains substantial discussion and follow-up. This assessment does not measure adoption, typical response speed or support quality.
Maturity2/5Under the visible rubric, material evaluation concerns remain: 62 recorded audit advisories need review, and our run did not validate agent workloads or safety controls.

Who it’s for

Developers evaluating agent tools, memory and orchestration in one project.
Python teams prepared to evaluate the core SDK separately from our measured Node subproject.
Teams able to test tool permissions and failure handling before granting access to consequential actions.

Who it’s NOT for

Buyers requiring demonstrated agent execution or application test results from this review.
Teams requiring a dependency tree without recorded audit advisories before evaluation.
Developers assuming that a remote tool sandbox contains every custom tool.
Readers seeking measured Python installation costs, model quality or runtime throughput.

Setup reality

Our run on October 13, 2026 evaluated commit 6dd94ca in the Node subproject src/praisonai. Installation completed in our sandbox in 86 seconds with exit code 0 and no recorded timeout. The stored parser summary records 807 dependencies occupying 241 MB. The raw installer reports a different package-add count; we have not reconciled the counting scopes or replaced the stored summary.

Our sandbox recorded 62 npm audit advisories: 4 critical, 40 high, 17 moderate and 1 low. Scan coverage is unknown because the record contains no scannedPackages field. The advisories do not establish application exploitability.

The harness marked build and tests skipped because it found no scripts for those steps. It records installation success, duration, exit code and timeout status separately from skipped command outcomes. Our run did not test the Python SDK, execute an agent, contact a model provider, discover MCP tools or deploy a workload.

Should you evaluate PraisonAI?

Try PraisonAI on a bounded workflow if you need its combination of agent tools, memory and orchestration. Choose the language package first: our Node installation cannot establish the Python core's footprint or behavior.

Our run on October 13, 2026 evaluated commit 6dd94ca in the Node subproject src/praisonai. It supplies installation evidence, not a completed agent task. A useful next step is to test one read-only tool in your chosen package, then verify that a denied call never reaches its handler.

What our sandbox established

Installation completed in 86 seconds with exit code 0 and no recorded timeout. Our sandbox used Node 22 with 3 CPUs and 8 GB of memory. Build and tests were skipped because the selected subproject had no scripts for those steps. Skipped checks establish neither success nor failure.

The stored parser summary records 807 dependencies occupying 241 MB. The raw installer reports a different package-add count. These observations have different, unreconciled counting scopes; the stored summary remains unchanged. They do not establish exhaustive dependency enumeration or audit coverage.

Our sandbox recorded 62 npm audit advisories: 4 critical, 40 high, 17 moderate and 1 low. The record has no scannedPackages field, so scan coverage is unknown. Review the affected dependencies, reachability and available fixes before using this installation with production data. This run contains no upgrade validation or application security assessment.

The harness stores command outcomes separately: installation has a success flag, elapsed time, exit code and timeout flag; build and tests have skipped markers with reasons. A successful installation does not demonstrate CLI operation, agent execution or deployment. The MrKeyoor testing methodology explains the publisher's recording approach and its limits. Its current text provides provenance context, not proof that this older run used today's methodology version. No new execution was performed for this correction.

Which package should you start with?

The README identifies praisonaiagents as the Python core, praisonai as the Python CLI package, and an npm package for JavaScript. Its Python quickstart requires the core package and a model credential. Optional interfaces and integrations introduce further configuration.

Keep those entrypoints separate during evaluation. Our npm result does not measure the Python installation, and the presence of a Python example does not validate JavaScript behavior. Start with the package your application will actually use and record its dependency tree, tool results and failure paths.

Where do tools execute?

The README says custom tools remain local when shell, file and code tools move to a remote tool sandbox. That boundary matters if a custom handler can read credentials, change files or contact internal services. Inspect each handler's execution location before deciding which permissions the sandbox contains.

The README also distinguishes moving tools from moving the whole agent, including its model calls and execution loop. These are documented capabilities. Our sandbox did not exercise either arrangement, approval policies, budget stops or MCP discovery.

What changed in the safety report?

Issue 3866 is closed, and the August 30 follow-up reports fixes to the permission and hook paths. The original report described argument-blind permission checks, approval configuration gaps and hooks that could allow execution after failures. The follow-up says the first two findings were already resolved and describes fixes for remaining hook cases.

That is upstream evidence, not our reproduction of the fixes. The historical report should not be presented as a currently open defect. Before relying on these controls, test the selected version with denied arguments, unexpected hook exits and missing callbacks. Confirm that the tool handler never starts when authorization fails. External authorization and operating-system restrictions can complement the framework where actions have consequences beyond the agent process.

Which alternatives fit the decision?

LangGraph provides low-level infrastructure for long-running, stateful agents, including durable execution and human oversight. Shortlist it when persistence and inspection or modification of workflow state are central requirements.

CrewAI combines role-based agent Crews with event-driven Flows. Shortlist it when roles and tasks suit the collaboration and you want explicit workflow logic around that work.

These are alternatives for the orchestration layer. We did not run either framework here, so this comparison establishes no advantage in installation cost, security or task quality. Neither replaces application authorization or operating-system controls.

What do the ratings mean?

The five-point editorial rubric is: 1 for substantial evidenced obstacles, 2 for material unresolved concerns, 3 for a workable starting point requiring important follow-up, 4 for strong supplied evidence with stated limits, and 5 for broad corroborated evidence within the assessed dimension. Ratings are judgments about the supplied evidence, not benchmark results.

Setup ease is 3: installation completed, but usable agent setup was not exercised. Documentation is 4 for the README's package distinctions, examples and troubleshooting; we did not inspect every linked guide. Community is 4 for visible issue discussion and follow-up, without treating that discussion as a measurement of adoption or typical support. Maturity is 2 because the recorded advisories require review and our run did not validate workloads or safety controls.

Alternatives

ProjectWhat it isPick it when
LangGraph gh↗Low-level orchestration infrastructure for long-running, stateful agents.Shortlist it when durable execution and inspecting or modifying agent state are central requirements. We did not test it in this run.
CrewAI gh↗A Python framework combining role-based Crews with event-driven Flows.Shortlist it when roles and tasks suit agent collaboration and Flows suit the surrounding workflow logic. We did not test it in this run.

What people are saying

  1. [github-trending] MervinPraison/PraisonAI

Sources

  1. PraisonAI repository and README
  2. PraisonAI v4.7.1 release
  3. PraisonAI safety-gate issue 3866
  4. PraisonAI Windows MCP issue 4375
  5. PraisonAI documentation

More llm tools reviews

gemini-api-cli · MCPJungle · octomind · kimi-k3-in-c · nanochat · FreeToken · the whole board →