mrkeyoor.com_
Tue 01 Sept 17:39 UTC
Automationevaluationupdated 27 Aug 2026

agentcore-cli review

AgentCore CLI creates, runs, packages, deploys, and operates AI agents on Amazon Bedrock AgentCore. It turns agent code and JSON resource specifications into AWS infrastructure, with commands for memory, gateways, credentials, evaluations, policies, knowledge bases, observability, and payments.

+6stars / 7d
Verdict

Our AgentCore CLI run passed 6,030 of 6,148 tests and found 0 known npm vulnerabilities, but 23 tests still failed after an 848 MB install. It is a credible control surface for a team already committed to Bedrock AgentCore and AWS operations. Everyone else is buying a large, provider-specific infrastructure workflow when a smaller framework or ordinary deployment stack may be easier to own.

We ran it

Lab card: what happened when we ran agentcore-cliScreenshot of agentcore-cli (docs.aws.amazon.com/bedrock-agentcore/latest/devguide/agentcore-get-started-cli.html)
Install✓ · 53s936 packages · 848 MB
Build✓ · 16s
Tests✗ · 221s6030 passed · 23 failed · 95 skipped of 6148 (vitest)
Known vulns00 critical · 0 high · 0 moderate · 0 low (npm audit)
Repo1679 files~264,488 lines of source · 11.2 MB · 21 CI workflows

Answers from our run

Does agentcore-cli build from source?

Dependencies installed in 53 seconds (936 packages), and the build succeeded in 16 seconds. We cloned commit 5c0c744 into a clean Debian container with 3 CPUs and no project-specific setup.

Do agentcore-cli's tests pass?

Not all of them: 6030 of 6148 passed and 23 failed when we ran the project's own test command (vitest). Some failures need services or credentials a bare container does not have.

Does agentcore-cli have known vulnerabilities in its dependencies?

npm audit found none in the dependency tree at the time of our run.

Who should not use agentcore-cli?

Teams seeking a cloud-neutral deployment tool: deploy targets Amazon Bedrock AgentCore and generates CDK infrastructure.

What are the alternatives to agentcore-cli?

Microsoft Agent Framework, LangGraph, Strands Harness SDK. Our AgentCore CLI run passed 6,030 of 6,148 tests and found 0 known npm vulnerabilities, but 23 tests still failed after an 848 MB install.

Setup3/553-second install, 848 MB, then AWS credentials and IAM
Docs5/5Commands, schemas, permissions, resources, and operations are indexed
Community3/5267 stars, active pushes, and 222 combined issues and PRs
Maturity3/5Broad v0.28.0 surface with 23 failing tests and preview features

Who it’s for

AWS teams that have chosen Bedrock AgentCore as the production runtime for agents.
Platform engineers who want agent infrastructure represented in project files and deployed through CDK.
Developers using Strands, LangGraph, Google ADK, or OpenAI Agents who need one AgentCore deployment path.
Operators who can own IAM, account and region targeting, CloudFormation state, model credentials, logs, traces, and AWS cost.

Who it’s NOT for

Teams seeking a cloud-neutral deployment tool: deploy targets Amazon Bedrock AgentCore and generates CDK infrastructure.
Developers without AWS credentials and permission-design experience: the README points to a dedicated IAM permissions document.
Projects that may reuse the same project and target names in one account and region: open issue 2104 reports both deployments resolving to one CloudFormation stack.
Users who still have the old Python starter toolkit installed: both tools claim the agentcore command and the README tells users to uninstall the old one.
Buyers treating every command as stable: failure-pattern insights are explicitly marked preview.

Setup reality

Our sandbox installed commit 5c0c744 in 53 seconds, adding 936 packages and using 848 MB. The build passed in 16 seconds. Tests failed after 221 seconds: 6,030 passed, 23 failed, and 95 skipped out of 6,148.

Local development needs Node.js 20 or later and uv for generated Python agents. Deployment needs AWS credentials, suitable IAM permissions, an account and region target, and whatever provider keys, Secrets Manager entries, gateways, knowledge bases, evaluators, or payment connectors the project declares.

The repository had 21 CI workflow files and no Dockerfile or top-level tests directory. The test tail gives a final count and shows 22 failed files, but it does not include the assertions for the 23 failures. A global npm install is simpler than building the 936-package source tree.

One CLI owns the AgentCore project lifecycle

AgentCore CLI scaffolds an agent, starts a local server, packages it, deploys AWS infrastructure, invokes the deployed runtime, and retrieves status, logs, or traces. Projects keep resource declarations in agentcore/agentcore.json, deployment targets in aws-targets.json, and generated application code under app/. That gives a platform team reviewable configuration instead of a collection of console clicks.

The scope is far wider than four lifecycle commands. The CLI can add memory, credentials, gateways, gateway targets, evaluators, online evaluations, knowledge bases, policy engines, datasets, config bundles, runtime endpoints, and payment components. A harness can bundle runtime, model, tools, skills, memory, and observability without handwritten agent code. Each resource still becomes something the team must permission, monitor, update, and pay for in AWS.

A 936-package install fronts managed AWS infrastructure

Our clean Node container installed commit 5c0c744 in 53 seconds. Npm added 936 packages and used 848 MB on disk. The repository itself contained 1,679 files, roughly 264,488 lines of source, and occupied 11.2 MB. The small checkout therefore understates the local dependency cost, though most users can install the published @aws/agentcore package globally instead of cloning it.

Node.js 20 or later is required, and generated Python agents use uv. Deployment adds AWS credentials, account and region selection, CDK, CloudFormation, and IAM permissions. Non-Bedrock models need their own provider keys. Gateway targets may point at Lambda, MCP, OpenAPI, Smithy, API Gateway, web search, or a knowledge base, each with a different authentication and network story.

What happened when we ran it

Our build completed successfully in 16 seconds after the 53-second install. The test command ran for 221 seconds and exited with code 1. Vitest reported 6,030 passed, 23 failed, and 95 skipped out of 6,148 tests. The summary also showed 406 passing and 22 failing test files out of 428.

The supplied tail lists successful tests around deployed-state carry-forward, payment cleanup, error classification, and subprocess exit codes before printing the failure totals. It does not include the failed assertions or names for all 23 failures. We cannot assign a cause from that output, so the practical finding is simply that commit 5c0c744 built but did not pass its full suite in the fresh container.

Npm audit reported 0 known vulnerabilities at critical, high, moderate, or low severity. The repository had 21 CI workflow files, while our scan found no Dockerfile and no top-level tests directory. Tests live beside source under __tests__, as the tail paths show. Those are healthy engineering signals, but they do not turn 23 failures into a passing result.

CloudFormation names can collide across separate projects

Open issue 2104 reports that two directories with the same project name and target, deployed to the same AWS account and region, resolve to the same AgentCore-<name>-<target> CloudFormation stack. In the reproduction, the second deployment updates the first project's stack rather than creating a separate one. The report points to stack identity being derived only from the two human-chosen names.

Until that issue is closed and the fix is verified, enforce unique project and target pairs across each account and region. A central registry or naming prefix is cheap protection. Also inspect existing stack tags before the first deployment from a newly cloned directory. Infrastructure tools need identity stronger than a successful exit because a successful update can still target the wrong resource set.

Evaluations and policies add services, not certainty

The CLI supports custom model-based judges, online evaluations, batch runs, recommendations, and A/B tests. These are useful operating tools, especially when tied to traces and versioned config bundles. They do not establish that a judge is correct or that a promoted prompt will behave safely outside the sampled traffic. Teams need reviewed datasets, stable metrics, cost limits, and a rollback path for every promotion.

Cedar policies can run before or after calls, with content filters, prompt-attack detection, and sensitive-information redaction. Failure-pattern insights are labeled preview. Payment connectors can sign a payment after an x402 response and retry the tool call, so tool allowlists and transaction limits deserve direct review. A convenience command can create financially or operationally meaningful resources.

Version 0.28.0 is moving quickly

GitHub showed 267 stars, 222 combined issues and pull requests, and a last push on August 27, 2026. Release v0.28.0 was published on August 24 with CDK dependency updates, a Windows tool-shim fix, evaluator work, and a quick-create payment connector. Push and issue activity are current; the combined queue is not a confirmed bug count.

The pre-1.0 version and broad command set call for pinning. Read the export notes generated for harness applications, run validate, inspect the CDK diff, and deploy first to a disposable AWS target with spending alerts. AgentCore CLI reduces the typing involved in an AWS agent platform. It does not reduce the ownership of IAM, state, names, credentials, evaluations, or bills.

Alternatives

ProjectWhat it isPick it when
Microsoft Agent Framework gh↗A provider-oriented agent SDK and runtime from Microsoft rather than an AWS deployment CLI.pick this instead when you need an agent programming framework and do not want deployment tied to Bedrock AgentCore.
LangGraph gh↗A graph runtime for stateful agent workflows that can be hosted in several ways.pick this instead when explicit workflow state and hosting choice matter more than managed AWS resources.
Strands Harness SDKA lower-level SDK for building agent harnesses without adopting this full CLI lifecycle.pick this instead when application-side harness code matters more than provisioning the full AgentCore resource set.

What people are saying

  1. [github-trending] aws/agentcore-cli

Sources

  1. AgentCore CLI README
  2. AgentCore CLI v0.28.0 release
  3. AgentCore IAM permissions
  4. CloudFormation project-name collision report

More automation reviews

rclone · lego · OpenCLI · web-access · Karabiner-Elements · WiiUDownloader · the whole board →