mrkeyoor.com_
Fri 16 Oct 18:51 UTC
AI Toolsevaluationupdated 08 Oct 2026

codex-security review

Codex Security is a command-line scanner and TypeScript SDK that uses coding agents to find, validate, and help fix vulnerabilities in source repositories. It can turn a repository, path, Git diff, or imported alert backlog into findings with evidence, coverage records, patches, and machine-readable exports.

+56stars / 7d
Verdict

Our repository run added 0 packages and had no build or test target, so it proves almost nothing about the scanner's security judgment. Codex Security is worth a controlled trial when your AppSec team wants agent-led investigation tied to evidence, coverage, and reviewed patches. Keep Semgrep, CodeQL, or similar deterministic checks in place, and do not deploy the preview findings service or share scan logs without adding the missing controls around them.

We ran it

Lab card: what happened when we ran codex-securityScreenshot of codex-security (developers.openai.com/codex/security)
Install✓ · 1s0 packages · 23 MB
Buildn/ano build script
Testsn/ano test script
Known vulns00 critical · 0 high · 0 moderate · 0 low (npm audit)
Repo922 files~293,526 lines of source · 12.8 MB · 20 CI workflows · Dockerfile

Answers from our run

Does codex-security build from source?

Dependencies installed in 1 seconds (0 packages), and the project has no separate build step. We cloned commit 5ebe48d into a clean Debian container with 3 CPUs and no project-specific setup.

Does codex-security have tests you can run?

Not through a standard command: the project exposes no test script or target that our harness could run.

Does codex-security have known vulnerabilities in its dependencies?

npm audit found none in the dependency tree at the time of our run.

Who should not use codex-security?

Teams without approved scanner access: the npm package is public, but OpenAI inference scans require Codex Security access and some work may require Trusted Access for Cyber.

What are the alternatives to codex-security?

Semgrep, CodeQL, Trivy. Our repository run added 0 packages and had no build or test target, so it proves almost nothing about the scanner's security judgment.

Setup3/51-second repo install, but scans need access, auth, Python, and isolation
Docs5/5Clear CLI, SDK, CI, permissions, budgets, and artifact guidance
Community5/511,025 stars, 46 open issues, and same-day pull request activity
Maturity3/5v0.2.0 moves fast; artifact and integration contracts still have bugs

Discussed on

  1. hnCodex Security598 points
  2. hnCodex Security: now in research preview35 points
  3. hnWhy Codex Security Doesn't Include a SAST Report5 points
  4. hnOpenAI open-sources Codex Security CLI for repository scans and CI3 points

Who it’s for

Security teams that already have Codex Security access and want repository-specific investigation beside rule-based scanners.
Platform engineers building approved scans into CI, GitHub Actions, or an internal TypeScript service.
AppSec teams that need SARIF, JSON, or CSV output plus saved threat models and coverage records.
Organizations prepared to isolate scans, remove unrelated credentials, review model findings, and keep reports private.

Who it’s NOT for

Teams without approved scanner access: the npm package is public, but OpenAI inference scans require Codex Security access and some work may require Trusted Access for Cyber.
Environments that expect an approval prompt before local actions: official documentation says scans use the operating system's permissions and do not pause for approval.
Anyone planning to expose the preview findings service directly: the README says its API has no built-in authentication.
Organizations that cannot store source excerpts, vulnerability details, or possible credentials in private locations: scan results and saved logs can contain all three, and v0.2.0 removed diagnostic redaction.
Buyers requiring a settled public accuracy benchmark before adoption: open issue 763 asks for the first versioned scanner-quality corpus, while an initial corpus remains in an open pull request.

Setup reality

Our sandbox installed repository commit 5ebe48d in 1 second, added 0 packages, and used 23 MB. The root package has no build or test script, so both steps were skipped. Npm audit reported 0 known vulnerabilities across that empty root install.

Using the released CLI is a separate path. It requires Node.js 22.13.0 or later within 22.x, or Node 24 or 26, plus Python 3.10 or newer. Scans need Codex Security access and a ChatGPT login, API key, or supported provider credentials.

Local scans inherit operating-system permissions and do not pause for approval. Results and logs may hold source or credentials, so the docs recommend removing unrelated secrets and writing output to a private directory outside the repository.

Version 0.2.0 turns model review into durable scan artifacts

Codex Security v0.2.0 can scan a repository, selected paths, a committed diff, or working-tree changes. It records findings, coverage, and a manifest, then exports formats such as SARIF, JSON, and CSV. Deep mode adds parallel discovery workers. The result is more useful than a chat transcript because a team can see which surfaces were reviewed, which work was deferred, and what evidence supports each reported vulnerability.

The tool also validates findings, drafts patches, verifies fixes, creates security-policy drafts, and saves threat models. Existing GitHub code-scanning alerts can enter the same review flow. A TypeScript SDK exposes scans and callbacks for applications, while GitHub Actions, Docker Compose, and bulk CSV campaigns cover automation. The README supports OpenAI, Amazon Bedrock, OpenRouter, and Fireworks credentials, though feature and model availability still depend on the provider and the user's approved access.

Access matters more than the 1-second repository install

Our repository-level install finished in 1 second, added 0 packages, and used 23 MB. That result reflects the sparse root package, not installation of the published @openai/codex-security CLI from npm. A real scan needs Node.js 22.13.0 or later in the 22 line, or Node 24 or 26, plus Python 3.10 or newer. The public package alone does not grant permission to run OpenAI-backed scans.

Interactive users can sign in with ChatGPT, while CI can use an OpenAI or Codex API key. Device authentication covers some headless workspaces. Official OpenAI documentation says some full-repository scans may also require Trusted Access for Cyber. Alternative providers bring their own credentials and model selection. Cost belongs in the operating plan: the CLI reports usage estimates when available, and its maximum-cost setting can be exceeded slightly by requests already in progress.

What happened when we ran it

Our sandbox cloned commit 5ebe48d with 922 files, about 293,526 lines of source, and a 12.8 MB checkout. The repository-level npm install completed in 1 second with 0 packages installed and 23 MB on disk. Our test method used an unprivileged Node 22 container with 3 CPUs, 8 GB of RAM, and no secrets. Npm audit found 0 known vulnerabilities in that root install.

The root package defines neither a build script nor a test script, so both steps were skipped. Our scan found 20 CI workflow files, a Dockerfile, and a Compose file, but no conventional tests directory. Those signals show substantial automation elsewhere in the monorepo. They do not replace a runnable root verification target, and we made no paid or credentialed model call to judge finding accuracy, scan duration, token use, or patch quality.

Node 22.13.0 scans inherit local operating-system permissions

The documented minimum is Node 22.13.0 within the 22.x line, and local scans use the account's operating-system permissions without pausing for approval. OpenAI tells users to remove unrelated credentials before scanning. A dry run checks paths and output locations without starting Codex or loading credentials, which should be the first production check. Run the actual job in a disposable worktree or similarly constrained environment when the repository is sensitive.

Output needs equal care. Findings can contain source excerpts and vulnerability details, live dashboard events may expose code or credentials, and saved logs are not redacted. Release v0.2.0 explicitly notes that diagnostic text resembling credentials is no longer masked. Store results outside the checkout, apply a retention policy, and review every report before sharing it in a ticket, pull request, or chat channel.

The v0.2.0 preview findings service has no authentication

The local findings service in v0.2.0 can store scan results, display them in a dashboard, group possible duplicates, and accept published scans. Its API has no built-in authentication. Imports also send complete finding JSON to the configured embeddings endpoint and require an embedding API key. Treat it as a local or tightly protected preview component, not an Internet-facing AppSec portal.

Patches deserve the same restraint. The CLI can generate a change, verify it, and optionally open a pull request, but a model-produced fix is still a proposed diff. The official guidance keeps the final decision with an engineer. Teams should reproduce the bug where safe, inspect the changed trust boundary, require a regression test when feasible, and run their existing review and deployment gates before merging.

Forty-six open issues show young contracts under real use

GitHub search found 46 open issues on October 8, 2026, while the repository API listed 287 combined issues and pull requests. The repository was pushed that same day, two days after v0.2.0 shipped. Current reports include missing delegated-worker dispatch events, inconsistent durable coverage after resolved checkpoints, and equivalent findings receiving different identities between Standard and Deep scans. These are integration and evidence-contract bugs, not cosmetic requests.

Issue 763 asks for a public, versioned corpus that measures whether releases keep finding the same vulnerability classes with comparable evidence. An open October 8 pull request adds an initial synthetic corpus and scorer, so the gap is being worked. Until that lands and accumulates history, evaluate Codex Security on your own known test cases. Its best role today is an evidence-producing investigator beside established scanners, with humans retaining authority over severity, disclosure, and fixes.

Alternatives

ProjectWhat it isPick it when
SemgrepA multi-language static analyzer built around explicit rules and code-like patterns.pick this instead when deterministic, fast, policy-controlled checks matter more than agent-led investigation.
CodeQLGitHub's query libraries and analysis engine for code scanning and security research.pick this instead when your team can write data-flow queries and wants repeatable analysis tied closely to GitHub.
Trivy gh↗A scanner for packages, secrets, misconfiguration, containers, Kubernetes, repositories, and SBOMs.pick this instead when dependency and infrastructure coverage is the priority and model reasoning is unnecessary.

What people are saying

  1. [github-trending] openai/codex-security

Sources

  1. Codex Security README
  2. Official Codex Security CLI quickstart
  3. Codex Security v0.2.0 release
  4. Versioned scanner benchmark proposal
  5. Worker status callback bug

More ai tools reviews

universal-modder · DeepEP-Ascend · DeepGEMM-Ascend · hypoarena · jeeves · faster-whisper · the whole board →