mrkeyoor.com_
Tue 01 Sept 17:41 UTC
Dev Toolsevaluationupdated 27 Aug 2026

plugins review

OpenAI Plugins is a curated source collection for extending Codex with skills, app connections, MCP configuration, commands, agents, hooks, and supporting assets. It is mainly a reference and distribution repository for plugin authors and Codex users, not one application that you install and run as a service.

+64 / 4dstars / 7d
Verdict

Our plugin-eval install added 0 packages in 4 seconds, but its test command failed after 8 seconds on a literal glob path, so this repository is better used as pinned source material than as a trusted monolithic package. Codex plugin authors should study it because 53 manifests show the format in real bundles, and users can take only the plugins they need. Check each plugin's license, permissions, authentication, and executable surfaces separately before adding it to a company marketplace.

We ran it

Lab card: what happened when we ran pluginsScreenshot of plugins (github.com/openai/plugins)
Install✓ · 4s0 packages · 1 MB
Buildn/ano build script
Tests✗ · 8sran, no count parsed
Known vulns00 critical · 0 high · 0 moderate · 0 low (npm audit)
Repo4421 files~254,897 lines of source · 37.4 MB · 0 CI workflows · tests dir

Answers from our run

Does plugins build from source?

Dependencies installed in 4 seconds (0 packages), and the project has no separate build step. We cloned commit 33bd952 into a clean Debian container with 3 CPUs and no project-specific setup.

Do plugins's tests pass?

The test command failed in our container, and its output did not report a pass or fail count.

Does plugins have known vulnerabilities in its dependencies?

npm audit found none in the dependency tree at the time of our run.

Who should not use plugins?

Developers looking for a single npm library or server: the README describes a collection of independent plugin folders, and the tested Node project lives specifically in plugins/plugin-eval.

What are the alternatives to plugins?

Anthropic Skills, Microsoft Skills, OpenAI Cookbook. Our plugin-eval install added 0 packages in 4 seconds, but its test command failed after 8 seconds on a literal glob path, so this repository is better used as pinned source material than as a trusted monolithic package.

Setup3/5Zero-package install was quick, but the supplied test command failed
Docs3/5Root overview is brief; plugin-level guidance carries the detail
Community4/55,242 stars with pushes in August and PR activity in July 2026
Maturity3/5Many real bundles, but no repository release or single license

Discussed on

  1. hnChatGPT Plugins1,875 points
  2. hnOpenAI's ChatGPT plugins may revolutionise the traditional customer journey39 points
  3. hnChatGPT Plugins, up and running in <5 minutes32 points
  4. hnCodex Plugins27 points
  5. hnOpenAI and four rivals just agreed on one standard for AI agents24 points

Who it’s for

Codex users who want official examples of plugin manifests, skills, apps, MCP connections, agents, commands, and hooks.
Plugin authors who need real directory layouts and marketplace entries to compare with their own bundle.
Teams curating an internal Codex marketplace with installation and authentication policies.
Engineers evaluating local skills through the included plugin-eval command and Codex plugin.

Who it’s NOT for

Developers looking for a single npm library or server: the README describes a collection of independent plugin folders, and the tested Node project lives specifically in plugins/plugin-eval.
Users outside Codex who expect the bundles to work unchanged: discovery depends on a Codex marketplace and .codex-plugin/plugin.json manifests.
Organizations that require one clear repository-wide reuse license: GitHub reports no license for the repository, while only some plugin directories contain their own license files.
Release-driven consumers who need tagged, versioned drops: GitHub returned no latest release, so pinning a commit is safer than waiting for a release channel.
Anyone ready to run generated benchmark prompts without inspection: the plugin-eval guide says its benchmark starts real codex exec sessions and tells users to review the configuration first.

Setup reality

Our sandbox installed the plugins/plugin-eval project in 4 seconds, adding 0 packages and using 1 MB. It has no build script, so build was skipped. Tests failed with exit code 1 after 8 seconds because Node looked for the literal path tests/**/*.test.js and could not find it. Npm audit reported 0 known vulnerabilities.

The local evaluator requires Node.js 20 or newer and is marked private, so its documented path is a checkout plus node or npm link. Installing a plugin also needs Codex marketplace discovery. Individual app or MCP bundles can require their own accounts, authentication, service access, and product eligibility.

Static analysis stays local, but live benchmarking starts real Codex CLI sessions in temporary workspaces and writes artifacts under .plugin-eval/. Marketplace paths resolve relative to the user or workspace marketplace file, and Codex may need a restart before a newly linked plugin appears.

This is a Codex plugin catalog, not one executable

OpenAI Plugins is a source collection for extending Codex. Each plugin sits under plugins/<name>/ and must contain .codex-plugin/plugin.json. A bundle may also carry skills, app or MCP configuration, agents, commands, hooks, and assets. The default marketplace file points Codex at those local directories and records policies such as whether authentication happens during installation or first use.

commit 33bd952 contained 53 plugin manifests and 482 SKILL.md files. The breadth is useful for reading actual structure: Figma covers design workflows, Notion covers research and knowledge capture, and separate bundles address iOS, macOS, web apps, Expo, Netlify, Remotion, and Google Slides. It also means the repository has no single runtime story. Every folder can expose a different mix of instructions, remote connections, and executable behavior.

The 4-second install covers only plugin-eval

Our lab did not install all 4,421 repository files as one product. The Node project detected by the harness lives in plugins/plugin-eval, a private package that evaluates local skills and plugins. Its install completed in 4 seconds, added 0 packages, and occupied 1 MB. There is no build script or target, so the build step was skipped rather than passed.

That narrow scope matters when reading the lab card. A successful zero-dependency npm install says the evaluator has no declared package tree at commit 33bd952. It says nothing about signing into Figma, connecting an MCP server, running a deployment workflow, or granting a remote app access. The repository used 37.4 MB before installation and contained about 254,897 lines of source, much of it instructions and plugin assets rather than one JavaScript program.

What happened when we ran it

Our sandbox ran npm install successfully in 4 seconds with Node 22, then found no build target. The test step failed with exit code 1 after 8 seconds. The package script invoked node --test tests/**/*.test.js, and Node reported that it could not find /work/repo/plugins/plugin-eval/tests/**/*.test.js.

A test file does exist in that directory, and the repository scan marked a tests directory as present. The observed failure is the literal glob path, not a failed assertion inside the suite. We did not substitute another test command because the lab records the project's supplied target. Npm audit found 0 known vulnerabilities across the installed package set, which in this run contained 0 added packages.

The repository scan found 0 CI workflow files and no Dockerfile. Those absences fit a catalog better than a deployed server, but they reduce visible repository-level verification. The 8-second failure also leaves the checked-in evaluator's assertions unproven by our standard command. A team adopting plugin-eval should first make its test invocation work in the same shell and Node environment used by its own CI.

Marketplace policy does not replace a permission review

The marketplace describes plugins as available and can specify authentication at install or use. Some entries are restricted to Codex. That metadata answers discovery questions, but it does not tell a security reviewer what every skill may instruct the agent to do, which MCP tools are reachable, or what an app connection can read and change. Those answers live inside each selected bundle and its external service.

The repository tree includes 27 .app.json files and 26 .mcp.json files at the measured commit. Plugins can also supply hooks, commands, or agent definitions. Treat installation as adding several control surfaces, even when the files are mostly text. Review the manifest, skills, connection configuration, authentication timing, and any command or hook before making a plugin available across every workspace.

Licensing needs the same per-folder attention. GitHub's repository metadata returned no top-level license, while our tree check found license files in only some plugin directories. That does not make every unlicensed folder forbidden, nor does a licensed subfolder cover its neighbors. It means a company intending to copy, modify, or redistribute a bundle should identify the license that applies to that exact directory instead of inferring one from the OpenAI owner name.

Plugin-eval separates static checks from live Codex runs

The included plugin-eval package is the closest thing here to a standalone tool. It requires Node.js 20 or newer and can run directly from its folder or through npm link. Static commands analyze a plugin, explain token budgets, or propose a measurement plan. The benchmark command is different: it launches real codex exec sessions in isolated temporary workspaces and stores run artifacts under .plugin-eval/.

Its guide tells users to inspect generated benchmark configuration, especially when prompts or the target project came from elsewhere. That warning is the right operational boundary. Static scoring can be part of routine review, while live benchmarks consume model usage and execute an agent workflow. Keep artifacts and local node_modules out of commits unless they are intentional records, and use a disposable target for unfamiliar benchmark scenarios.

August pushes show activity without a release channel

GitHub recorded the last push on August 26, 2026, and 40 combined issues and pull requests. The latest open activity fetched for this review was concentrated in pull requests updated during June and July, including plugin syncs, skill changes, connector work, and scheduled-task templates. GitHub returned no latest release, so there is no repository-wide version tag to use as a compatibility promise.

For plugin authors, this is still the most direct public reference for Codex's own curated bundles. Read it folder by folder, copy structure only when the applicable license permits it, and pin commit 33bd952 or a later revision you have reviewed. For ordinary Codex users, installing one needed plugin is more defensible than cloning the catalog wholesale. The test-path failure makes local verification part of adoption, not an optional cleanup task.

Alternatives

ProjectWhat it isPick it when
Anthropic Skills gh↗A public collection of agent skills and examples centered on Claude workflows.pick this instead when Claude skill structure is the target rather than Codex plugin packaging.
Microsoft SkillsMicrosoft's repository of reusable skills for agent workflows.pick this instead when Microsoft's agent ecosystem and examples match the runtime you use.
OpenAI CookbookCode examples and guides for building directly with OpenAI APIs.pick this instead when you need application-level API examples rather than Codex plugin bundles.

What people are saying

  1. [github-trending] openai/plugins
  2. [github-trending] anthropics/claude-plugins-community
  3. [github-trending] anthropics/claude-plugins-official
  4. [github-trending] cursor/plugins

Sources

  1. OpenAI Plugins repository
  2. OpenAI Plugins README
  3. Curated plugin marketplace
  4. Plugin Eval guide
  5. Plugin Eval package

More dev tools reviews

workmux · v2rayNG · SecLists · hashcat · eslint · fastfetch · the whole board →