mrkeyoor.com_
Sat 17 Oct 13:32 UTC
LLM Toolsevaluationupdated 12 Oct 2026

awesome-jev review

Awesome-jev is a source-attributed catalog of public Jev examples, organized by the decisions an agent needs to make. Its searchable site, MCP server, and Claude Code skill help you find relevant code while preserving caveats about what was read and what remains untested.

+2 / 4dstars / 7d
Verdict

Our awesome-jev run installed 62 packages in 13 seconds, built successfully, and reported 1,338 passing tests, making the catalog tooling practical to try locally. Use it to find an implementation and its caveats, then test that implementation on your own task. The passing repository suite does not certify the catalog's integrations or Jev's decisions.

We ran it

Lab card: what happened when we ran awesome-jevScreenshot of awesome-jev (kydlikebtc.github.io/awesome-jev)
Install✓ · 13s62 packages · 72 MB
Build✓ · 1s
Tests✓ · 126s1338 passed · 0 failed · 2 skipped of 1338 (pytest)
Known vulns0(pip-audit)
Repo259 files~40,236 lines of source · 7.7 MB · 8 CI workflows · tests dir

Answers from our run

Does awesome-jev build from source?

Dependencies installed in 13 seconds (62 packages), and the build succeeded in 1 seconds. We cloned commit d181418 into a clean Debian container with 3 CPUs and no project-specific setup.

Do awesome-jev's tests pass?

Yes. The project's own test command finished in 126 seconds and reported 1338 passed, 0 failed, 2 skipped (pytest).

Does awesome-jev have known vulnerabilities in its dependencies?

pip-audit found none in the dependency tree at the time of our run.

Who should not use awesome-jev?

Teams expecting verified production integrations: the README says catalog entries have not been runtime-tested by this repository.

What are the alternatives to awesome-jev?

TypeSafe skills, AI Cookbook, JevBench. Our awesome-jev run installed 62 packages in 13 seconds, built successfully, and reported 1,338 passing tests, making the catalog tooling practical to try locally.

Setup4/5Local checks passed, with uv and MCP SDK compatibility to manage
Docs5/5Explicit provenance, provider differences, freshness, and license limits
Community3/5598 stars and October metadata and description corrections
Maturity4/5Passing catalog tooling with clear limits on runtime verification

Who it’s for

Agent developers looking for cited examples of routing, compaction, classification, or other typed decisions.
MCP users who want filtered catalog results with source dates and caveats attached.
Claude Code users who need ecosystem examples alongside TypeSafe's official API guidance.
Researchers comparing independent reports, including approaches their authors declined to adopt.

Who it’s NOT for

Teams expecting verified production integrations: the README says catalog entries have not been runtime-tested by this repository.
Developers seeking local Jev inference: the README states there are no published Jev weights.
MCP environments pinned below SDK 2.x: the server imports the newer MCPServer API and documents an import failure with older SDKs.
Buyers needing an immutable evidence snapshot by default: call-site links target the default branch, and packaged catalog data can refresh from GitHub main.

Setup reality

Our run installed commit d181418 in 13 seconds: 62 packages and 72 MB on disk. The build passed in 1 second, and pytest succeeded in 126 seconds. The supplied summary reports 1,338 passed, 0 failed, and 2 skipped, with a stated total of 1,338. Pip-audit reported 0 known vulnerabilities.

Reading or querying the catalog needs no Jev credential. The MCP command needs a compatible client, and the Claude Code plugin needs uv on PATH. Executing linked model examples requires the provider access specified by those examples.

Our Python 3.12 environment met the interpreter requirement. The server requires MCP SDK 2.x, so an older pinned environment can fail at import. Installed catalog data normally refreshes from GitHub, with explicitly stale cache and bundled fallbacks. A local data override supports offline use.

The catalog helps you choose what to investigate

Awesome-jev keeps the evidence next to the example. A row can point to a call site while warning that its code hasn't been run, that the integration stays in shadow mode, or that its author measured the approach and declined to adopt it. That makes this a useful starting point for a developer deciding where a typed decision model belongs in an agent.

Our checkout contained 259 files and roughly 40,236 source lines, much more machinery than a static bookmark list. There is a searchable bilingual site, machine-readable metadata, generated documentation, and an MCP server. The English README is the main entry point, with Chinese documentation alongside it. I would use the catalog's evidence definitions to shortlist examples, then read the linked implementation before borrowing it.

What happened when we ran it

Our sandbox installed commit d181418 in 13 seconds, adding 62 Python packages and using 72 MB on disk. The build succeeded in 1 second. The October 9, 2026 run used a fresh Debian container with Python 3.12, 3 CPUs, and 8 GB of RAM, without secrets or elevated privileges. The checkout occupied 7.7 MB before installation. That is a manageable local footprint for exploring the tooling.

Pytest succeeded in 126 seconds. The supplied summary reports 1,338 passed, 0 failed, and 2 skipped, with a stated total of 1,338. We retain those reported counts rather than infer a different total. Pip-audit reported 0 known vulnerabilities. The scan found 8 CI workflow files, a tests directory, and no Dockerfile. These results concern this repository. They don't validate every linked project, a hosted Jev response, or the accuracy of any decision model.

Catalog search needs no model credential

The MCP server searches recorded examples and returns their caveats. Tools include search_examples, get_example, and a compatibility lookup for provider-specific request shapes. A coding assistant can narrow its search by decision pattern, language, or platform instead of consuming the whole README. Browsing these records doesn't call Jev. Running the separate model examples does require access to whichever provider their code targets.

Our 62-package installation covers a larger environment than the catalog scripts alone, which the documentation describes as standard-library code. The MCP server guide documents a stdio command for general clients and a Claude Code plugin that bundles the server with an agent skill. The plugin requires uv on PATH. Python 3.12 satisfied the package's interpreter requirement in our run, but client registration remains a separate task.

MCP SDK 2.x is a real compatibility boundary

The server imports MCPServer from the MCP SDK's 2.x API. Its documentation warns that an environment pinned to the older SDK can fail at import. This matters if you already maintain a shared environment for MCP tools. Check the package constraint before adding the command to a client, and give it an environment whose dependencies can resolve independently if your existing server stack uses the earlier API.

The 72 MB footprint we measured makes a separate environment a reasonable trade for avoiding that conflict. Data freshness is another choice: the installed package can fetch the catalog from GitHub's main branch, then fall back to cached data or a bundled snapshot. Results identify their source and mark stale fallbacks. For an offline or pinned-data workflow, AWESOME_JEV_CATALOG points to a local directory containing the required JSON files.

A cited call site still needs your own trial

The catalog distinguishes a human reading of code from a script spotting a request-shaped string. Its evidence links generally target a file on the default branch, rather than a frozen commit. That keeps the destination convenient, but the file can change or disappear after the recorded reading date. A successful link check says the address answered then. It doesn't establish that the example works now or makes sound decisions.

All 1,338 reported passing tests belong to our run of awesome-jev, not to the projects it indexes. The repository is unusually direct about that limit. Independent measurement rows describe their authors' work, including unfavorable outcomes, without claiming reproduction. Use them to find a relevant comparison and inspect its dataset. If you're choosing a compaction policy, a source about classification correctness won't answer whether important tool output survives compaction.

Provider differences make copied examples easy to misuse

The compatibility matrix records differences in model identifiers, request envelopes, and answer fields across gateways. Its human verification date is September 22, 2026, and the prose tells readers to reopen the provider documentation before shipping. That dated boundary is useful. An agent copying code from a different surface can produce a valid-looking request that reads the wrong answer field.

Our 126-second pytest step doesn't settle those live provider contracts. The bundled wire_pattern prompt can supply a matching example and its caveats, while the skill supplements TypeSafe's official guidance. Choose the official TypeSafe skills for the API contract, Dave Ebbelaar's AI Cookbook for a tutorial sequence, or JevBench for a decision-model evaluation project. Those are narrower answers to different jobs, rather than substitute catalogs with identical scope.

October corrections show the catalog is being tended

The last push was October 11, 2026. GitHub listed 598 stars and 10 open issues and PRs. Recent merged work updated JevBench's entry and refreshed catalog metadata, while open discussions cover discovery and corrections to existing descriptions. The latest-release endpoint returned no published release. This is an actively edited reference whose data can change independently of its Python package.

The 1-second build and passing local suite make awesome-jev easy to consider as research infrastructure. The license needs a closer look when republishing: code uses MIT, catalog metadata uses CC0, and copied upstream descriptions retain their authors' rights. Pick a relevant row, keep its caveats with the snippet, and pin the implementation you actually test. The record is most useful when it sends you to a better experiment.

Alternatives

ProjectWhat it isPick it when
TypeSafe skillsOfficial agent guidance for building with the System One API.pick this instead when the provider contract and question design are your immediate needs.
AI CookbookExamples and tutorials for building AI systems, including a Jev track.pick this instead when you want a guided implementation lesson rather than a catalog search.
JevBenchA benchmark project for typed decision models.pick this instead when your job is measuring decision quality rather than discovering integrations.

What people are saying

  1. [velocity-scout] heyjunpenn/awesome-jev
  2. [velocity-scout] kydlikebtc/awesome-jev
  3. [velocity-scout] Promethe-us/awesome-jev
  4. [velocity-scout] logicrw/awesome-jev-projects
  5. [velocity-scout] v-modal/awesome-jev-tools
  6. [velocity-scout] fatwang2/awesome-jev

Sources

  1. Awesome-jev README and evidence limits
  2. MCP server operation and freshness
  3. Provider compatibility matrix
  4. Package and SDK requirements
  5. Catalog sources and licensing
  6. JevBench entry correction

More llm tools reviews

GLM-5.3-Flash-EXL3-2x-DGX-Sparks-TensorFold · livenerf · scion · opencode2api · IQuest-Q1 · iCode · the whole board →