mrkeyoor.com_
Fri 04 Sept 16:56 UTC
AI Toolsevaluationupdated 04 Sept 2026

MathModelAgent review

MathModelAgent is primarily documented in Chinese, with a separate English README available. It combines Claude Code or Codex skills, a desktop app, and a self-hosted web stack to help analyze a mathematical-modeling problem, run code, produce figures, and draft a formatted paper for human review.

trackingstars / 7d
Verdict

Our MathModelAgent backend installed 35 packages, built in 18 seconds, and returned 0 known pip-audit findings, but it offered no test target. Try the skills or desktop app for supervised practice if Chinese-first documentation and the personal-use license fit you. Do not expose the web backend publicly or submit its paper output without checking the math, citations, code, and typesetting yourself.

We ran it

Lab card: what happened when we ran MathModelAgentScreenshot of MathModelAgent (mathmodel.top/home)
Install✓ · 45s35 packages · 37 MB
Build✓ · 18s
Testsn/ano test script
Known vulns0(pip-audit)
Repo966 files~19,216 lines of source · 62.5 MB · 0 CI workflows · Dockerfile

Answers from our run

Does MathModelAgent build from source?

Dependencies installed in 45 seconds (35 packages), and the build succeeded in 18 seconds. We cloned commit 83d8783 into a clean Debian container with 3 CPUs and no project-specific setup.

Does MathModelAgent have tests you can run?

Not through a standard command: the project exposes no test script or target that our harness could run.

Does MathModelAgent have known vulnerabilities in its dependencies?

pip-audit found none in the dependency tree at the time of our run.

Who should not use MathModelAgent?

Commercial users: the project's custom license allows free personal use, requires contacting the author for commercial use, and forbids commercial services built on it.

What are the alternatives to MathModelAgent?

Agent Laboratory, OpenCodeInterpreter, sci-box. Our MathModelAgent backend installed 35 packages, built in 18 seconds, and returned 0 known pip-audit findings, but it offered no test target.

Setup3/5Backend build passed; full source setup adds Redis and a frontend
Docs2/5English exists, but feature claims conflict with the later roadmap
Community4/54,152 stars with a September release and active reports
Maturity2/5Experimental, no test target, and unsafe for public hosting

Who it’s for

Chinese-speaking students who want a structured assistant for mathematical-modeling practice.
Researchers who will inspect every assumption, calculation, citation, and generated paragraph before use.
Claude Code or Codex users who prefer a staged skill workflow over building an agent harness.
Developers able to isolate a FastAPI, Redis, and frontend stack from the public internet while testing it.

Who it’s NOT for

Commercial users: the project's custom license allows free personal use, requires contacting the author for commercial use, and forbids commercial services built on it.
Anyone planning to submit the generated paper untouched: the README calls output reference material, and open issue 100 reports LaTeX syntax left inside Typst files.
Public or multi-user hosting without security work: the current backend exposes generated files and task messages without authentication, matching open issue 89.
Buyers expecting the advertised search, RAG, human approval, evaluator feedback, and handoff stack to be finished: the Chinese README later marks those paths incomplete or unimplemented.
Teams that require a maintained automated test suite: our measured backend had no test target, so no tests ran.

Setup reality

Our run at commit 83d8783 installed 35 Python packages in 45 seconds and used 37 MB. The backend build succeeded in 18 seconds. There was no test target, so testing was skipped. Pip-audit found 0 known vulnerabilities in the installed packages.

Source deployment needs Python 3.12 or newer, Redis, a separate Node and pnpm frontend, environment files, and at least one model API credential. Optional interpreters and data sources can add more service keys. The Claude Code or Codex route installs the supplied skills instead of the older web harness.

A Dockerfile exists, and v0.0.15 also ships signed and notarized macOS desktop packages plus an unsigned Windows installer. SmartScreen may warn on Windows. The self-hosted backend listens on port 8000 and currently lacks authentication around generated files and task messages, so it belongs on a trusted local network only.

The Chinese README now favors skills and a desktop bundle

MathModelAgent v0.0.15 has several faces. The current Chinese README recommends a desktop app that bundles Claude Code and the project's skills. Developers can also install the skills into Claude Code or Codex, or run the older FastAPI, Redis, and frontend stack. The intended workflow breaks a modeling problem into analysis, model selection, coding, figures, paper writing, and typesetting. An English README exists, but it is shorter and does not reflect every qualification in the Chinese page.

The repository markets a ready-to-submit paper and even states a vision of compressing 3 competition days into 1 hour. Its final caution gives a much more responsible limit: AI output is for reference, and the current system should not be expected to win the national competition by itself. That later warning is the one to trust. Mathematical modeling depends on assumptions, data quality, model choice, sensitivity analysis, and clear argument, none of which becomes correct because an agent filled a template.

Several advertised features remain unfinished

The upper feature list names web search, a RAG knowledge base, human approval, evaluator feedback, and multi-stage failure handling. Farther down, the Chinese roadmap says the human-in-loop data model is not fully integrated, evaluator feedback lacks its core logic, RAG has configuration without the main retrieval path, and A2A handoff is also incomplete. It says the original Tavily search path was not implemented and OpenAlex is used instead. Those are current limits, not promised near-term deliveries.

The skills path is more concrete. A /1start-mathmodel command coordinates separate stages, and the repository includes Typst templates for Chinese and international competitions. Results can include a notebook, Markdown, figures, and a compiled paper. Our measured checkout contained 966 files, about 19,216 source lines, and 62.5 MB, so there is enough material here to inspect and adapt. The workflow still needs a person to verify every equation, source, chart label, and claim.

What happened when we ran it

Our sandbox entered backend/ at commit 83d8783 and installed 35 packages in 45 seconds, using 37 MB on disk. The build succeeded in 18 seconds. Pip-audit reported 0 known vulnerabilities in the installed Python dependencies. The environment used 3 CPUs, 8 GB of RAM, Python 3.12 on Debian, an unprivileged container, and no secrets.

There was no test script or target, so the lab skipped tests. The measured checkout had no CI workflow and no tests directory, though it did include a Dockerfile. A successful 18-second backend build confirms package construction only. It does not exercise Redis, the browser interface, model calls, code execution, document conversion, Typst output, or the desktop wrapper. We did not run those paths, and the review makes no quality or performance claim for them.

Source deployment needs more than the 37 MB backend

The backend pyproject requires Python 3.12 or newer and pulls libraries for FastAPI, notebooks, numerical work, plotting, model APIs, document handling, and Redis. Local web setup also needs Redis plus a separate frontend installed with pnpm. Environment files hold the Redis URL and model configuration. The desktop distribution avoids those manual steps by bundling Claude Code and the skills, but users still provide a model API key.

Release v0.0.15 provides macOS packages for Apple and Intel processors, both signed and notarized according to its notes. The Windows 64-bit installer is unsigned, so Microsoft Defender SmartScreen may warn. That release added more competition templates, reusable team details, file previews, and tutorial material. Those desktop conveniences do not validate the generated mathematics, and they do not address the backend's public-hosting boundary.

Unauthenticated artifact routes make public hosting unsafe

Current backend source mounts project/work_dir under /static and exposes routes for download links and task messages without a login check. Open issue 89 describes the same design and warns that someone who knows or guesses a task ID can read papers, data products, and logs. The FastAPI app also sets wildcard CORS origins with credentials. Run it on localhost or a private test network until authentication, per-user authorization, and restrictive origin settings are implemented and verified.

The absence of 35-package audit findings does not cover application-level access control. Pip-audit checks known dependency advisories; it cannot tell whether a route should require a user session. Modeling inputs may contain unpublished data, student identifiers, drafts, and paid API settings. Exposing generated files is therefore a practical data issue, not a theoretical web-hardening exercise. A reverse proxy alone cannot invent task ownership that the application does not track.

The custom license excludes ordinary commercial adoption

GitHub does not detect a standard repository license. The project's license file contains 3 short restrictions: personal use is free, commercial use requires contacting the author, and closed-source distribution plus commercial services based on the project are forbidden. A company cannot treat this like MIT or Apache-2.0 code. Obtain written terms from the author before commercial deployment, modification, redistribution, or a hosted service.

The September 2 release is active and still experimental

GitHub recorded 4,152 stars, a last push on September 2, 2026, and release v0.0.15 on the same day. The open queue held 27 issues and 4 pull requests. Recent reports cover file operations, certificate verification, context limits, API connectivity, and paper syntax. A September 4 pull request proposed stricter scholarly-reference checks, which shows contributor activity after the release.

The project itself calls the code an experimental development demo with frequent changes and bugs. That label matches our evidence better than the promise of a submission-ready paper. The clean 18-second backend build and 0 audit findings make the Python package approachable, while the missing test target and exposed routes stop the self-hosted stack from being a public service. Start with skills in a disposable project and judge the outputs against work you can solve yourself.

Alternatives

ProjectWhat it isPick it when
Agent LaboratoryAn autonomous research workflow that helps plan experiments, run code, and draft a report.pick this instead when the job is a broader research workflow rather than a competition-specific math paper.
OpenCodeInterpreterA code-generation system that adds execution and iterative correction around language models.pick this instead when executable problem solving matters more than templates and paper assembly.
sci-boxThe author's separate skill collection for scientific figures and editable diagrams.pick this instead when you only need publication figures or diagrams, not the full modeling workflow.

What people are saying

  1. [github-trending] jihe520/MathModelAgent

Sources

  1. MathModelAgent Chinese README
  2. MathModelAgent English README
  3. MathModelAgent v0.0.15 release
  4. MathModelAgent license terms
  5. Unauthenticated task artifact report
  6. Typst output syntax report

More ai tools reviews

Hands-On-AI-Engineering · ML-From-Scratch · OpenCluely · text-to-cad · miles · Paddle · the whole board →