mrkeyoor.com_
Wed 11 Nov 20:35 UTC
Dataevaluationupdated 01 Nov 2026

data-formulator review

Choose Data Formulator for exploratory analysis when you want to revisit earlier questions and can check the generated work before sharing it. Data Formulator is a Microsoft Research workspace for exploring data with AI agents, tables and editable charts. Data Threads let you branch from an earlier analysis step. Our run on September 27, 2026, at commit 5477f0e checked installation, the frontend build and Vitest command outcomes; it did not test model answers, database connections or an end-to-end analysis.

+9stars / 7d
Verdict

Data Formulator is worth a supervised trial if branching analysis is useful to you and someone can verify the resulting transformations and charts. Our run installed the developer dependencies in 67 seconds and built the frontend in 57 seconds; it did not establish analytical accuracy or deployment readiness. Start with a known dataset and a checkable question, then evaluate model behavior and your intended deployment separately.

We ran it

Lab card: what happened when we ran data-formulatorScreenshot of data-formulator (data-formulator.ai)
Install✓ · 67s1050 packages · 807 MB
Build✓ · 57s
Tests✓ · 34s391 passed · 0 failed of 391 (vitest)
Repo689 files~136,350 lines of source · 28.1 MB · 2 CI workflows · Dockerfile · tests dir

Answers from our run

Does data-formulator build from source?

Dependencies installed in 67 seconds (1050 packages), and the build succeeded in 57 seconds. We cloned commit 5477f0e into a clean Debian container with 3 CPUs and no project-specific setup.

Do data-formulator's tests pass?

Yes. The project's own test command finished in 34 seconds and reported 391 passed, 0 failed (vitest).

Who should not use data-formulator?

Readers who need this review to establish analytical accuracy or production readiness: our run did not test either.

What are the alternatives to data-formulator?

LIDA, Evidence, Apache Superset. Data Formulator is worth a supervised trial if branching analysis is useful to you and someone can verify the resulting transformations and charts.

Setup4/5The developer install and build completed successfully in our sandbox. Peer-dependency warnings and untested model, Python and deployment setup prevent treating this as a fully verified installation path.
Docs5/5Strong documented coverage within this rubric: the supplied guide explains development, production builds, sandbox backends, workspace storage and deployment profiles. We did not execute every documented route.
Community5/5This retained rating is limited to visible contribution evidence: the supplied release lists multiple contributors and merged changes. It does not rate adoption, response times or current community size.
Maturity4/5The recorded frontend build and Vitest command succeeded, and the release provides a changelog. The tested release is beta; backend coverage, analytical accuracy and production reliability remain unverified.

Discussed on

  1. hnShow HN: Data Formulator – AI-powered data visualization from Microsoft Research212 points
  2. hnShow HN: Data Formulator – interactive AI agents for data analysis (Microsoft)38 points
  3. hnShow HN: Data Formulator 0.5 – Vibe with your data (Microsoft Research)4 points

Who it’s for

Analysts who want to branch into follow-up questions while retaining earlier tables and charts.
Teams prepared to check source data, generated transformations and chart interpretations.
Developers evaluating a local workspace before configuring model access or shared hosting.

Who it’s NOT for

Readers who need this review to establish analytical accuracy or production readiness: our run did not test either.
Anonymous public deployments that need durable database credentials or arbitrary model endpoints; the deployment guide requires restrictions for that profile.
Organizations requiring signed desktop applications; the README describes the desktop downloads as unsigned, unnotarized previews.
Teams choosing primarily on verified adoption, support response times or service reliability; the supplied evidence does not establish those.

Setup reality

Our sandbox recorded a successful Yarn install in 67 seconds, a successful build in 57 seconds and a successful Vitest command in 34 seconds. The dependency record contains 1,050 packages occupying 807 MB. These are developer-checkout measurements, not timings for the Python installation routes described in the README.

The install log includes unmet and incorrect peer-dependency warnings. The build log includes a warning about chunks larger than its configured threshold. Neither command failed, but successful completion does not establish browser performance or dependency compatibility across other environments.

The development guide requires Python >= 3.11, Node.js and Yarn for local development. Model configuration is separate from building the frontend. Shared hosting also requires decisions about identity, workspace persistence and generated-code isolation.

What our run establishes

Our run took place on September 27, 2026, at commit 5477f0e, using our lab-node:22 sandbox with 3 CPUs and 8 GB RAM. The attached harness records success flags, exit codes, elapsed time, timeout status and output tails for installation, build and tests. All three commands returned exit code zero without timing out.

The stored parser summaries report 391 passed, 0 failed and 0 skipped Vitest tests. These summaries do not establish exhaustive unique test coverage. The attached raw footer agrees with the stored passing count, but no new execution or complete-log reconciliation was performed for this correction.

The frontend test tail includes DOM-nesting and missing-i18next-instance warnings. Those warnings are not recorded test failures. Python tests were detected in the repository, but the supplied execution record establishes a Vitest run, not execution of the Python suite.

We did not test a model-backed analysis, database connector, desktop application, Python wheel installation or deployed service. The audit field is null, so dependency scan coverage is unknown. Command success provides grounds to continue evaluation; it does not verify chart accuracy or security.

The MrKeyoor testing methodology explains how command outcomes and parsed counts reach our reviews. That page provides provenance context; its current procedure does not establish which methodology version governed this older run.

Why branching matters for exploration

Data Threads let you branch from an earlier analysis step. The repository README describes explanations, tables and editable charts in one history, with results that can be refined or assembled into reports. This gives an analyst a practical reason to try the workspace: compare a new question with an earlier path without discarding that path.

That is a documented capability, not an outcome we exercised. For a useful next step, load a dataset whose totals you already know, ask a question you can verify independently, then inspect the resulting table and chart before branching into a second question. Treat that as your acceptance check, not as a reproduction of our build-and-test run.

Choose the deployment profile before sharing access

The development guide says to keep data connectors and custom models disabled for anonymous deployments. It explains that browser identities are client-provided and suitable for disposable demo workspaces, rather than durable credentials or sensitive server state. Its anonymous profile also uses ephemeral workspaces and hides configured API keys.

The documented authenticated profile uses verified identity and persistent storage. These are configuration instructions, not security properties verified by our run. Read the deployment guide against your hosting requirements before exposing the application to other users.

Generated Python introduces a separate isolation choice. The guide describes a local subprocess backend and a disposable Docker execution backend. It explicitly says the Docker sandbox is unsupported when the application itself runs inside a container. Running the application in Docker therefore does not establish that generated code uses the Docker execution backend.

Match the alternative to the work

LIDA provides an API for generating, executing, editing, explaining, evaluating and repairing visualization code. Choose LIDA when you need those operations inside an application you control. It also has an optional UI, so the distinction is its reusable API, not an absence of a browser interface. Its documentation warns that it generates and executes code.

Evidence creates reports in code using SQL and Markdown. Choose Evidence when the deliverable is a report maintained in code and published as a site. It can complement an exploratory workspace when you want to turn checked findings into a separate reporting artifact; that is a workflow choice, not a documented integration.

Apache Superset provides a SQL editor, a lightweight semantic layer, dashboards and configurable security roles. Evaluate Apache Superset when those BI capabilities define the requirement. Its documentation establishes their presence; it does not establish that Superset will fit your identity system or database configuration without evaluation.

Release scope and ratings

The supplied release page identifies 0.8b1 at commit 5477f0e as a beta. The README distinguishes the 0.8.0b1 preview package from stable 0.7. Our checkout results should not be presented as measurements of an unpinned stable-package installation.

The release notes include a change to gracefully degrade chart insights for text-only models. An older report of a generic chart-insight error is therefore insufficient evidence that the same behavior persists in the tested release. The supplied extracts also do not verify the current status of the earlier Ollama and semantic-layer issues, so this review does not use them as established limitations.

The retained ratings use a five-point editorial rubric: 1 means the evidence shows a blocking problem, 2 substantial obstacles, 3 a usable path with significant gaps, 4 a successful or well-documented path with material qualifications, and 5 strong evidence within the dimension's stated scope. Setup assesses the recorded developer setup; docs assesses coverage of setup and deployment instructions; community assesses visible contribution evidence, not adoption; maturity assesses release and test evidence, not production reliability. Unknown dimensions would remain unassessed. These ratings are judgments, not benchmarks or comparisons with the alternatives.

Alternatives

ProjectWhat it isPick it when
LIDAA library with an API for generating and working with visualization code, plus an optional UI.Choose it when you need visualization operations inside your own application rather than adopting Data Formulator's workspace.
EvidenceA tool for creating reports in code using SQL and Markdown.Choose it for reports published as sites; it can also complement exploration by providing a separate destination for checked findings.
Apache Superset gh↗A BI application with dashboards, a SQL editor, a lightweight semantic layer and configurable roles.Evaluate it when dashboard authoring and explicit BI configuration are the main requirements.

What people are saying

  1. [github-trending] microsoft/data-formulator

Sources

  1. Data Formulator repository
  2. Data Formulator development and deployment guide
  3. Data Formulator 0.8b1 release
  4. Local Ollama model issue
  5. Text-only chart insight issue
  6. Semantic layer feature request

More data reviews

rerun · telegraf · rocksdb · redash · akshare · DB-GPT · the whole board →