mrkeyoor.com_
Tue 27 Oct 06:35 UTC
Automationevaluationupdated 27 Oct 2026

skill-recorder review

Microsoft Skill Recorder captures a desktop task and uses GitHub Copilot to turn the recording into instructions an AI agent can reuse. It can produce a SKILL.md procedure or a scheduled automation, preferring the agent's native tools over replaying screen clicks. The intended benefit is explaining a recurring workflow by doing it once, then reviewing the resulting instructions.

Verdict

Our Skill Recorder run completed installation, build and tests, but npm audit reported 16 known vulnerabilities, including 14 high. It is worth a controlled trial with nonconfidential tasks if you already have Copilot access and will inspect the generated instructions and requested tools. The passing checks do not establish desktop capture quality, safe tool grants or successful execution of the resulting skill.

We ran it

Lab card: what happened when we ran skill-recorderScreenshot of skill-recorder (github.com/microsoft/skill-recorder)
Install✓ · 98s482 packages · 1441 MB
Build✓ · 8s
Tests✓ · 15sran, no count parsed
Known vulns160 critical · 14 high · 2 moderate · 0 low (npm audit)
Repo254 files~38,840 lines of source · 7.2 MB · 3 CI workflows

Answers from our run

Does skill-recorder build from source?

Dependencies installed in 98 seconds (482 packages), and the build succeeded in 8 seconds. We cloned commit b05d590 into a clean Debian container with 3 CPUs and no project-specific setup.

Do skill-recorder's tests pass?

Yes. The project's own test command exited successfully in 15 seconds, although its output did not expose an individual test count.

Does skill-recorder have known vulnerabilities in its dependencies?

npm audit flagged 16 known advisories in the dependency tree at the time of our run.

Who should not use skill-recorder?

Workflows whose captured screens, URLs, clipboard previews or terminal details must stay entirely on the device: Analyze sends recording material to GitHub's cloud.

What are the alternatives to skill-recorder?

Playwright, Anthropic Skills. Our Skill Recorder run completed installation, build and tests, but npm audit reported 16 known vulnerabilities, including 14 high.

SetupN/ARepository install, build and test steps passed, but supported desktop installation, OS permissions, Copilot sign-in and successful analysis were not evaluated.
Docs4/5The README details capture boundaries, cloud analysis, prerequisites, preview behavior and source installation. Under the visible documentation rubric, that merits 4 for detailed guidance, with the desktop workflow unverified.
CommunityN/AAn issue discussion and source release were read, but anonymous metadata access was rate-limited and support response capacity was not assessed.
MaturityN/AOur checks passed but did not execute a recorded workflow. Production reliability, output quality and target-agent permission enforcement remain unassessed.

Who it’s for

Copilot users who can demonstrate a recurring desktop task with nonconfidential sample data.
Developers willing to inspect the generated procedure and its requested tools before installing or exporting it.
Teams able to verify the resulting skill on a different input before attaching a schedule or trigger.

Who it’s NOT for

Workflows whose captured screens, URLs, clipboard previews or terminal details must stay entirely on the device: Analyze sends recording material to GitHub's cloud.
Users without GitHub Copilot access: the documented analysis path depends on that entitlement.
Teams requiring the preview to enforce tool permissions: review is optional, and issue 8 reports generated tool grants exceeding the approved plan.
Operators looking for a prebuilt desktop binary: the current release is source-only and the installer assembles it locally.

Setup reality

Our October 26, 2026 sandbox run at b05d590 completed installation in 98 seconds, the build in 8 seconds and tests in 15 seconds. It recorded 482 dependencies and 1,441 MB on disk. Npm audit reported 16 known vulnerabilities: 14 high and 2 moderate, with none critical or low. No passing-test count was supplied.

The documented user route downloads a pinned runtime and assembles a source release locally. Analysis requires a GitHub account with Copilot access; macOS also needs Screen Recording permission. The README lists macOS as the primary target, Windows 11 support and an Ubuntu installation route. These platform paths were not reproduced by our repository checks.

The sandbox configuration recorded 3 CPUs, 8 GB RAM and image lab-node:22. That label doesn't establish the actual runtime version. Current developer instructions require Node.js 24, so the supplied record cannot confirm that it used the documented runtime. Desktop capture, Copilot sign-in, analysis quality and execution of an exported skill remain unverified.

Review the generated procedure before giving it a job

Skill Recorder turns a demonstrated task into a SKILL.md procedure or an automation. The README says it captures a work session, reconstructs an intent and ordered steps with GitHub Copilot, then generates instructions that prefer the agent's native tools. Recording a browser form doesn't promise that the result will replay the same clicks.

That distinction is the reason to consider it. A demonstration can communicate details you'd forget to put in written instructions. It also gives the model a single example to generalize from. I'd judge the output by whether its procedure makes sense for another input, before letting it repeat a task on a schedule. Our lab record doesn't include that evaluation.

What happened when we ran it

Our October 26, 2026 sandbox run at commit b05d590 completed installation in 98 seconds, the build in 8 seconds and tests in 15 seconds. The recorded environment contained 482 dependencies and occupied 1,441 MB on disk. No test-case count accompanies the successful test step.

Npm audit reported 16 known vulnerabilities: 14 high and 2 moderate, with none critical or low. The supplied record doesn't identify the advisories or establish whether the affected code is reachable in a particular desktop workflow. Investigate the findings before deciding where to use the app. The successful checks don't establish security.

The configuration lists 3 CPUs, 8 GB RAM and image lab-node:22. An image name doesn't establish the executed runtime version. The current developer instructions require Node.js 24; without raw toolchain logs, we can't reconcile the configured image label with the actual runtime used. Neither a runtime mismatch nor its absence should be inferred from that label alone.

The scan found three CI workflow files, no Dockerfile and no tests directory. That directory signal doesn't contradict the successful test command or tell us how many cases it covered. Desktop capture, authorization, workflow reconstruction and a generated skill's execution are outside the evidence supplied here.

Analyze sends captured material to GitHub

The README says recording and local processing stay on your computer, while Analyze sends captured material to GitHub's cloud. That material includes the event timeline, extracted screen images and narration text. The timeline can contain window titles, URLs, clipboard previews and terminal commands; analysis can also request bounded terminal-output excerpts.

A team handling confidential work needs to decide whether that data transfer is permitted before recording a real task. Local capture doesn't make the later analysis local. Use a sample workflow with appropriate data, and inspect what the session contains before requesting reconstruction.

The recorded terminal is explicitly limited to the terminal opened from the app's recording bar. The README says it doesn't watch existing terminals or install global shell hooks. That's a useful boundary, but it still captures the complete output of its own terminal. A command that prints sensitive output can therefore create a sensitive recording even if no password was typed.

The source release needs Copilot and desktop permissions

The v0.7.0 release is source-only. Its documented installer obtains a pinned runtime and assembles the exact release commit locally; it isn't a download of a prebuilt Skill Recorder binary. Our repository checks don't reproduce that user installation route.

The README requires a GitHub account with Copilot access and identifies macOS as the primary target. It documents Windows 11 support and an Ubuntu installation route as well. On macOS, Screen Recording permission is part of first use. These requirements matter more to an adoption decision than treating our build duration as an estimate of the complete onboarding experience.

The release is pinned to the same b05d590 commit as our lab record. Its September 21 release and the discussion on issue 8 are dated activity, but the last-push date is unverified. Those records alone cannot establish current maintenance capacity, and the release's own validation claims aren't our measurements.

A readable preview does not enforce tool limits

The README describes an optional Review SKILL.md action that shows the complete generated file before installation or export. Editing the plan invalidates the prepared preview. Users can still go directly to Add or Export without inspecting it, so the review step isn't a mandatory checkpoint.

Issue 8 reports a related permission problem: generated allowed-tools entries can exceed the human-approved plan. An August discussion links a proposed constraint, but that reference doesn't prove the change shipped. At b05d590, the builder selects a nonempty model-submitted tool list without filtering it against the approved plan at that assignment.

That assignment is a narrow implementation observation. It doesn't establish how every target agent will enforce the resulting file. Compare the final requested tools with the approved procedure and the destination agent's policy. Seeing the generated text gives you something concrete to inspect; it doesn't prove the permissions are correct.

Write browser automation or a skill directly when that is easier

Playwright drives Chromium, Firefox and WebKit through one API. Choose it when the task stays in a browser and you want to write explicit automation steps instead of reconstructing a desktop demonstration. We didn't compare their reliability.

Anthropic Skills provides skill examples and a template. Use its template when you can describe the procedure yourself and do not need to record the screen. Its README distinguishes open-source examples from source-available document skills, so check the individual license.

Documentation receives 4 on our scale: 1 means basic orientation, 3 means a usable main workflow, and 5 means guidance corroborated across the reviewed paths. The capture and configuration details are substantial, but execution remains unverified. Take the generated procedure to a second sample input and check both its result and its requested tools before assigning recurring work.

Alternatives

ProjectWhat it isPick it when
Playwright gh↗A browser automation framework with a programmable API.Choose it when the task stays in a browser and you want to write explicit automation steps instead of reconstructing a desktop demonstration.
Anthropic Skills gh↗Skill examples and a template for writing instructions directly.Use its template when you can describe the procedure yourself and do not need to record the screen. Check individual skill licenses; the repository includes both open-source and source-available material.

What people are saying

  1. [github-trending] microsoft/skill-recorder

Sources

  1. Skill Recorder README
  2. Skill Recorder v0.7.0 source release
  3. Reported tool-permission boundary defect
  4. Builder implementation at the measured commit
  5. Playwright README
  6. Anthropic Skills README

More automation reviews

BPB-Wizard · wenzi-xiaohongshu-workflow · open-dot · Obtainium · microduck · artemis · the whole board →