桌面UI自动化测试MCP服务器

MCP Test Utils

MCP server for automated desktop UI testing. A single binary — no runtime, no dependencies, no installer.

Windows x64 only. There are no macOS or Linux builds yet. If you need one, write to JeenyJAI@gmail.com: requests decide what comes next.

Gives AI agents eyes and hands: screenshots, window management, mouse, keyboard, UI Automation, OCR, file search. Replays saved scenarios as regression runs — after every build, without an agent. Records what you do into a draft scenario, checks accessibility, watches the resources of the application under test.

Why

AI agents can trigger actions in applications but can't see the screen. This server bridges that gap:

Agent triggers action → takes screenshot → sees the result →
switches window → clicks a button → verifies → writes report

Fully autonomous, no user involvement required.

Demo

Setup

1. Download mcp-test-utils.exe from Releases (the .sig file next to it is for the built-in updater — you do not need it).
2. Add it to your MCP client:

Claude Desktop: %APPDATA%\Claude\claude_desktop_config.json

{
  "mcpServers": {
    "test-utils": {
      "command": "D:\\path\\to\\mcp-test-utils.exe"
    }
  }
}

Claude Code:

claude mcp add test-utils -- "D:\path\to\mcp-test-utils.exe"

For other clients, see their documentation.

3. Restart the client.
4. In chat, try: "Take a screenshot" — the agent will return an image of your desktop.

Optional settings (logging, file search, starting programs) go into env — see Environment variables:

{
  "mcpServers": {
    "test-utils": {
      "command": "D:\\path\\to\\mcp-test-utils.exe",
      "env": {
        "MCP_LOG_DIR": "D:\\path\\to\\logs",
        "MCP_SEARCH_DIRS": "D:\\Projects\\app1;D:\\Projects\\app2",
        "MCP_LAUNCH_APPS": "C:\\Program Files\\MyApp\\myapp.exe"
      }
    }
  }
}

Tools (31)

Four of them appear only when configured: search_in_files and find_files with MCP_SEARCH_DIRS, enable_logging and disable_logging with MCP_LOG_DIR — by default the server lists 27 tools.

Vision

Window management

Input

Structured UI access

Process

Waiting, batching and scenarios

File search

Agent guide

Session logging

Regression runs without an agent

An agent finds a path through your application once and saves it as a scenario — a JSON file. After that the scenario replays without an agent: fast, the same way every time, no tokens spent.

mcp-test-utils --check order-form.json     # validate the file, touch nothing
mcp-test-utils --run order-form.json       # run: report in the console and in order-form.report.json

• Exit codes: 0 — passed, 1 — a step failed, 2 — did not run. Ready for a CI job after each build.
• On a failure you get a screenshot, the element tree and a hint: either the scenario is stale or the application has changed.
• An agent runs a scenario with run_scenario(path) and learns the format from get_usage_guide(section: "scenarios").
• Suites and data rows: --suite runs several scenario files in order with one summary; --data rows.csv runs a scenario once per row (columns become variables); --junit report.xml adds JUnit XML for CI.
  复制

  mcp-test-utils --suite regress.suite.json --junit regress.xml
  

• Without a license key a scenario runs up to 50 steps (see License key).

Recording

Do the steps yourself and get a draft scenario instead of describing them to an agent:

mcp-test-utils --record order-form.json --app myapp

Only that window and its dialogs are recorded, with a notice on screen; Ctrl+Alt+Shift+R (or Enter in the console) stops the recording. Password fields are never read; text typed into a terminal is recorded only with --keys-text. An agent can start the same recording with record_scenario.

Environment variables

Tray icon, updates and input lock

• A tray icon shows a live log of tool calls, one tab per session, errors in red; MCP_NOTIFY=off hides it.
• Updates: tray menu → Check for updates…. Only a release signed by the author is installed; afterwards restart your MCP client. The server goes online only when you click.
• Input lock: while the server types or clicks, your keyboard and mouse buttons are paused (the pointer still moves). Press Esc to stop the action and get your input back. MCP_INPUT_LOCK=off turns the lock off.

Feedback

If an agent hits a gap in the tools, it offers to prepare a short suggestions file (prepare_feedback). The file goes to Documents\mcp-test-utils feedback\, with personal data masked and no screenshots; review it and email it to JeenyJAI@gmail.com. Nothing is sent automatically.

Use cases

• Automated QA — the agent navigates the app, clicks through flows, takes screenshots at each step, writes a test report
• Regression runs — replay saved scenarios after each build, from a script or a CI job, without an agent
• Recorded tests — walk through a path yourself once, get a draft scenario, let the agent turn it into a test
• Desktop automation — fill forms, copy data between windows, run workflows
• Accessibility audit — check_accessibility finds unnamed controls, controls the Tab key cannot reach, duplicate ids
• Resource leaks — process_info shows handles and GDI objects growing across repeated calls
• Visual checks — the agent compares screenshots between builds
• Data extraction — read document text through UI Automation, or OCR text from applications that don't expose it
• Code search — find patterns across multiple projects without leaving the agent session

Security

• Responds only to requests from the MCP client; opens no network ports
• Writes files only when you ask: logs, scenario reports and JUnit files, recorded drafts, sealed scenarios, the feedback file, the license file — plus small settings files in %LOCALAPPDATA%\mcp-test-utils\ and an update you install
• Sends no data externally; goes online only when you click Check for updates (and Download and install) in the tray window — an agent's tool call never does, and only a file signed by the author is installed
• Holds your keyboard and mouse buttons only during a call, batch or scenario run that sends input — Esc releases them at once
• Starts only the programs you list in MCP_LAUNCH_APPS (never shells or interpreters); a forced close_window terminates only a program it started
• Records only on an explicit command, with a notice on screen the whole time; password fields are never read
• Screenshots capture the entire screen — make sure no sensitive information is visible
• File search is sandboxed — only directories in MCP_SEARCH_DIRS are accessible

How it works

MCP Test Utils is an MCP server over stdin/stdout: your MCP client starts the exe and calls its tools. It uses native Windows APIs (UI Automation, Win32 input, Windows OCR) — no PowerShell, no helper tools, no network access except the update check you start. Tested with Claude Desktop and Claude Code.

License key

All tools are free. A license key only lifts the 50-step limit of scenario runs.

For now, keys are issued through early access: the first 30 users get a free one-year key in exchange for short feedback after the first month — write to JeenyJAI@gmail.com with your email and the machine code of your computer. A key is bound to that computer. Your agent sees the code in the second line of get_usage_guide, or print it yourself:

mcp-test-utils --machine-id

Register the key once on that computer:

mcp-test-utils --set-license <email> <key>

Reinstalling Windows or replacing the motherboard alone keeps the key valid; a new computer needs a new key — just write again.

A sealed scenario runs anywhere without the limit — that file only, exactly as sealed. On the licensed computer mcp-test-utils --seal order-form.json writes a seal into the file; a CI agent or a colleague without a key then runs it in full. Any change to its steps (or to the files it includes) breaks the seal — seal it again on the licensed computer.

Support us

If you find it useful — jeenyjai.github.io

License

Copyright 2026 JeenyJAI. All rights reserved.

🚀 Created with Claude