Talkthru MCP server

talkthru

talkthru.dev · npm · @dr_edon · MIT

An automated feedback loop for any app. Screen-record your app on your phone and talk while you use it. Send it to your machine and your coding agent gets everything you said, attached to the screen you were looking at when you said it.

you:    *tapping through checkout* "this button is too small, I keep missing it"
                                  "and this error doesn't say what went wrong"

agent:  sees both screens, finds both components, fixes them.

Runs entirely on your machine. No accounts, no uploads, no API keys.

Works with a mac screen recording (⌘⇧5), an iPhone one over AirDrop, or Windows Game Bar. Any video with sound works — point the watcher at a folder.

70-second demo — install, record, and the agent picking it up.

Install

npx talkthru doctor --fix

Pulls ffmpeg, whisper.cpp and the speech model. Nothing else to set up.

Start the watcher

npx talkthru watch

Leave it running. It only touches files named like a screen recording — the rest of your Downloads folder is invisible to it.

Connect your agent

talkthru is an MCP server, so any MCP client works — Cursor, Windsurf, Cline, Zed, Claude Desktop. Add it to your client's config:

{
  "mcpServers": {
    "talkthru": {
      "command": "npx",
      "args": ["talkthru-mcp"]
    }
  }
}

Claude Code has a one-liner for the same thing:

claude mcp add --scope user talkthru -- npx talkthru-mcp

Restart your client afterwards so it picks up the server.

Built and tested against Claude Code. Other MCP clients should work — tell me if yours doesn't.

Set up your mac

Once. Press ⌘⇧5, pick a record mode (the icons with the ◉ dot), then open Options and set Save to → Downloads and your Microphone. Both stick.

1 · 2. press ⌘⇧5, pick a record mode, open Options 3. Save to → Downloads — the folder talkthru watch looks at 4. pick your mic under Microphone 5. hit Record and talk as you use your app

No mic selected means a silent video and nothing to transcribe. Worth checking before your first recording.

Set up your phone

Optional — only if you want to record a phone app rather than your desktop.

Once. Control Centre → + → Add a Control → Screen Recording. Then press and hold it and turn the microphone on.

Shortened. The full README is on GitHub.