AInotate MCP server

Annotated screenshots for AI agents: the agent shows you the button instead of describing where it is.

Website · Get started · Privacy

Ask an agent how to post a link on Hacker News and you usually get directions: the orange bar at the top, the last link after jobs. With AInotate it sends the picture above instead and says "click submit, where the blue arrow points".

It captures a web page, a window or a screenshot you already have, finds the elements you mean, draws numbered steps, arrows, boxes and labels where they hide the least, blacks out emails and tokens, and looks at the result before sending it. It works in Claude Code, Cowork, Claude Desktop, Codex, Gemini CLI, Cursor and any other MCP client, and from the command line or Python.

We built it at DontPayFull because our own agents kept answering "where is it?" with a paragraph. A picture with a number on the right button settles the question in a second, in a chat, a ticket or a guide.

What it is for

agent answers with the screen itself, the control boxed and numbered.

• "Where is it?" Settings, menus, buttons that hide behind icons. The

ainotate guide turns them into a Markdown, HTML or PDF guide.

• "Walk me through it." One image per step, in the order to follow;

screen: the agent does not click for you. It shows exactly what to press and says what the click does.

• "Your turn." A permission switch, a 2FA code, a payment or consent

right in green, emails and tokens blacked out before anyone sees them.

• Bug reports and tickets. What is wrong, outlined in red, what is

talks about, re-shot from the same spec when the UI changes; before and after plates for a change.

• Docs and changelogs. Screenshots that point at the thing the text

Set it up in your agent

1. Install, one of:

Then ainotate doctor checks the machine and prints the exact fix for anything missing, including the one command that downloads Chromium for web capture. To update later: brew upgrade ainotate, pipx upgrade ainotate or uv tool upgrade ainotate; the plugin with /plugin marketplace update ainotate; the Desktop extension by opening the newer .mcpb from Releases.

2. Connect it to the agent you use:

Shortened. The full README is on GitHub.