Evals MCP server

by cyanheads·io.github.cyanheads/evals-mcp-server·v0.1.3

Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.

What users say

No reviews yet

Safety scan

not scanned yet

Adoption

Not measured yet

Usage numbers are collected on the next scan

Reviews

Nobody has reviewed Evals yet.

If you have run it, two minutes of your experience saves the next person an afternoon.

No tool declarations could be read from the package source. They show once the server is installed.

Not scanned yet. New registry listings are scanned within a day of import.

Runs npx -y @cyanheads/evals-mcp-server on your machine. Read the scan report first; the gateway never runs local packages.

claude mcp add evals-mcp-server -- npx -y @cyanheads/evals-mcp-server

Is Evals MCP server safe?: Not known yet: the safety scan has not run. New listings are scanned within a few days.
How do I install Evals?: It runs on your machine. Copy the Claude Code, Claude Desktop or Cursor config from the install section.
Does Evals need an API key?: No secret keys are declared. It reads 14 settings from the environment.
Is Evals maintained?: The latest release is v0.1.3.

Local package. It runs on your machine, not through the gateway.

EVALS_DATA_DIRRoot folder for record JSON. The store manages drafts/, submitted/, and exports/ subdirs under it.
EVALS_REQUIRE_CONFIRMATIONWhen 'true', evals_submit_draft requests human confirmation before finalizing.
EVALS_DEFAULT_LICENSEDefault metadata.license applied when a draft omits one.
EVALS_CAPTURE_DIRDirectory of framework-written tool-call captures; when set, captures EvalsIDs resolve to full dumps.
MCP_LOG_LEVELSets the minimum log level for output (e.g., 'debug', 'info', 'warn').
MCP_HTTP_HOSTThe hostname for the HTTP server.
MCP_HTTP_PORTThe port to run the HTTP server on.
MCP_HTTP_ENDPOINT_PATHThe endpoint path for the MCP server.
MCP_AUTH_MODEAuthentication mode to use: 'none', 'jwt', or 'oauth'.
EVALS_DATA_DIRRoot folder for record JSON. The store manages drafts/, submitted/, and exports/ subdirs under it.
EVALS_REQUIRE_CONFIRMATIONWhen 'true', evals_submit_draft requests human confirmation before finalizing.
EVALS_DEFAULT_LICENSEDefault metadata.license applied when a draft omits one.
EVALS_CAPTURE_DIRDirectory of framework-written tool-call captures; when set, captures EvalsIDs resolve to full dumps.
MCP_LOG_LEVELSets the minimum log level for output (e.g., 'debug', 'info', 'warn').

Claim it to keep the listing current and reply to reviews. Claiming never changes the grade or hides a review.

Shows the safety grade and links back to this page. It updates itself after every scan and review.

[![mcp.market](https://mcp.market/badge/cyanheads-evals-mcp-server.svg)](https://mcp.market/server/cyanheads-evals-mcp-server)