MCP.Market

Ragmetric MCP server

by MukundaKatta·io.github.MukundaKatta/ragmetric-mcp·v0.1.1
No reviews yet

RAG retrieval IR metrics: recall@k, hit@k, MRR, NDCG@k, evaluate_batch.

A92/100grade A
Write a reviewInstall
What users say
No reviews yet
Be the first
Safety scan
A92/100

full report

Adoption
New

0 stars

Reviews

Write one

Nobody has reviewed Ragmetric yet.

If you have run it, two minutes of your experience saves the next person an afternoon.

Ragmetric tools (5, 1 write)

write = sends, deletes, buys or posts

Read from the package source without running it. The installed server may list more.

  • evaluate_batchwrite action

    Run all four metrics over a batch of queries and return per-metric means. Use this when you have multiple eval queries and want one summary number per metric.

  • hit_at_k

    Hit@k: 1.0 if any relevant doc appears in top k, else 0.0. Useful when 'did we get at least one right?' is what matters.

  • mrr

    Mean Reciprocal Rank: 1 / rank of first relevant doc, 0 if none retrieved. Ranks are 1-based. For a single query.

  • ndcg_at_k

    NDCG@k with binary relevance. Discount = log2(rank + 1). Returns DCG@k / IDCG@k. Penalizes putting relevant docs lower in the ranking.

  • recall_at_k

    Recall@k: fraction of relevant doc IDs in the top k retrieved. Use this when you have ground-truth relevance for a query and want to measure how well the retriever surfaced the right docs.

Public scan report

scanner v0.1.9 · 2026-09-27 · same rubric, same numbers if you re-run it

no findings
  • Code scan3 source files scanned25/25
  • –Live reliabilityno gateway calls yet and no remote to proben/a
  • –Tool poisoningtools not inspected (local package is not executed); not countedn/a
  • Auth qualitylocal package, no credentials required12/15
  • Maintenancelast push 29 days ago15/15
  • Maintainer identityregistry namespace matches repository owner; GitHub account older than a year8/10
Overall 92/100. Components that don't apply are left out of the denominator. Any critical finding is an F.RubricAppeal a findingJSON

How Ragmetric compares

Against every graded AI and agents MCP server, from our own scans and uptime checks. Updated after each scan run.

Safety score
92/100
higher than 90% of 4,464 AI and agents servers
Tools
5
the typical AI and agents server has 6
Tools that change things
20%
typical: 0%. Fewer write tools means less an agent can break

What its tools let an agent do: 4 read · 1 run or deploy

Install Ragmetric in Claude Code, Cursor or VS Code

Runs npx -y @mukundakatta/ragmetric-mcp on your machine. Read the scan report first; the gateway never runs local packages.

claude mcp add ragmetric-mcp -- npx -y @mukundakatta/ragmetric-mcp
Add to Cursor

What the publisher says

From the Ragmetric repository's README, as published. We do not edit it. Read it on GitHub

mcp-stack

Fourteen small MCP servers for everyday LLM / RAG / agent work. Each ships independently on npm, listed in the official MCP Registry, and is callable from Claude Desktop, Cursor, Cline, Windsurf, Zed, and any other MCP-compatible client.

RAG / agent helpers

Reliable transforms LLMs reach for tools instead of imagining

Sibling libraries

The first four wrap or re-implement logic from the user's Rust + Python work:

ragdrift-py (PyPI) — five-dimensional drift detection

  • ragdrift (crates.io) /

stopstream, citecite, ragmetric — pure-Rust crates from the rust-llm-stack workspace

  • embedrank, promptbudget,

The MCP servers are independent: they implement the logic they need in plain JavaScript so installing them doesn't pull a Rust toolchain.

Install (any of them)

Add to your MCP client config. Example for Claude Desktop:

Shortened. The full README is on GitHub.

Nothing above is checked by us. What we check is on the safety report.

Ragmetric: common questions

Is Ragmetric MCP server safe?
Yes, by our scan: it is graded A (92/100). Read the Ragmetric safety report
How do I install Ragmetric?
It runs on your machine. Copy the Claude Code, Cursor, VS Code or Claude Desktop config from the install section.
Does Ragmetric need an API key?
Not as far as the registry entry and our scan can tell: no credentials are declared or required.
Is Ragmetric maintained?
The last commit was 65 days ago (2026-08-29). The latest release is v0.1.1.
What can I use instead of Ragmetric?
Servers from other publishers that do the same job: Tw Legal Rag MCP server, Serena MCP: the IDE for your agent MCP server and Local Rag MCP server.
How does Ragmetric compare with other AI and agents MCP servers?
safety score 92/100 (higher than 90% of 4,464 AI and agents servers); tools 5 (the typical AI and agents server has 6); tools that change things 20% (typical: 0%. Fewer write tools means less an agent can break). Full comparison.

Alternatives to Ragmetric

Same job from other publishers: the closest match first, then the best rated.

  • Tw Legal Rag
    Citation-guarded retrieval over 22M Taiwan court judgments and administrative interpretations
    A
  • Serena MCP: the IDE for your agent
    A powerful toolkit for coding, providing semantic retrieval and editing capabilities.
    C
  • Local Rag
    Easy-to-setup local RAG server with minimal configuration
    A
  • Butterbase AI
    Butterbase MCP server — manage your backend: schemas, auth, functions, storage, RAG, deploys.
    A
  • Guaardvark
    Local AI studio on your GPU: images, video, music, voice, RAG. Needs the Guaardvark app installed.
    B

More from MukundaKatta →