MCP.Market

Backtest Auditor MCP server

by nothingbutalpha.app·app.nothingbutalpha/backtest-auditor·v0.7.0

Automated red-team checks for trading backtests: lookahead lint, Deflated Sharpe, costs. Local.

C60/100grade C
What users say
No reviews yet
Be the first
Safety scan
C60/100

full report

Adoption
New

81 downloads/wk

Reviews

Write one

Nobody has reviewed Backtest Auditor yet.

If you have run it, two minutes of your experience saves the next person an afternoon.

Backtest Auditor tools (6)

write = sends, deletes, buys or posts

Read from the package source without running it. The installed server may list more.

  • audit_backtest

    One call that runs every audit that applies: check_path on the code, audit_returns on the returns, audit_trade_log on the trades, all against the benchmark if given. Returns one combined verdict, the worst of the parts: No red flags found / Some red flags / Major red flags, with reasons per part. Without a benchmark, or with code only, the best verdict is 'Some red flags'. No red flags doesn't mea

  • audit_returns

    Statistical red-team of a backtest's return series: net vs gross at 0/5/10/20 bps and the break-even cost; Sharpe with Newey-West and Lo-style t-stats (autocorrelation-aware); the Deflated Sharpe Ratio (Bailey & Lopez de Prado 2014) for n_trials and the minimum track record length; stability by thirds and by year; share of PnL from the best 5% of days; max drawdown and duration; excess return, IR

  • audit_trade_log

    Builds daily PnL, returns and turnover from a trade log (marked to market with your prices if given), then runs the full audit_returns review. Adds PnL concentration by ticker and heuristic survivorship hints (tickers traded before their symbol existed; no names ever leaving a multi-year universe). Heuristics are labeled as such.

  • check_code

    Static review of Python/pandas strategy code for patterns that inflate backtests: negative shifts in features or signals, centered windows, backward fill, fitting before the time split, shuffled CV, signal and fill on the same bar, labels on the wrong bar, today's index constituents, yfinance caveats, intraday resample labels, global normalization, target leakage, full-sample parameter search and

  • check_path

    Read-only lint of Python strategy files on disk: the same rules as check_code, per file. Code is parsed with ast and never imported or run. Virtual environments, node_modules, .git and caches are skipped; folder symlinks are not followed; huge, binary, unreadable or undecodable files are skipped with a reason (a UTF-8 BOM is fine). Each finding has rule_id, severity, title, start_line/end_line, wh

  • explain

    What a check looks for, why the problem inflates backtest results, how to fix it, and references.

Public scan report

scanner v0.1.10 · 2026-10-28 · same rubric, same numbers if you re-run it

1 medium1 low
  • Code scan21 source files scanned20/25
  • –Live reliabilityno gateway calls yet and no remote to proben/a
  • –Tool poisoningtools not inspected (local package is not executed); not countedn/a
  • Auth qualitylocal package, no credentials required12/15
  • Maintenanceno repository listed3/15
  • Maintainer identityverified namespace with website, no repo4/10

Findings (2)

  • mediumeval / new Function usedexec.eval
    backtest_auditor-0.7.0/nba_auditor/lint.py: …---- # v0.4: query/eval strings. `frame.eval("t * b")`, `frame.query("m > 0")` and `p…
  • lowNo source repository listedmaint.no-repo
Overall 60/100. Components that don't apply are left out of the denominator. Any critical finding is an F.RubricAppeal a findingJSON

How Backtest Auditor compares

Against every graded MCP server, from our own scans and uptime checks. Updated after each scan run.

Safety score
60/100
higher than 15% of 48,255 servers
Tools
6
the typical server has 7
Tools that change things
0%
typical: 0%. Fewer write tools means less an agent can break
Downloads a week
81
more than 58% of 12,191 servers with a package

What its tools let an agent do: 6 read

Install Backtest Auditor in Claude Code, Cursor or VS Code

claude mcp add backtest-auditor -- uvx backtest-auditor
Add to Cursor

Backtest Auditor: common questions

Is Backtest Auditor MCP server safe?
With care: it is graded C, so read the findings first (60/100). Read the Backtest Auditor safety report
How do I install Backtest Auditor?
It runs on your machine. Copy the Claude Code, Cursor, VS Code or Claude Desktop config from the install section.
Does Backtest Auditor need an API key?
Not as far as the registry entry and our scan can tell: no credentials are declared or required.
Is Backtest Auditor maintained?
The latest release is v0.7.0.
How does Backtest Auditor compare with other MCP servers?
safety score 60/100 (higher than 15% of 48,255 servers); tools 6 (the typical server has 7); tools that change things 0% (typical: 0%. Fewer write tools means less an agent can break). Full comparison.