cavi-ai/
GitHub ↗

Installation

MCP Eval 0.1.0 is the Cargo package mcpeval and installs the mcpeval (and mcpeval-demo) binaries. Install from crates.io, or download a checksummed prebuilt binary from the release page:

sh
cargo install mcpeval --locked
mcpeval --version

The version command must print mcpeval 0.1.0. Building from a checked-out release source works too:

sh
cargo build --release
./target/release/mcpeval --version

Set MCPEVAL_HOME when you want a capture root other than the default:

sh
export MCPEVAL_HOME="$PWD/.mcp-eval"

When MCPEVAL_HOME is unset, MCP Eval uses $HOME/.mcp-eval if HOME is available. Keep this directory private. Records in its store/ child are content-minimized, but you must manually review or remove free-form annotation notes before sharing any store files.

For HTTP transports, no extra runtime service is installed. mcpeval shim-http listens only on the explicit loopback socket you provide and forwards to the validated upstream endpoint for the life of that process.