Rishav Katoch
Co-founder, SineFrame. SineFrame builds M3, open-source testing for MCP servers and the agents that use them.
On a well-built MCP server, Haiku matched Opus
On a well-built MCP server, Claude Haiku matched Opus. On one with real-world API flaws, small models broke. Six models, 1,248 runs.
Claude Code and Codex break on different MCP features
We ran Claude Code and Codex against the same ten MCP servers at pinned versions. Five features split them, and they never failed the same one.
Your MCP server passed. Did the agent call it?
Test an MCP server with plain pytest, break it on purpose, then run the same tests through real Claude Code and Codex. A walkthrough with M3.