THESIS · MCP OWNER EVALUATION

Run history

Every run is kept in SQLite. The arrows compare each run with the previous run using the same chronological history.

PERSISTENT

Recorded runs

6append-only history

Latest pass rate

100%10 of 10 cases

Latest model

—deterministic

Estimated cost

—latest run · token estimate

ALL RUNS

Comparable measurements

Pass rate ↑ is better. Duration, calls, tokens and cost ↓ are better.

RunModelPassed / ΔMedian / ΔP95MCP callsAPI callsTokensEst. cost
16 Nov 2026, 14:27fd1ef2bbdeterministicdeterministic · ×110/10→ 091 ms↑ 5196 ms26——cap —
16 Nov 2026, 14:21dfe2224ddeterministicdeterministic · ×110/10→ 087 ms↓ 37202 ms26——cap —
16 Nov 2026, 13:43e3eb6c85deterministicdeterministic · ×110/10→ 0124 ms↑ 4268 ms26——cap —
16 Nov 2026, 13:38a76aa0e9deterministicdeterministic · ×110/10→ 0121 ms↑ 14227 ms26——cap —
16 Nov 2026, 13:31cfe5ad3cdeterministicdeterministic · ×110/10↑ 0.10106 ms↓ 12223 ms26——cap —
16 Nov 2026, 13:30808a93e4deterministicdeterministic · ×19/10—118 ms—181 ms25.5——cap —

LATEST RUN

Case results

16 Nov 2026, 14:27

CaseStatusDurationMCPAPIModel callsTokensError
archive_productrepeat 1passed90 ms260——
create_productrepeat 1passed163 ms4100——
edit_inventoryrepeat 1passed90 ms260——
invalid_pricerepeat 1passed84 ms130——
new_categoryrepeat 1passed92 ms260——
order_and_cancelrepeat 1passed130 ms5120——
products_subscriptionrepeat 1passed92 ms250——
read_scope_deniedrepeat 1passed70 ms130——
settings_and_staffrepeat 1passed196 ms6140——
viewer_deniedrepeat 1passed86 ms250——