fix: correct stale metadata + complete SDLC variance coverage

- Fix ccb_understand per_suite count 34→20 (was stale after narrowing)
- Fix total_selected 400→398 to match actual task count
- Add 3rd variance pass for openlibrary-search-query-fix-001 and
  pytorch-tracer-graph-cleanup-fix-001 (promoted fix_haiku_20260301_190026)
- All 178 SDLC tasks now have >= 3 runs in both baseline and MCP configs

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Author: sjarmak

configs/selected_benchmark_tasks.json

@@ -5,7 +5,7 @@
     "generated_by": "SDLC suite migration from migration_map.json",
     "generated_date": "2026-02-18",
     "total_available": 835,
-    "total_selected": 400,
+    "total_selected": 398,
     "migration_source": "migration_map.json (157 mapped tasks across 8 SDLC suites)",
     "target_total": 294,
     "target_note": "178 SDLC tasks (9 suites, ccb_test=18 after TAC task removal) + 220 MCP-unique tasks (11 suites x 20) = 398 active. 2 llamacpp TAC tasks dropped (need external RocketChat server).",
@@ -167,7 +167,7 @@
       "ccb_refactor": 20,
       "ccb_secure": 20,
       "ccb_test": 18,
-      "ccb_understand": 34
+      "ccb_understand": 20
     }
   },
   "tasks": [

docs/official_results/README.md

@@ -2,7 +2,7 @@
 
 This bundle is generated from `runs/official/` and includes only valid scored tasks (`passed`/`failed` with numeric reward).
 
-Generated: `2026-03-01T13:28:24.423549+00:00`
+Generated: `2026-03-01T19:12:02.665318+00:00`
 
 ## Local Browse
 
@@ -19,16 +19,16 @@ Historical reruns/backfills remain available in `data/official_results.json` und
 |---|---|---:|---:|---:|---:|---|
 | [ccb_build](suites/ccb_build.md) | `baseline-local-direct` | 23 | 23 | 0.580 | 0.783 | ok |
 | [ccb_build](suites/ccb_build.md) | `mcp-remote-direct` | 20 | 23 | 0.592 | 0.800 | FLAG: below minimum |
-| [ccb_debug](suites/ccb_debug.md) | `baseline-local-direct` | 16 | 20 | 0.739 | 1.000 | FLAG: below minimum |
-| [ccb_debug](suites/ccb_debug.md) | `mcp-remote-direct` | 16 | 20 | 0.559 | 0.688 | FLAG: below minimum |
-| [ccb_design](suites/ccb_design.md) | `baseline-local-direct` | 20 | 20 | 0.766 | 1.000 | ok |
-| [ccb_design](suites/ccb_design.md) | `mcp-remote-direct` | 33 | 20 | 0.741 | 1.000 | ok |
-| [ccb_document](suites/ccb_document.md) | `baseline-local-direct` | 20 | 20 | 0.890 | 1.000 | ok |
-| [ccb_document](suites/ccb_document.md) | `mcp-remote-direct` | 44 | 20 | 0.841 | 1.000 | ok |
+| [ccb_debug](suites/ccb_debug.md) | `baseline-local-direct` | 20 | 20 | 0.688 | 1.000 | ok |
+| [ccb_debug](suites/ccb_debug.md) | `mcp-remote-direct` | 25 | 20 | 0.510 | 0.720 | ok |
+| [ccb_design](suites/ccb_design.md) | `baseline-local-direct` | 20 | 20 | 0.770 | 1.000 | ok |
+| [ccb_design](suites/ccb_design.md) | `mcp-remote-direct` | 33 | 20 | 0.720 | 0.970 | ok |
+| [ccb_document](suites/ccb_document.md) | `baseline-local-direct` | 20 | 20 | 0.845 | 1.000 | ok |
+| [ccb_document](suites/ccb_document.md) | `mcp-remote-direct` | 44 | 20 | 0.875 | 1.000 | ok |
 | [ccb_feature](suites/ccb_feature.md) | `baseline-local-direct` | 20 | 20 | 0.631 | 0.850 | ok |
 | [ccb_feature](suites/ccb_feature.md) | `mcp-remote-direct` | 20 | 20 | 0.553 | 0.800 | ok |
 | [ccb_fix](suites/ccb_fix.md) | `baseline-local-direct` | 25 | 25 | 0.450 | 0.600 | ok |
-| [ccb_fix](suites/ccb_fix.md) | `mcp-remote-direct` | 70 | 25 | 0.572 | 0.714 | ok |
+| [ccb_fix](suites/ccb_fix.md) | `mcp-remote-direct` | 72 | 25 | 0.556 | 0.694 | ok |
 | [ccb_mcp_compliance](suites/ccb_mcp_compliance.md) | `baseline-local-artifact` | 1 | 28 | 0.375 | 1.000 | FLAG: below minimum |
 | [ccb_mcp_compliance](suites/ccb_mcp_compliance.md) | `baseline-local-direct` | 7 | 28 | 0.648 | 1.000 | FLAG: below minimum |
 | [ccb_mcp_compliance](suites/ccb_mcp_compliance.md) | `mcp-remote-artifact` | 1 | 28 | 0.742 | 1.000 | FLAG: below minimum |
@@ -65,13 +65,13 @@ Historical reruns/backfills remain available in `data/official_results.json` und
 | [ccb_mcp_security](suites/ccb_mcp_security.md) | `baseline-local-direct` | 10 | 25 | 0.524 | 0.800 | FLAG: below minimum |
 | [ccb_mcp_security](suites/ccb_mcp_security.md) | `mcp-remote-artifact` | 6 | 25 | 0.792 | 1.000 | FLAG: below minimum |
 | [ccb_mcp_security](suites/ccb_mcp_security.md) | `mcp-remote-direct` | 25 | 25 | 0.719 | 1.000 | ok |
-| [ccb_refactor](suites/ccb_refactor.md) | `baseline-local-direct` | 20 | 20 | 0.755 | 1.000 | ok |
-| [ccb_refactor](suites/ccb_refactor.md) | `mcp-remote-direct` | 20 | 20 | 0.671 | 1.000 | ok |
-| [ccb_secure](suites/ccb_secure.md) | `baseline-local-direct` | 20 | 20 | 0.669 | 0.950 | ok |
-| [ccb_secure](suites/ccb_secure.md) | `mcp-remote-direct` | 24 | 20 | 0.637 | 0.917 | ok |
-| [ccb_test](suites/ccb_test.md) | `baseline-local-direct` | 20 | 20 | 0.480 | 0.750 | ok |
-| [ccb_test](suites/ccb_test.md) | `mcp-remote-direct` | 35 | 20 | 0.475 | 0.686 | ok |
-| [ccb_understand](suites/ccb_understand.md) | `baseline-local-direct` | 34 | 20 | 0.771 | 0.853 | ok |
+| [ccb_refactor](suites/ccb_refactor.md) | `baseline-local-direct` | 20 | 20 | 0.789 | 0.950 | ok |
+| [ccb_refactor](suites/ccb_refactor.md) | `mcp-remote-direct` | 20 | 20 | 0.703 | 1.000 | ok |
+| [ccb_secure](suites/ccb_secure.md) | `baseline-local-direct` | 20 | 20 | 0.712 | 1.000 | ok |
+| [ccb_secure](suites/ccb_secure.md) | `mcp-remote-direct` | 24 | 20 | 0.707 | 0.958 | ok |
+| [ccb_test](suites/ccb_test.md) | `baseline-local-direct` | 20 | 20 | 0.484 | 0.700 | ok |
+| [ccb_test](suites/ccb_test.md) | `mcp-remote-direct` | 35 | 20 | 0.468 | 0.686 | ok |
+| [ccb_understand](suites/ccb_understand.md) | `baseline-local-direct` | 34 | 20 | 0.902 | 0.971 | ok |
 | [ccb_understand](suites/ccb_understand.md) | `mcp-remote-direct` | 48 | 20 | 0.873 | 0.979 | ok |
 
 <details>
@@ -317,13 +317,35 @@ Historical reruns/backfills remain available in `data/official_results.json` und
 | [debug_haiku_20260228_231033](runs/debug_haiku_20260228_231033.md) | `ccb_debug` | `mcp-remote-direct` | 10 | 0.804 | 1.000 |
 | [debug_haiku_20260301_021540](runs/debug_haiku_20260301_021540.md) | `ccb_debug` | `baseline-local-direct` | 11 | 0.847 | 1.000 |
 | [debug_haiku_20260301_021540](runs/debug_haiku_20260301_021540.md) | `ccb_debug` | `mcp-remote-direct` | 11 | 0.813 | 1.000 |
+| [debug_haiku_20260301_030159](runs/debug_haiku_20260301_030159.md) | `ccb_debug` | `baseline-local-direct` | 11 | 0.837 | 1.000 |
+| [debug_haiku_20260301_030159](runs/debug_haiku_20260301_030159.md) | `ccb_debug` | `mcp-remote-direct` | 11 | 0.801 | 1.000 |
+| [debug_haiku_20260301_031844](runs/debug_haiku_20260301_031844.md) | `ccb_debug` | `baseline-local-direct` | 11 | 0.806 | 1.000 |
+| [debug_haiku_20260301_031844](runs/debug_haiku_20260301_031844.md) | `ccb_debug` | `mcp-remote-direct` | 11 | 0.750 | 1.000 |
+| [debug_haiku_20260301_033225](runs/debug_haiku_20260301_033225.md) | `ccb_debug` | `baseline-local-direct` | 9 | 0.444 | 0.889 |
+| [debug_haiku_20260301_033225](runs/debug_haiku_20260301_033225.md) | `ccb_debug` | `mcp-remote-direct` | 9 | 0.389 | 0.778 |
+| [debug_haiku_20260301_035030](runs/debug_haiku_20260301_035030.md) | `ccb_debug` | `baseline-local-direct` | 9 | 0.333 | 0.667 |
+| [debug_haiku_20260301_035030](runs/debug_haiku_20260301_035030.md) | `ccb_debug` | `mcp-remote-direct` | 9 | 0.278 | 0.556 |
+| [debug_haiku_20260301_040300](runs/debug_haiku_20260301_040300.md) | `ccb_debug` | `baseline-local-direct` | 9 | 0.500 | 1.000 |
+| [debug_haiku_20260301_040300](runs/debug_haiku_20260301_040300.md) | `ccb_debug` | `mcp-remote-direct` | 9 | 0.389 | 0.778 |
+| [debug_haiku_20260301_071226](runs/debug_haiku_20260301_071226.md) | `ccb_debug` | `baseline-local-direct` | 11 | 0.842 | 1.000 |
+| [debug_haiku_20260301_071226](runs/debug_haiku_20260301_071226.md) | `ccb_debug` | `mcp-remote-direct` | 11 | 0.841 | 1.000 |
 | [design_haiku_20260223_124652](runs/design_haiku_20260223_124652.md) | `ccb_design` | `baseline-local-direct` | 13 | 0.770 | 1.000 |
 | [design_haiku_20260223_124652](runs/design_haiku_20260223_124652.md) | `ccb_design` | `mcp-remote-direct` | 20 | 0.718 | 1.000 |
 | [design_haiku_20260301_022406](runs/design_haiku_20260301_022406.md) | `ccb_design` | `baseline-local-direct` | 20 | 0.766 | 1.000 |
 | [design_haiku_20260301_022406](runs/design_haiku_20260301_022406.md) | `ccb_design` | `mcp-remote-direct` | 20 | 0.734 | 1.000 |
+| [design_haiku_20260301_031030](runs/design_haiku_20260301_031030.md) | `ccb_design` | `baseline-local-direct` | 20 | 0.762 | 0.950 |
+| [design_haiku_20260301_031030](runs/design_haiku_20260301_031030.md) | `ccb_design` | `mcp-remote-direct` | 20 | 0.747 | 1.000 |
+| [design_haiku_20260301_031845](runs/design_haiku_20260301_031845.md) | `ccb_design` | `baseline-local-direct` | 20 | 0.807 | 1.000 |
+| [design_haiku_20260301_031845](runs/design_haiku_20260301_031845.md) | `ccb_design` | `mcp-remote-direct` | 19 | 0.701 | 1.000 |
+| [design_haiku_20260301_071227](runs/design_haiku_20260301_071227.md) | `ccb_design` | `baseline-local-direct` | 20 | 0.770 | 1.000 |
+| [design_haiku_20260301_071227](runs/design_haiku_20260301_071227.md) | `ccb_design` | `mcp-remote-direct` | 20 | 0.699 | 0.950 |
 | [document_haiku_20260223_164240](runs/document_haiku_20260223_164240.md) | `ccb_document` | `baseline-local-direct` | 19 | 0.851 | 1.000 |
 | [document_haiku_20260223_164240](runs/document_haiku_20260223_164240.md) | `ccb_document` | `mcp-remote-direct` | 20 | 0.822 | 1.000 |
 | [document_haiku_20260226_013910](runs/document_haiku_20260226_013910.md) | `ccb_document` | `baseline-local-direct` | 1 | 1.000 | 1.000 |
+| [document_haiku_20260301_031846](runs/document_haiku_20260301_031846.md) | `ccb_document` | `baseline-local-direct` | 20 | 0.875 | 1.000 |
+| [document_haiku_20260301_031846](runs/document_haiku_20260301_031846.md) | `ccb_document` | `mcp-remote-direct` | 20 | 0.908 | 1.000 |
+| [document_haiku_20260301_071228](runs/document_haiku_20260301_071228.md) | `ccb_document` | `baseline-local-direct` | 20 | 0.845 | 1.000 |
+| [document_haiku_20260301_071228](runs/document_haiku_20260301_071228.md) | `ccb_document` | `mcp-remote-direct` | 20 | 0.898 | 1.000 |
 | [feature_haiku_20260228_190114](runs/feature_haiku_20260228_190114.md) | `ccb_feature` | `baseline-local-direct` | 5 | 0.507 | 0.600 |
 | [feature_haiku_20260228_190114](runs/feature_haiku_20260228_190114.md) | `ccb_feature` | `mcp-remote-direct` | 6 | 0.550 | 0.833 |
 | [feature_haiku_20260228_211127](runs/feature_haiku_20260228_211127.md) | `ccb_feature` | `baseline-local-direct` | 17 | 0.664 | 0.941 |
@@ -343,6 +365,8 @@ Historical reruns/backfills remain available in `data/official_results.json` und
 | [feature_haiku_20260301_071229](runs/feature_haiku_20260301_071229.md) | `ccb_feature` | `baseline-local-direct` | 20 | 0.631 | 0.850 |
 | [feature_haiku_20260301_071229](runs/feature_haiku_20260301_071229.md) | `ccb_feature` | `mcp-remote-direct` | 19 | 0.582 | 0.842 |
 | [feature_haiku_vscode_rerun_20260301_023018](runs/feature_haiku_vscode_rerun_20260301_023018.md) | `ccb_feature` | `baseline-local-direct` | 1 | 0.500 | 1.000 |
+| [fix_haiku_20260301_190026](runs/fix_haiku_20260301_190026.md) | `ccb_fix` | `baseline-local-direct` | 2 | 0.000 | 0.000 |
+| [fix_haiku_20260301_190026](runs/fix_haiku_20260301_190026.md) | `ccb_fix` | `mcp-remote-direct` | 2 | 0.000 | 0.000 |
 | [refactor_haiku_20260228_210652](runs/refactor_haiku_20260228_210652.md) | `ccb_refactor` | `baseline-local-direct` | 1 | 0.750 | 1.000 |
 | [refactor_haiku_20260228_210652](runs/refactor_haiku_20260228_210652.md) | `ccb_refactor` | `mcp-remote-direct` | 1 | 0.790 | 1.000 |
 | [refactor_haiku_20260228_230116](runs/refactor_haiku_20260228_230116.md) | `ccb_refactor` | `mcp-remote-direct` | 6 | 0.585 | 1.000 |
@@ -355,19 +379,33 @@ Historical reruns/backfills remain available in `data/official_results.json` und
 | [refactor_haiku_20260301_023530](runs/refactor_haiku_20260301_023530.md) | `ccb_refactor` | `mcp-remote-direct` | 10 | 0.717 | 0.900 |
 | [refactor_haiku_20260301_031849](runs/refactor_haiku_20260301_031849.md) | `ccb_refactor` | `baseline-local-direct` | 20 | 0.755 | 1.000 |
 | [refactor_haiku_20260301_031849](runs/refactor_haiku_20260301_031849.md) | `ccb_refactor` | `mcp-remote-direct` | 20 | 0.671 | 1.000 |
+| [refactor_haiku_20260301_071230](runs/refactor_haiku_20260301_071230.md) | `ccb_refactor` | `baseline-local-direct` | 20 | 0.789 | 0.950 |
+| [refactor_haiku_20260301_071230](runs/refactor_haiku_20260301_071230.md) | `ccb_refactor` | `mcp-remote-direct` | 19 | 0.713 | 1.000 |
 | [secure_haiku_20260223_232545](runs/secure_haiku_20260223_232545.md) | `ccb_secure` | `baseline-local-direct` | 20 | 0.669 | 0.950 |
 | [secure_haiku_20260223_232545](runs/secure_haiku_20260223_232545.md) | `ccb_secure` | `mcp-remote-direct` | 18 | 0.705 | 1.000 |
 | [secure_haiku_20260224_011825](runs/secure_haiku_20260224_011825.md) | `ccb_secure` | `mcp-remote-direct` | 2 | 0.500 | 0.500 |
+| [secure_haiku_20260301_031850](runs/secure_haiku_20260301_031850.md) | `ccb_secure` | `baseline-local-direct` | 20 | 0.737 | 0.950 |
+| [secure_haiku_20260301_031850](runs/secure_haiku_20260301_031850.md) | `ccb_secure` | `mcp-remote-direct` | 20 | 0.728 | 1.000 |
+| [secure_haiku_20260301_071231](runs/secure_haiku_20260301_071231.md) | `ccb_secure` | `baseline-local-direct` | 20 | 0.712 | 1.000 |
+| [secure_haiku_20260301_071231](runs/secure_haiku_20260301_071231.md) | `ccb_secure` | `mcp-remote-direct` | 20 | 0.767 | 1.000 |
 | [test_haiku_20260223_235732](runs/test_haiku_20260223_235732.md) | `ccb_test` | `baseline-local-direct` | 10 | 0.492 | 0.800 |
 | [test_haiku_20260223_235732](runs/test_haiku_20260223_235732.md) | `ccb_test` | `mcp-remote-direct` | 19 | 0.495 | 0.684 |
 | [test_haiku_20260224_011816](runs/test_haiku_20260224_011816.md) | `ccb_test` | `baseline-local-direct` | 11 | 0.295 | 0.545 |
 | [test_haiku_20260224_011816](runs/test_haiku_20260224_011816.md) | `ccb_test` | `mcp-remote-direct` | 11 | 0.262 | 0.455 |
 | [test_haiku_20260228_230654](runs/test_haiku_20260228_230654.md) | `ccb_test` | `mcp-remote-direct` | 1 | 0.000 | 0.000 |
 | [test_haiku_20260228_231039](runs/test_haiku_20260228_231039.md) | `ccb_test` | `mcp-remote-direct` | 1 | 0.200 | 1.000 |
+| [test_haiku_20260301_031851](runs/test_haiku_20260301_031851.md) | `ccb_test` | `baseline-local-direct` | 17 | 0.571 | 0.824 |
+| [test_haiku_20260301_031851](runs/test_haiku_20260301_031851.md) | `ccb_test` | `mcp-remote-direct` | 8 | 0.769 | 1.000 |
+| [test_haiku_20260301_071232](runs/test_haiku_20260301_071232.md) | `ccb_test` | `baseline-local-direct` | 17 | 0.569 | 0.824 |
+| [test_haiku_20260301_071232](runs/test_haiku_20260301_071232.md) | `ccb_test` | `mcp-remote-direct` | 8 | 0.780 | 1.000 |
 | [understand_haiku_20260224_001815](runs/understand_haiku_20260224_001815.md) | `ccb_understand` | `baseline-local-direct` | 20 | 0.533 | 0.650 |
 | [understand_haiku_20260224_001815](runs/understand_haiku_20260224_001815.md) | `ccb_understand` | `mcp-remote-direct` | 20 | 0.679 | 0.850 |
 | [understand_haiku_20260225_211346](runs/understand_haiku_20260225_211346.md) | `ccb_understand` | `baseline-local-direct` | 7 | 0.789 | 1.000 |
 | [understand_haiku_20260225_211346](runs/understand_haiku_20260225_211346.md) | `ccb_understand` | `mcp-remote-direct` | 7 | 0.870 | 1.000 |
+| [understand_haiku_20260301_031852](runs/understand_haiku_20260301_031852.md) | `ccb_understand` | `baseline-local-direct` | 20 | 0.728 | 0.850 |
+| [understand_haiku_20260301_031852](runs/understand_haiku_20260301_031852.md) | `ccb_understand` | `mcp-remote-direct` | 20 | 0.832 | 0.950 |
+| [understand_haiku_20260301_071233](runs/understand_haiku_20260301_071233.md) | `ccb_understand` | `baseline-local-direct` | 20 | 0.884 | 1.000 |
+| [understand_haiku_20260301_071233](runs/understand_haiku_20260301_071233.md) | `ccb_understand` | `mcp-remote-direct` | 20 | 0.850 | 1.000 |
 
 </details>