Context
In PR #1509 (fix(wasm): port missing node extractions to JS extractor), tests/benchmarks/regression-guard.test.ts widened the 1-file rebuild and No-op rebuild thresholds from 25%→50% and CANARY mode to 100%.
The justification is empirical CI variance on sub-30ms metrics (±10ms CI jitter ≈ ±50%+ relative), and MIN_ABSOLUTE_DELTA provides a floor. However, the PR does not include CI data showing the measured variance.
Action
- Attach a CI run showing the variance on
1-file rebuild, No-op rebuild, and CANARY metrics that motivated the threshold change.
- If the empirical data supports the change, add a comment in the test file citing the CI run ID.
- If the data does not support it, revert to 25% and investigate the root cause of the instability.
Context
In PR #1509 (fix(wasm): port missing node extractions to JS extractor),
tests/benchmarks/regression-guard.test.tswidened the1-file rebuildandNo-op rebuildthresholds from 25%→50% and CANARY mode to 100%.The justification is empirical CI variance on sub-30ms metrics (±10ms CI jitter ≈ ±50%+ relative), and
MIN_ABSOLUTE_DELTAprovides a floor. However, the PR does not include CI data showing the measured variance.Action
1-file rebuild,No-op rebuild, and CANARY metrics that motivated the threshold change.