Skip to content

bench: let shuf_input_range deterministic, drop broken b3sum#11160

Closed
oech3 wants to merge 1 commit intouutils:mainfrom
oech3:bench
Closed

bench: let shuf_input_range deterministic, drop broken b3sum#11160
oech3 wants to merge 1 commit intouutils:mainfrom
oech3:bench

Conversation

@oech3
Copy link
Contributor

@oech3 oech3 commented Feb 28, 2026

Closes #11105

@github-actions
Copy link

GNU testsuite comparison:

Skipping an intermittent issue tests/tail/symlink (passes in this run but fails in the 'main' branch)
Skipping an intermittent issue tests/tty/tty-eof (passes in this run but fails in the 'main' branch)
Congrats! The gnu test tests/misc/io-errors is no longer failing!
Congrats! The gnu test tests/timeout/timeout-group is no longer failing!
Congrats! The gnu test tests/tail/tail-n0f is now passing!

@codspeed-hq
Copy link

codspeed-hq bot commented Feb 28, 2026

Merging this PR will improve performance by ×470

⚡ 2 improved benchmarks
✅ 290 untouched benchmarks
⏩ 44 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation shuf_input_range[1000000] 84,782.2 µs 181.9 µs ×470
Memory shuf_input_range[1000000] 7,881.4 KB 46.7 KB ×170

Comparing oech3:bench (018fb1b) with main (6100aee)

Open in CodSpeed

Footnotes

  1. 44 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@oech3 oech3 closed this Feb 28, 2026
@oech3 oech3 deleted the bench branch February 28, 2026 14:26
black_box(run_util_function(uumain, &["-i", &range_arg]));
black_box(run_util_function(
uumain,
&["-i", "--random-seed=1", &range_arg],
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: we could use empty string for the seed

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This bench is broken. We cannot use --random-seed. Also I don't see any reason to use empty string.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

shuf_input_range benchmark is flakey

2 participants