Experiment Request: The Things That Count#2116
Open
clesmian wants to merge 5 commits into
Open
Conversation
Ensure that we actually get, build and fuzz the pinned version only
The main repo has moved
Avoid build failures due to unstable https://git.savannah.gnu.org/
|
Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA). View this failed invocation of the CLA check for more information. For the most up to date status, view the checks section at the bottom of the pull request. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Hi everyone,
at FUZZING workshop in February we presented our registered report "The Things That Count: Coverage Evaluation Under the Microscope" (https://www.ndss-symposium.org/wp-content/uploads/fuzzing2026-30.pdf) where we try to see how accurate our coverage measurements are. To complete our proposed experiments and evaluation we'd like to include data from the FuzzBench cloud infrastructure.
Could you run an experiment using the fuzzers aflplusplus, honggfuzz, libafl, and libfuzzer? We'd be interested in a run with all 23 benchmarks for the standard duration of 24h. Reviewers requested us to run 30 trials, however, we'd be also happy with 10 trials in case 30 should exceed the available capacity.
Thanks in advance! Happy to discuss, in case there's any questions!
The changes we've made are mainly small fixes we've needed to make our local builds/runs succeed. We think they might also be useful to upstream for others.