Comments (2)
Hi,
I am reading this https://google.github.io/fuzzbench/getting-started/adding-a-new-fuzzer/ to add AFLSmart (https://github.com/aflsmart/aflsmart) so it can be benchmarked using FuzzBench. However, AFLSmart supports a few more arguments, especially the one taking an input model (-g) to enable its structure-aware capability. I have two questions regarding this
- How to support this -g argument in FuzzBench?
If this argument were not target/benchmark specific do you think it's unclear from the docs how this can be done? (asking because I want to know if our docs need improvement)
- Since the input model is target program-specific. For example, LibPNG takes PNG input model, LibJpeg-turbo takes JPEG input model. As far as I understand, FuzzBench uses projects integrated into OSS-Fuzz for benchmarking so where should I store AFLSmart's input models and how to map them to the corresponding OSS-Fuzz projects?
I am thinking about a simple solution which could answer the above questions but I am not sure it is desirable. The solution is that I fix the -g argument with an input model, say "-g model.xml" and when I build a OSS-Fuzz project, I copy a corresponding input model to the working folder and rename it to model.xml.
That should work.
The other possibility is to infer which model to use from the BENCHMARK
environment variable, when executing fuzz
. I wouldn't say it's official API but I think relying on it is OK.
Does this help?
from fuzzbench.
Hi @jonathanmetzman,
Thank you for your reply. Your suggestions work. I have just sent a pull request (#84) for AFLSmart. I check the value of the BENCHMARK env. variable to decide which input model will be used. However, it works pretty well when the number of benchmarks is small, but it would be an issue when the benchmarks become large, especially when you consider different versions of a subject program as I see in another discussion. So I would like to see a new feature that can handle this in a more proper way. Fortunately, it seems that this feature is on the working list since I see Abhishek has marked my request as a "new feature" -- which is awesome!
Best regards,
Thuan
from fuzzbench.
Related Issues (20)
- Running several experiments at one time HOT 1
- freetype_ftfuzzer oss-fuzz benchmark uses outdated commit
- llvm-cov show command report warning: <N> functions have mismatched data
- Allow setting `merge_with_nonprivate` in `run_experiment.py` command line params
- PyQt5 Issue HOT 2
- unknown flag: --gpus all when executing run_experiment.py
- No snapshot data when running local experiment HOT 6
- Average rank scoring
- Retire benchmarks that dont show differences HOT 1
- edges_found and edges_covered mismatch
- [docs] Outdated documentation about fuzzer configs
- Encounter problems when adding a new fuzzer HOT 3
- Why the report-data only contains the code covrage data? HOT 2
- Update `Python` dependencies to update deprecated packages and resolve conflicts HOT 8
- Some error about "run the local bug experiment". HOT 4
- Cannot pull gcr.io/fuzzbench/base-image docker image from Artifact Registry HOT 1
- local experiment issue : Local uncommitted changes found, exiting - raise ValidationError('Local uncommitted changes found, exiting.') HOT 1
- Show data and report links in `experiment` CI
- Fix/Remove `aspell_aspell_fuzzer_e8eb74` from tag `SBFT'23` HOT 6
- Is it possible to migrate a java or python benchmark from OSS-Fuzz to fuzzbench? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fuzzbench.