renatahodovan / fuzzinator Goto Github PK
View Code? Open in Web Editor NEWFuzzinator Random Testing Framework
License: BSD 3-Clause "New" or "Revised" License
Fuzzinator Random Testing Framework
License: BSD 3-Clause "New" or "Revised" License
fuzzinator/fuzzinator/tracker/gitlab.py
Line 29 in 37520f6
In Gitlab maximum issue title size is 256, so I am seeing that when we create an issue with a long title - which could be the assertion failure message, the issue is just not reported at all. Pressing report does nothing to it. My suggestion here is to trim the title to 256, and check the result of the issue create to see if creation was successful because at the moment there's no failure message when something goes wrong.
I will look into this if nobody else has time.
Hi,
I feel that there's no way to achieve differential fuzzing with fuzzinator. Have you thought about this?
The use of this for us would be to run different versions of JSC and check if the console output of the SUT (if it doesn't) crash, is the same as other versions.
Could you add some comments on this? If not possible at the moment, how hard do you think it would be add this feature?
I do have a fuzzer=fuzzinator.fuzzer.RandomContent working, and I also were able to run half of a fuzzer with grammar:
grammarinator is called, but my SUT not. Help would be great :)
[sut.jerry]
call=fuzzinator.call.SubprocessCall
#call.decorate(0)=fuzzinator.call.ExitCodeFilter
#call.decorate(11)=fuzzinator.call.FileReaderDecorator
[sut.jerry.call]
command=/media/detlef/Fast/KALI/fuzzer/gecko-dev/js/src/fuzzbuild_OPT.OBJ/dist/bin/js
#command=/media/detlef/Fast/KALI/fuzzer/ASTFuzz/a.out
cwd=.
# Parameter section for ExitCodeFilter.
[sut.jerry.call.decorate(0)]
exit_codes=[3]
[fuzz.jerryscript-grammarinator]
sut=sut.jerry
fuzzer=fuzzinator.fuzzer.SubprocessRunner
[fuzz.jerryscript-grammarinator.fuzzer.init]
outdir=./jerryscript/grammarinator/{uid}/
command=grammarinator-generate
--unlexer=./ecma_unparser/ECMAScriptUnlexer.py
--unparser=./ecma_unparser/ECMAScriptUnparser.py
--max-depth=20
--out=./fuzzgrammar/%d.js
-n=100
--population=./pop
--tree-transformers=grammarinator.runtime.simple_space_transformer
contents=False
# Test cases are defined here as file paths but they should be saved as content.
[sut.jerryscript]
call.decorate(11)=fuzzinator.call.FileReaderDecorator
Hi, you sould add to dependencies/requirements the oauth2client package.
Thanks.
Unsure what's going on - web interface returns 500. Backtrace in logs is:
fuzzer_1 | Uncaught exception GET /issues/60a2395c856c6217330862aa/report (192.168.10.14)
fuzzer_1 | HTTPServerRequest(protocol='http', host='localhost:8080', method='GET', uri='/issues/60a2395c856c6217330862aa/report', version='HTTP/1.1', remote_ip='192.168.10.14')
fuzzer_1 | Traceback (most recent call last):
fuzzer_1 | File "/jscfuzz/venv/lib/python3.7/site-packages/tornado/web.py", line 1702, in _execute
fuzzer_1 | result = method(*self.path_args, **self.path_kwargs)
fuzzer_1 | File "/jscfuzz/venv/lib/python3.7/site-packages/fuzzinator/ui/wui/ui_handlers.py", line 119, in get
fuzzer_1 | duplicates = tracker.find_issue(issue['id'])
fuzzer_1 | File "/jscfuzz/venv/lib/python3.7/site-packages/fuzzinator/tracker/gitlab.py", line 24, in find_issue
fuzzer_1 | 'url': issue.attributes['web_url']} for issue in issues]
fuzzer_1 | File "/jscfuzz/venv/lib/python3.7/site-packages/fuzzinator/tracker/gitlab.py", line 24, in <listcomp>
fuzzer_1 | 'url': issue.attributes['web_url']} for issue in issues]
fuzzer_1 | AttributeError: 'dict' object has no attribute 'attributes'
fuzzer_1 | 500 GET /issues/60a2395c856c6217330862aa/report (192.168.10.14) 285.30ms
Again - I will look into this soon.
Hi!
Great piece of software - I am evaluating fuzzinator to understand if we can use it as the fuzzing framework of the 32bits port of JSC at Igalia.
I am running into this error:
[14:36:55] fuzzinator.ui.cli.cli_listener warning():40 #41: Exception in <fuzzinator.job.validate_job.ValidateJob object at 0x7fd2002b8040>: 'id'
Traceback (most recent call last):
File "/home/pmatos/dev/fuzzinator/fuzzinator/controller.py", line 415, in _run_job
for issue in job.run():
File "/home/pmatos/dev/fuzzinator/fuzzinator/job/validate_job.py", line 29, in run
_, new_issues = self.validate()
File "/home/pmatos/dev/fuzzinator/fuzzinator/job/validate_job.py", line 43, in validate
if issue['id'] == self.issue['id'] and not self.issue.get('invalid'):
KeyError: 'id'
Also, and probably unrelated this line suspiciously looks like a debug line that should have been removed but never was.
fuzzinator/fuzzinator/job/validate_job.py
Line 42 in ed9df5f
Do you have any idea what could be triggering the above error?
Hi, renatahodovan, is it possible to run on Windows OS? or not, can you give me some advices for adjusting windows os?
thanks.
Good day,
I'm trying to test fuzzinator but I get this error after pip installing it and trying to run it:
Traceback (most recent call last): File "/usr/local/bin/fuzzinator", line 11, in <module> load_entry_point('fuzzinator==16.10', 'console_scripts', 'fuzzinator')() File "/usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 565, in load_entry_point return get_distribution(dist).load_entry_point(group, name) File "/usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 2631, in load_entry_point return ep.load() File "/usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 2291, in load return self.resolve() File "/usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 2297, in resolve module = __import__(self.module_name, fromlist=['__name__'], level=0) File "/usr/local/lib/python2.7/dist-packages/fuzzinator/__init__.py", line 8, in <module> from .controller import Controller File "/usr/local/lib/python2.7/dist-packages/fuzzinator/controller.py", line 21, in <module> from .mongo_driver import MongoDriver File "/usr/local/lib/python2.7/dist-packages/fuzzinator/mongo_driver.py", line 77 exec=0) ^ SyntaxError: invalid syntax
I have put 'alias python='python3.5' in my .bashrc so that the requirements of python 3.5 are fullfiled for fuzzinator. Could you assist?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.