Comments (4)
Hi,
Great! Build issues are very welcome. I'll fix soonish when I have spare time. My *BSD buildbots are currently offline, so might be that I haven't noticed some issue on BSDish platforms.
There have been many issues with unit tests on OSX due to minor differences in arguments etc. Might make sense to use the version of owl used for building also for sorting and echoing in tests.
from radamsa.
So the behavior is intended, because radamsa is supposed to pad the input with a low probability with random data, if the input is very short. This is done to improve coverage of test with tiny fixed inputs. The only issues is with OSX sort getting confused by non-textual data. This does not matter, because the tests are probabilistic and are expected to fail on occasion, in which case they are tried again many times before tests/run considers them to fail. Sort stderr is now piped to /dev/null, so it doesn't get in the way.
Does the build work otherwise on OSX?
from radamsa.
The only issues is with OSX sort getting confused by non-textual data.
Oh, I did not realize that the output was not representative of a failure. Sorry for the false alarm on those tests.
I've modified ab.sh as follows to determine why it is sometimes failing:
# check bad string insertion happens as intended (more likely within quoted area)
mkdir -p tmp
echo '-----------------------------------------------------------------""---------------------------------------------------------------------------' \
| $@ -m ab -p od -n 20 > tmp/ab.sh.tmp
cat tmp/ab.sh.tmp | grep -q '^-*\".*%.*\"-*$'
rc=$?
if [ $rc -ne 0 ]; then
echo "Unexpected output:"
cat tmp/ab.sh.tmp
exit 1
fi
Attached is one the output from one such test run which failed.
This does not matter, because the tests are probabilistic and are expected to fail on occasion, in which case they are tried again many times before tests/run considers them to fail.
When building Radamsa the unit tests automatically run. As unit tests may sporadically fail, could the unit tests be sectioned into their own make target (e.g. "make check") so that they do not run automatically? Otherwise, one may build Radamsa, see a failure, and wonder if the sporadic failure indicates an issue with Radamsa on one's platform.
Sure, I can understand that Radamsa, being probabilistic, may not always fuzz as expected. However, is it possible to modify the unit tests which may fail with some probability so that the tests will be more deterministic?
Does the build work otherwise on OSX?
Seems to work so far. I've not tried the TCP stuff yet, which looks interesting.
from radamsa.
Makes sense. There is now a separate test build target, which runs the tests if necessary. I also added a thanks-section to readme.md.
from radamsa.
Related Issues (20)
- add external contributions up to 0.4 to NEWS
- Internal compiler error HOT 3
- combining inputs? HOT 2
- Preseed mutations
- not possible to use system owl-lisp instead of downloading HOT 6
- Dialect and implementation of Scheme? HOT 1
- [QUESTION] Is it possible to use radamsa as a library? HOT 23
- Please make radamsa great again (building on Windows) HOT 6
- bug: not removing alarm on io error, if there HOT 4
- a unknown bug in network fuzzing time HOT 3
- question about radamsa using HOT 2
- check fd closing w/ uniqueness filter blocking
- Radamsa hang on linux and macOS HOT 4
- check sample file reads after eof
- cc: internal compiler error: Killed (program cc1) HOT 3
- flexible output generators HOT 1
- Selectable checksum algorithms and exposing the checksum in the output pattern HOT 1
- Can it be installed on a raspberry pi ? HOT 4
- Inconsistent output with the --seek option HOT 2
- amount of fuzzed objects differ from count parameter HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from radamsa.