A tool to test the File Information Tool Set (FITS) against a test corpora. This tool will allow to pass a FITS implementation by argument and test it against a set of files, producing and report on Microsoft Excel format. Optionally, you can pass a ground truth file which will be used to validate the FITS output results in terms of mime type, puid and validation.

To build the application simply clone the project and execute the following Maven command: mvn clean package
The binary will appear at target/fits-testing-1.0-SNAPSHOT-jar-with-dependencies.jar

To see the usage options execute the command:

$ java -jar target/fits-testing-1.0-SNAPSHOT-jar-with-dependencies.jar -h
usage: report
 -d <arg>   directory with files to process
 -f <arg>   fits home
 -g <arg>   ground truth file
 -h         print this message
 -o <arg>   output file

To test a FITS against the included corpora, execute the following command:

$ java -jar target/fits-testing-1.0-SNAPSHOT-jar-with-dependencies.jar -d corpora/files/ -f ../fits-harvard-lts/ -g corpora/groundtruth.xls -o results/results-fits-harvard-lts.xls

Note that this command assumes you have downloaded the harvard-lts version of FITS into the parent folder.

These are test results that resulted from the execution of this tool against several FITS versions.

¹ Correct result is one that agrees with the ground truth, incorrect result is one that disagrees with the ground truth, and unknown result is one where FITS gives no answer.
² The validation depends on the identification process. A tool will try to validate a file against the format it has identified, so if the identification is wrong, the validation cannot be considered as correct. So we only count validations of correct identifications (of MIME type or PUID), but the result is divided by the total number of files. This is why the total number of correct, incorrect and unknown validations in not 100%.

Test date: 2013-11-01
Test environment:

• Processor: Intel® Core™ i5 CPU 650 @ 3.20GHz × 4
• Memory: 7.7 GiB
• Disk: Western Digital WD Black WD1002FAEX 1TB 7200 RPM 64MB Cache SATA 6.0Gb/s
• Operative system: Ubuntu 12.04.3 LTS
• Java virtual machine: OpenJDK 1.6.0_27

Corpora:

• Provided files with manually created ground truth
• 48 files
• Formats:
• Vector graphics: Adobe Illustrator, Corel Draw
• Text, spreadsheet and presentation: Microsoft Office and Libre Office
• Application data: Lotus Notes

This software is available under the LGPL version 3 license. All corpora was created specifically for this project and is available under the Creative Commons Attribution-ShareAlike 3.0 Unported License.