mparaz / parasports-data-import Goto Github PK

Exceptions is helpful to see if there's a pattern that might indicated
Missing items is helpful because it can indicate what items are missing, patterns of misspellings or wrong matches.

When loading from Excel sheets, the loaded data (item or statement) should be traceable back to the workbook, worksheet and column/row to make it easy to trace problems.

Statements currently don't support aliases, and only the primary name of an item. This is because aliases are not distinct and can possibly refer to the wrong item when a statement is created.

This can be improved by providing a way to disambiguate between items - through an interactive interface, or by providing a report that can be acted upon.

Apache POI is random access, allowing the code to read any cell from any worksheet.
This requires the import to read in the entire XLSX workbook which is considerable for larger sheets.

Instead, read CSV-formatted input which can be streamed in and processed line by line.
External tools are available to convert XLSX to CSV.

Reading the CSV should be supported from either local files, http URLs, or stdin.
This will allow the processing to be distributed.

Such as through findbugs.

Currently the credentials and the URL are hard-coded in the code. This was fine because it was only used my me, like a hacky script. With more people using this... not so much.

Such as through checkstyle.