tdwg / bii Goto Github PK

Currently, the CSV files have carriage returns in some fields, which results in invalid CSVs (to many rows, shifted columns). I'll load the SQL in a local MySQL database and try to generate valid CSV outputs.

It looks like "Biodiversity Information Networks Database" is a predecessor of "Biodiversity Information Projects of the World". The latter contains more fields, records and similar entries. The Canadensys network for example is present in both:

• http://www.tdwg.org/biodiv-networks/networks-database/view-project/53/
• http://www.tdwg.org/biodiv-projects/projects-database/view-project/1742/

@sblum Is that true? What is the difference between both DBs? Can we merge them?

The content of the CSV exports are (probably) the same, with 147 lines:

• https://github.com/tdwg/bii/blob/master/mysql_dump/tx_tdwgbiodivprojects_networks.csv
• https://github.com/tdwg/bii/blob/master/mysql_dump/tx_tdwgbiodivprojects_projects.csv

The second file should contain many more records. @sblum can you export that part again?

Information could be taken from http://www.tdwg.org/biodiv-networks/ and http://www.tdwg.org/biodiv-projects/, but should probably be merged and updated.

Would also be good to add a citation.

There seems to be a character encoding issue in the mysql_dump, that is probably present in the source database, e.g. see Key inputs for this record:

Funding has been provided by CONABIO (Comisión Nacional para el Conocimiento y Uso de la Biodiversidad), SEMARNAT (Secretaría de Medio Ambiente y Recursos Naturales) and the Colegio de Postgraduados.

@mdoering, is this something that can be solved in the mysql_dump?