sarahys / pymrio Goto Github PK

GLORIA, the new ICIO tables and FIGARO need to be added to the framework

we need to most include those databases in the download and in the parse function. '

1. Download

Example for the download function call for an existing database:
exio_downloadlog = pymrio.download_exiobase3(
storage_folder=exio3_folder, system="pxp", years=[2011, 2012]
)
We need a function to do this for GLORIA and one for FIGARO (these are new databases) and update the one for OECD.
GLORIA
The files to download live here:
https://www.dropbox.com/sh/o4fxq94n7grvdbk/AABiL3x3nzJh4iYzMdy88apFa/latest_release/057/GLORIA_MRIO_Loop057_part_I_MRIOdatabase?dl=0&subfolder_nav_tracking=1 (core accounts)
and https://www.dropbox.com/sh/o4fxq94n7grvdbk/AABvN65VjrYbyOa1aAkAJPzHa/latest_release/057/GLORIA_MRIO_Loop057_part_III_satelliteaccounts?dl=0&subfolder_nav_tracking=1 (satellite accounts)
https://www.dropbox.com/sh/o4fxq94n7grvdbk/AAAvqYty44k-0VoE87J1OQcba/latest_release?dl=0&preview=GLORIA_ReadMe_057.xlsx&subfolder_nav_tracking=1 (read-me contains the meta data)
we always need Markup001

and for Figaro:
https://ec.europa.eu/eurostat/web/esa-supply-use-input-tables/data/database
(input-output tables)

https://ec.europa.eu/eurostat/web/esa-supply-use-input-tables/data (here is an excel sheet with the lables)

for OECD ICIO
https://www.oecd.org/sti/ind/inter-country-input-output-tables.htm

2. Parse

Then we need to parse that data into the IO structure
like this: exio3 = pymrio.parse_exiobase3(path='/tmp/mrios/exio3/zip/exiobase3.4_iot_2009_pxp.zip')

The important parts are IO.Z, IO.Y and IO.impact and the meta data: country, sector/industry, stressor, final demand names

GLORIA

20230314_120secMother_AllCountries_002_T-Results_1990_057_Markup001(full).csv This file contains the data of variable T, in both rows and columns all index layer 0 and index layer 1 combinations occur twice, the first occurrence needs to be deleted so that we get to the matrix Z which needs to be stored in IO.Z

T
20230314_120secMother_AllCountries_002_Y-Results_1990_057_Markup001(full).csv contains IO.Y
20230314_120secMother_AllCountries_002_V-Results_1990_057_Markup001(full).csv contains the first part of IO.satellite
and ~20230310_120secMother_AllCountries_002_TQ-Results_1990_057_Markup001(full).csv and
20230310_120secMother_AllCountries_002_YQ-Results_1990_057_Markup001(full).csv contain the second part of IO.satellite

FIGARO
The figaro file contains both IO.Z and IO.Y in one matrix which can be identified by the labels, in the label file. We have not yet found the data for IO.satellite so no need here.