Giter VIP home page Giter VIP logo

energy-data's Introduction

Data on Energy by Our World in Data

Our complete Energy dataset is a collection of key metrics maintained by Our World in Data. It is updated regularly and includes data on energy consumption (primary energy, per capita, and growth rates), energy mix, electricity mix and other relevant metrics.

The complete Our World in Data Energy dataset

🗂️ Download our complete Energy dataset : CSV | XLSX | JSON

The CSV and XLSX files follow a format of 1 row per location and year. The JSON version is split by country, with an array of yearly records.

The indicators represent all of our main data related to energy consumption, energy mix, electricity mix as well as other indicators of potential interest.

We will continue to publish updated data on energy as it becomes available. Most metrics are published on an annual basis.

A full codebook is made available, with a description and source for each indicator in the dataset. This codebook is also included as an additional sheet in the XLSX file.

Our source data and code

The dataset is built upon a number of datasets and processing steps:

Additionally, to construct region aggregates and indicators per capita and per GDP, we use the following datasets and processing steps:

Changelog

  • On August 30, 2024:
    • Fixed coal electricity generation for Switzerland, which was missing in the original data, and should be zero instead.
  • On June 20, 2024:
    • Updated the Energy Institute Statistical Review of World Energy.
    • Fixed issues on electricity data for aggregate regions.
  • On May 8, 2024:
    • Updated Ember's yearly electricity data, which includes data for 2023.
    • Updated GDP data, now coming from Maddison Project Database 2023.
  • On January 24, 2024:
    • Improved codebook, to clarify whether indicators refer to electricity generation or primary energy consumption.
    • Improved the calculation of the share of electricity in primary energy. Previously, electricity generation was calculated as a share of input-equivalent primary energy consumption. Now it is calculated as a share of direct primary energy consumption.
  • On December 12, 2023:
    • Updated Ember's yearly electricity data and EIA's International energy data.
    • Enhanced codebook (improved descriptions, added units, updated sources).
    • Fixed various minor issues.
  • On July 7, 2023:
    • Replaced BP's data by the new Energy Institute Statistical Review of World Energy 2023.
    • Updated Ember's yearly electricity data.
    • Updated all datasets accordingly.
  • On June 1, 2023:
    • Updated Ember's yearly electricity data.
    • Renamed countries 'East Timor' and 'Faroe Islands', and added 'Middle East (Ember)'.
    • Population and per capita indicators are now calculated using an updated version of our population dataset.
  • On March 1, 2023:
    • Updated Ember's yearly electricity data and fixed some minor issues.
  • On December 30, 2022:
    • Fixed some minor issues with BP's dataset. Regions like "Other North America (BP)" have been removed from the data, since, in the original Statistical Review of World Energy, these regions represented different sets of countries for different indicators.
  • On December 16, 2022:
    • The column electricity_share_energy (electricity as a share of primary energy) was added to the dataset.
    • Fixed some minor inconsistencies in electricity data between Ember and BP, by prioritizing data from Ember.
    • Updated Ember's yearly electricity data.
  • On August 9, 2022:
    • All inconsistencies due to different definitions of regions among different datasets (especially Europe) have been fixed.
      • Now all regions follow Our World in Data's definitions.
      • We also include data for regions as defined in the original datasets; for example, Europe (BP) corresponds to Europe as defined by BP.
    • All data processing now occurs outside this repository; the code has been migrated to be part of the etl repository.
    • Indicator fossil_cons_per_capita has been renamed fossil_elec_per_capita for consistency, since it corresponds to electricity generation.
    • The codebook has been updated following these changes.
  • On April 8, 2022:
    • Electricity data from Ember was updated (using the Global Electricity Review 2022).
    • Data on greenhouse-gas emissions in electricity generation was added (greenhouse_gas_emissions).
    • Data on emissions intensity is now provided for most countries in the world.
  • On March 25, 2022:
    • Data on net electricity imports and electricity demand was added.
    • BP data was updated (using the Statistical Review of the World Energy 2021).
    • Maddison data on GDP was updated (using the Maddison Project Database 2020).
    • EIA data on primary energy consumption was included in the dataset.
    • Some issues in the dataset were corrected (for example some missing data in production by fossil fuels).
  • On February 14, 2022:
    • Some issues were corrected in the electricity data, and the energy dataset was updated accordingly.
    • The json and xlsx dataset files were removed from GitHub in favor of an external storage service, to keep this repository at a reasonable size.
    • The carbon_intensity_elec column was added back into the energy dataset.
  • On February 3, 2022, we updated the Ember global electricity data, combined with the European Electricity Review from Ember.
    • The carbon_intensity_elec column was removed from the energy dataset (since no updated data was available).
    • Columns for electricity from other renewable sources excluding bioenergy were added (namely other_renewables_elec_per_capita_exc_biofuel, and other_renewables_share_elec_exc_biofuel).
    • Certain countries and regions have been removed from the dataset, because we identified significant inconsistencies in the original data.
  • On March 31, 2021, we updated 2020 electricity mix data.
  • On September 9, 2020, the first version of this dataset was made available.

Data alterations

  • We standardize names of countries and regions. Since the names of countries and regions are different in different data sources, we harmonize all names to the Our World in Data standard entity names.
  • We create aggregate data for regions (e.g. Africa, Europe, etc.). Since regions are defined differently by our sources, we create our own aggregates following Our World in Data region definitions.
    • We also include data for regions as defined in the original datasets; for example, Europe (EI) corresponds to Europe as defined by the Energy Institute.
  • We recalculate primary energy in terawatt-hours. The primary data sources on energy—the Energy Institute Statistical review of world energy, for example—typically report consumption in terms of exajoules. We have recalculated these figures as terawatt-hours using a conversion factor of 277.8.
  • We calculate per capita figures. All of our per capita figures are calculated from our population metric, which is included in the complete dataset.
    • We also calculate energy consumption per gdp, and include the corresponding gdp metric used in the calculation as part of the dataset.
  • We remove inconsistent data. Certain data points have been removed because their original data presented anomalies. They may be included again in further data releases if the anomalies are amended.

License

All visualizations, data, and code produced by Our World in Data are completely open access under the Creative Commons BY license. You have the permission to use, distribute, and reproduce these in any medium, provided the source and authors are credited.

The data produced by third parties and made available by Our World in Data is subject to the license terms from the original third-party authors. We will always indicate the original source of the data in our database, and you should always check the license of any such third-party data before use.

Authors

This data has been collected, aggregated, and documented by Hannah Ritchie, Pablo Rosado, Edouard Mathieu, Max Roser.

Our World in Data makes data and research on the world’s largest problems understandable and accessible. Read more about our mission.

How to cite this data?

If you are using this dataset, please cite both Our World in Data and the underlying data source(s).

Please follow the guidelines in our FAQ on how to cite our work.

energy-data's People

Contributors

bnjmacdonald avatar dominicwhite avatar edomt avatar hannahritchie avatar marigold avatar pabloarosado avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

energy-data's Issues

oil_electricity

Hi,
The values in the oil_electricity columns are oddly low, compared to other *_electricity columns. Are they true values?
Here is the case of United States in 2021.
year 2021.00
biofuel_electricity 54.25
coal_electricity 897.89
fossil_electricity 2512.45
gas_electricity 1579.36
hydro_electricity 246.47
low_carbon_electricity 1637.50
nuclear_electricity 778.19
oil_electricity 35.20
other_renewable_electricity 70.22
solar_electricity 164.42
wind_electricity 378.20

Contact

What will be the best way to contact you directly?

I have sent email to [email protected] and I havent heard back for about 10 days.

Need to discuss Potential Partnership

Indicators

Hi...
i realized that the population and biofuel_consumption of North America in 2021 is not equal to population of Canada/Mexico/United Sates combined.
i really wish if you can add column to the codebook (method) explaining the method of calculation (is sum or weighted average by column xx) etc. This would help us to understand how to calculate aggregates for certain group of countries concerned.
please advise

Missing regional aggregates

The raw data does not include values for South America, Oceania, Asia, North America. But the dashboard shows regional aggregates for some variables.

image

missing data

Hi!
First of all, thank you for providing these data, they are being very useful for my project!
I noticed that for some of the countries, like for instance for Switzerland in the case of share of electricity generation that comes from oil (column CM in the excel file "owid-energy-data"), this data is missing until the year of 2000.
I was wondering why, since all the data for the years before 2000 for this country are available.
Thank you in advance.
Lyubov

order of columns in codebook is different from order in database

(brand new to both github and data sharing, apologies for any stupidities)

I have made a small project based on this energy data, and am still in the middle of the project phase.

I re-downloaded the database, and noted the order of columns had changed in the database. (updated 220810). in my view, the new column ordering is an improvement over the previous.

However, the order of columns in the codebook is still as before the update.

It might be helpful to order the column descriptions in the codebook following the order in the database.

Carbon intensity of energy production figures compared to EEA, EPA numbers

Thank you so much for putting together this great database. We're trying to use your numbers for an open source blockchain carbon accounting system.

Could you explain how some of the numbers here are different than what we found from the EPA and EEA. For example, I'm looking at the carbon intensity of energy for India, Germany, and USA:
Screen Shot 2020-12-09 at 1 27 59 PM

This shows both Germany and USA at 0.21 kg/KWH of electricity.

The EEA publishes a statistic for all the EU countries: https://www.eea.europa.eu/data-and-maps/daviz/co2-emission-intensity-5

For Germany it has 440.8 g/kWH in 2016.

The EPA publishes an EGRID database (https://www.epa.gov/sites/production/files/2020-01/egrid2018_all_files.zip) and for 2018, the total of all USA utilities was 1,985,972,374 tons CO2e for 4,168,365,243 MWH of total electricity generated, or about 0.476 kG/KWH.

Thank you.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.