Giter VIP home page Giter VIP logo

antarcticrainforest / esm_analysis Goto Github PK

View Code? Open in Web Editor NEW
3.0 3.0 0.0 8.96 MB

Python 3 tools for distributed analysis and visualisation of big climate data on HPC systems.

Home Page: https://esm-analysis.readthedocs.io

License: BSD 3-Clause "New" or "Revised" License

Dockerfile 0.37% Makefile 0.69% Python 98.60% Shell 0.34%
climate-data xarray dask-distributed dask atmospheric-science ocean-sciences earth-sciences earthsystem

esm_analysis's Introduction

Build Status codecov Codacy Badge

Python 3 tools for reading, analysing net-cdf based climate data. esm_analysis stands for Earth System Model Analysis (Library)

Installing

The latest (master) version of the code can be installed using pip:

pip install git+https://github.com/antarcticrainforest/esm_analysis.git

The project is in alpha stage jet, there are many features missing and the ones that have been implemented have probably errors. Still, you're encouraged to report bugs or request new features.

Contributing

Tests

Tests can be run as follows:

python3 -m pytest -v

esm_analysis's People

Contributors

antarcticrainforest avatar

Stargazers

 avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

esm_analysis's Issues

speedup with xr.open_mfdataset kwargs

nice code base. will definitely try the MPICluster soon.

saw the benchmark that Bjorn mentioned in the julia mattermost group. I have a speedup suggestion:

xarray takes much time in coordinate checking which can be circumvented.

ds = xr.open_mfdataset(files, parallel=True, coords="minimal", data_vars="minimal", compat='override')

pydata/xarray#1823

My own example on mistral with smaller data: https://gitlab.dkrz.de/m300524/pymistral/-/blob/master/notebooks/read_netcdf_fast.ipynb

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.