Giter VIP home page Giter VIP logo

oceanhackathon2021_mappingbluecarbon's Introduction

Dataset Creation

The original dataset for this challenge contains images centered on latitude/longitude coordinates corresponding to empirically validated field sites for known blue carbon ecosystems curated from the literature and documented in this dataset. Train, validation, and test sets were chosen such that geographical regions in the validation and test sets are not represented in the training set. Images are 8-day true color RGB images from Jan 1-8, April 1-8, July 1-8, and Oct 1-8 for years 2020, 2019, and 2018, less those images with too much cloud cover (removed through manual inspection and retained in the folder called 'clouds' in the corresponding folder). Image dimensions are 224x224x3. Images are downloaded from the ORNL MODIS subsetting API.

ORNL MODIS subsetting API GetMODISImages

A big credit to Andrew Michaelis who helped me with the ORNL API, scripts here adapted from his repo. This is a simple script that will build a library of modis based images using Aqua Satellite product MYD09A1 for a set of target sites via ORNL’s modis subsetting api. Basic QC filtering is done and a gamma correction is applied to the images for better viewing.

See the sites.csv example for defining site targets. The headers etc need to match this format.

To add the python dependencies, a simple pip install can often work fine, e.g.:

$ pip3 install pandas requests Pillow scikit-image --user

Then run:

$ ./build_mod_imgs_rgbonly.py

Note, sites.csv must be in the working directory (see script) and outputs are placed in ./site-imgs/<site_tag>/<prod>_<latitude><longitude>_A<date>_rgb.png


Coastline image dataset

Coastline data was downloaded from NOAA GSHHG (https://www.ngdc.noaa.gov/mgg/shorelines/gshhs.html):

wget https://www.ngdc.noaa.gov/mgg/shorelines/data/gshhg/latest/gshhg-shp-2.3.7.zip

lat/lon coordinates were extracted from the shp file (see GetCoastlineCoordinates.ipynb), saved in coastal_boundaries_cruderes.csv, and images were downloaded with the ORNL API as for the labeled dataset above. Other resolutions are available - low, intermediate, high, full.

Pretrained model resources

There are a number of pretrained models trained on remote sensing data, see here.

Other resources

A description of the MODIS bands and products.

There is a MODIS cloud mask product that perhaps we can use to automate cloud cover QC

oceanhackathon2021_mappingbluecarbon's People

Contributors

ahoarfrost avatar avantishri avatar

Stargazers

 avatar  avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.