Giter VIP home page Giter VIP logo

capstone-landslides-soilmoisture's Introduction

DOI

capstone-landslides-soilmoisture project repository

Exploring patterns between soil moisture and rainfall during landslide events in the western US using satellite observations

Description

Landslide prediction is important. There are negative economic, transportation, and habitat impacts resulting from landslides. There are climate change implications where drought or heavier rains affect the number and severity of landslides. The goal of this project is to examine the relationship of soil moisture and precipitation over Colorado, USA. Colorado experiences many landslides each year because of its steep terrain. Some of them occur in remote areas that are difficult to monitor, with most occurring west of the Front Range. Damage from landslides in Colorado is estimated to be millions of dollars per year. A significant fraction of the Colorado population lives in the Rockies. It is also a popular tourist destination year-round and people are moving into the Rockies - it’s a popular area, to say the least.

cnn_newsarticle_glenspringsLandslideCO

Purpose

To address the need to improve our understanding of landslides caused by rainfall. To better characterize landslide properties by focussing the workflow on the state of Colorado as a case study region.

Contributions

  • Soil moisture can be a potential indicator of the type of rainfall induced landslide. We can use soil moisture data to group landslides into two types (1) shallow slope failures - saturation induced by rainfall infiltration and (2) run off driven landslides - triggered by intense storms. This informs the forecaster which models and precipitation products are optimal to use to better predict a landslide event.
  • Code presented here is helpful to those who want to know how to read/extract soil moisture parameters measured from NASA, USGS, and ESA satellites.
  • The workflow should perform with any state who's landslide data is archived in the NASA Global Landslide Catalog (GLC).

Python Packages Used

The following are python packages currently used to run the current list of jupyter notbooks in this repository.
  • os
  • glob
  • datetime
  • earthpy
  • geopandas
  • folium
  • h5py (pip install h5py)
  • matplotlib
  • numpy
  • pandas
  • re
  • rioxarray
  • scipy
  • seaborn
  • shapely
  • xarray

To install packages separately, using conda, type `conda install -c conda-forge name-of-package-listed-above`

Installing the capstone-landslides-soilmoisture Conda Environment

This repository contains a file called environment.yml that contains the python packages to install the capstone-landslides-soilmoisture environment. Included is installation of Jupyter notebook and it's dependencies.

  • Clone/Fork this repository.
  • Once you are in the capstone-landslides-soilmoisture directory, you can create the environment. To do this run: conda env create -f environment.yml.
  • Once the environment is installed you can activate it using: conda activate capstone-landslides-soilmoisture.
  • To view a list of all conda environments available on your machine run: conda info --envs.
  • To view a list of all conda packages installed in capstone-landslides-soilmoisture run: conda list.

Workflow

  • Soil moisture and precipitation satellite data are co-located with 2015-2020 landslide events in Colorado and other US states affected by landslides using the Global Landslide Catalog (GLC) (refer to "Data & Formats" below).
  • CSV files have been created and stored in the data directory that ties all the various soil and precipitation data together and can be read using the pandas package.
  • If users simply want to work with the analysis portion, the can clone this repo and work with the CSV data files contained in the data folder

Python Notebooks can be run in the following order:

  1. capstone-study-area-final.ipynb

    • An introduction the study region and GLC statistics over Colorado.
  2. landslide_precip_soilm_DataExport_final.ipynb

    • Co-located SMAP and ESA CCI soil moistures with GPM precipitation products (daily and 30 min resolutions)

    • Data Directories

      • To run landslide_precip_soilm_DataExport_final.ipynb notebook, you need to download daily 2015-2020 data listed in the "Data & Formats" section below.
      • Note: The data files are large, particularly for SMAP which ignore subsetting.
      • Links to the data and instructions on what specifically to download are provided used in this study are provided in the "Data & Formats" section below
    • Data directory structure under your home space (Mac/Linux syntax shown below)

      • GLC data directory: earth-analytics/data/capstone/landslide
      • GPM daily precipitation directory: earth-analytics/data/capstone/gpm_westernUS
      • GPM IMERG 30min precipitation directory: earth-analytics/data/capstone/precip_imerg
      • SMAP daily soil moisture directory: earth-analytics/data/capstone/smap_9km
      • ESA CCI soil moisture directory: earth-analytics/data/capstone/esa_soil_moisture
    • Users can choose a US state where landslides are archived in the GLC. Currently, the following states are included:

      • Colorado
      • Idaho
      • Utah
      • California
      • Oregon
      • Washington
    • The result are two a pandas dataFrames that are exported as CSV files to the data folder. For example,

      • glc_smap_esa_gpm_2015-2020_Colorado.csv contains the 7-day accummulated precipitation and maximum soil moisture co-located to a GLC landslide.

      • glc_smap_esa_gpm_2015-2020_7day_Colorado.csv contains the precipitation and soil moisture co-located to a GLC landslide going back for 7-days prior to the landslide.

  3. landslide_precip_soilm_DataAnalyses_final.ipynb

    • Plot analysis that reads the exported CSV files created by landslide_precip_soilm_DataExport_final.ipynb above.
    • Output are plots inline with the notebooks. Noteworthy plots are exported as PNG files saved under the plots folder.

Data & Formats

  1. NASA Global Landslide Catalog (2007-2020)
  2. NASA SMAP Enhanced L3 Radiometer Global Daily 9 km EASE-Grid Soil Moisture V004
  3. ESA Climate Change Initiative (CCI) ACTIVE soil moisture 0.25 degree x 0.25 degree V03.3
  4. GPM IMERG Late Precipitation L3 1 day 0.1 degree x 0.1 degree V06
  5. GPM IMERG Final Precipitation L3 Half Hourly 0.1 degree x 0.1 degree V06
    • This capstone uses 30 min GPM IMERG data pre-assembled and saved in CSV format by Dr. Elsa Culler (CU-Boulder). The beauty of this data set is that precipitation values have been subset and co-located with GLC landslides by their ID, latitude, and longitude.
    • Instructions: Request this data set by emailing [email protected]
    • Citation: https://doi.org/10.5067/GPM/IMERG/3B-HH/06
    • Format: CSV format
  6. POLARIS 30m Probabilistic Soil Properties US

capstone-landslides-soilmoisture's People

Contributors

jacquiewitte avatar

Stargazers

 avatar

Watchers

Elsa Culler avatar  avatar

capstone-landslides-soilmoisture's Issues

SMAP lat/lon errors

I'm having trouble with the longitude and latitude numpy arrays - but not the soil moisture array. It giving the following error when I try do to anything with it like

sm_lon[sm_lon == -9999.0] = np.nan
OSError: Can't write data (no write intent on file)  

However, I can perform that same commands on the soil moisture data. Why is lat/ the exception? I read it exactly in the same way I read soil moisture.
 
Because of this, I am stalled to isolate just the Colorado region. I was planning to use the following code Reference

box_lat = [36.992426, 41.003444]
box_lon = [-109.060253, -102.041524]

lat_index = np.logical_and(sm_lat > box_lat[0], sm_lat < box_lat[1])
lon_index = np.logical_and(sm_lon > box_lon[0], sm_lon < box_lon[1])
box_index = np.logical_and(lat_index, lon_index)
data = sm_data[box_index]

SMAP authentication issues

I have recently learned SMAP data can be subsetted and will provide files only if there is data in the Colorado domain. This is great however I'm having authentication issues and there are about 630 subsetted data files I can download. I'll have to look into this further because I don't want to download files manually.

Plotting with xarray

How do I change the x-axis to read from -30 to 0 instead of the dates. I can't find any resources online. It seems xarray plotting is hard wired to plot the date attribute on the x-axis

Screen Shot 2022-04-20 at 5 03 05 PM

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.