Giter VIP home page Giter VIP logo

sisldm-isi's Introduction

Spacetime Separable Latent Diffusion Model with Intensity Structure Information for Precipitation Nowcasting

Abstract

The growing volume of meteorological data and advancements in computing performance have made the ap- plication of deep learning technology in short-term rainfall prediction crucial. However, existing learning approaches strug- gle to accurately predict detailed spatial location information, particularly obvious in predicting extreme rainfall events, leading to inadequate prediction accuracy and subpar performance in meteorological assessment indicators, limiting the effectiveness and applicability of deep learning models in rainfall prediction. To address these challenges, we propose a Spacetime Separable Latent Diffusion Model with Intensity Structure Information (SSLDM-ISI) to capture spatial and temporal information more efficiently. SSLDM-ISI incorporates two key strategies to solve the spatiotemporal information issue. First, a Spatiotemporal Conversion Block within the backbone network effectively ex- tracts and integrates spatiotemporal information. Second, our proposed latent space coding technique based on rainfall intensity structural information, enhances the information representation ability of extreme rainfall. In addition, an examination of the impact of various conditions is conducted on the prediction results to enhance the model’s prediction accuracy and stabil- ity. Through comparative analysis of meteorological evaluation and image quality evaluation indicators on two datasets, our proposed approach outperforms existing advanced technologies in short-term rainfall prediction, achieving current state-of-the- art results.

Spacetime Separable Latent Diffusion Model

Alt text

STC Block

Alt text

Pre-weight

pre-training you can find this address https://drive.google.com/file/d/1IJPlnGeL_JZbALS6Iidr0sylnlFsIhdQ/view?usp=drive_link

How to use?

cd SSLDM-ISI

you can run this demo to tran

python train.py

you can run this demo to sample

python sample.py

About the environment

There is no special environment, the only thing required is cuda>=11.7 torch>=1.13

To Do

  • Provide clean training code
  • Provide clean sampling code
  • Provide operating environment

sisldm-isi's People

Contributors

ybu-lxd avatar

Stargazers

 avatar  avatar

Watchers

 avatar

sisldm-isi's Issues

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.