Giter VIP home page Giter VIP logo

senetsnapsta's Introduction

Sen-Et SNAP standalone tool adapter

This repository contains the implementation of the Sen-ET SNAP standalone tool adapter

Sen-Et plugin

The Sen-Et plugin can be downloaded from the Sen-ET website (http://esa-sen4et.org/outputs/software).

Description

The purpose of the Sen-ET SNAP plugin is to enable estimation of actual evapotranspiration (and other land-surface energy fluxes) at field scale using Sentinel-2 (S2) and Sentinel-3 (S3) satellite observations as well as meteorological data available from Copernicus Climate Data Store. It was developed as part of the Sen-ET project (http://esa-sen4et.org/) and consists of open-source Python libraries and thin wrapper enabling execution from within SNAP graphical user interface (GUI).

Build the module

System Requirements

  • JDK 8
  • Maven 3

After having installed JDK and Maven, open a terminal, clone this repository, cd into it, and type maven clean package. On success, this command will generate a target folder which will contain all the .nbm files for each operator.

senetsnapsta's People

Contributors

panakouris avatar radosuav avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Forkers

solseyoum

senetsnapsta's Issues

No graphs found

Hi,
I installed SEN-ET as a plugin in SNAP and can download Data from Sentinel 2 and 3 and the required meteorological data with the respective operators. But when it comes to load the graphs I can´t find them anywhere within the SNAP Graph builder. Can You give an advice, please?
Best Regards
Rainer

crush QGIS

i use a grid to run the model for 1 month forcing data and after 2-3 hours of process it crushes and this error message appears
image

also the ram reaches 60GB usage

Download ERA5 reanalysis data issue

I would like to create daily ET on 12 August 2019. On the operator
"Download ECMWF ERA5 reanalysis data" I have chosen the same start -end date: 12 August 2019 but I found that same meteo variable were without values. When I have chosen star date=11 August, end date =12 August, I was able to proceed further.
Is my approach correct or I'm doing something wrong?
Thanks

download S3

Dear Sirs
I have always a connection problem to download S3 by SNAP,
would you please explain me how can I download S3 from COAH (product type instrument) because I have two different images
Thank you

(SL2_LST__) (SLSRT) is it OK?

Download ERA5 data problems - netCDF?

Why i can't download data as a form of Netcdf directly and I must provide a netcdf to download the Era5 data. It's illogical to me in this point. For that i must create a netcdf with all the variables and dimensions, but for example if i want to change the variables or dimensions to the next download I must create another Netcdf again. I really don't find the logic.

era52

Warp to template operator: error in output image...

Hi, thanks for the project http://esa-sen4et.org/

I testing your plugins in snap 7.0 in windows and ubuntu, but I have problems for the operator: Warp to template operator, this operator distorts the image changing the order of pixels:
error warp operator

this python results...:

C:\Users\ALVENI~1\AppData\Local\Temp>"C:\Users\alvenizpit\.snap\auxdata\sen-et-conda-Win64\sen-et-snap-scripts\\..\python.exe" "C:\Users\alvenizpit\.snap\auxdata\sen-et-conda-Win64\sen-et-snap-scripts\\warp_to_template.py" --resample_algorithm cubicspline --output "C:\Users\alvenizpit\Documents\Cathe Maestria\test\eldelcaso.dim" --source "C:\Users\alvenizpit\Documents\Cathe Maestria\anteproyecto\datos size 3 ete pc\S3a_20190104\!OUTPUT_observation_geometry!.dim" --template "C:\Users\alvenizpit\Documents\Cathe Maestria\anteproyecto\datos size 3 ete pc\s2a_20190104\!OUTPUT_SRTM_elevation!.dim" 
INFO: org.esa.snap.core.gpf.operators.tooladapter.ToolAdapterIO: Initializing external tool adapters
INFO: org.esa.snap.core.util.EngineVersionCheckActivator: Please check regularly for new updates for the best SNAP experience.
INFO: org.hsqldb.persist.Logger: dataFileCache open start
INFO: org.esa.snap.dataio.bigtiff.BigGeoTiffProductWriter: writing to output file C:\Users\ALVENI~1\AppData\Local\Temp\tmpvadbo3c8.tif
INFO: org.esa.snap.dataio.bigtiff.BigGeoTiffProductWriter: writing to output file C:\Users\ALVENI~1\AppData\Local\Temp\tmpvipat9y2.tif
Warning 1: TIFFReadDirectory:Sum of Photometric type-related color channels and ExtraSamples doesn't match SamplesPerPixel. Defining non-color channels as ExtraSamples.
Finished tool execution in 91 seconds

thank you...

Solution: Download sentinel data

If you are unable to download sentinel products using Download sentinel data, you must go to C:\Users\your_username\.snap\auxdata\sen-et-conda-Win64\sen-et-snap-scripts\find_sentinel_images.py and change the hub_address to hub_address="https://apihub.copernicus.eu/apihub/", on all functions!

Target product {fraction of Green]

Dear SIrs,
By using [estimate fraction of vegetation in green] what have I to write in target product name ? output image?
I write in target product " !OUTPUT_fraction_green_vegtation!"
I got wornning massage 'target product is required as adapter s templet, non is provided'
would you please explain what is the correct
Thank you so much

Download ERA5 reanalysis data error

When i try to download ERA5 reanalysis data using SEN-ET plugins i get this ERROR:Missing/incomplete configuration file: $USERPROFILE/.cdsapirc. I configured correctly the .cdsapirc file and tested with the associated python(see the image).era5

All it works fine, i downloaded some test data. But when i use it in SNAP all the time i get the error.
era523

What can it cause it because i am out of ideas?

Error in operator 3.3.7 Produce maps of vegetation structural parameters

Hi Radoslaw,
the following error apears, while processing operator 3.3.7:
"ERROR:K:\SEN-ET\Wernikow\20180726\Wernikow_OUTPUT_20180726_CCI_landcover.dim does not contain band CCILandCover-2015" but I created the landcover-Output before (step 3.3.4), however the band in the Output of 3.3.4 is called "land_cover_CCILandCover-2015".
Regards
Rainer

Download S2 Authontification issue

I keep getting HTTP status 401 Unauthorized even if my scihub.copernicus username and password are correct.

C:\Users\e806872\AppData\Local\Temp>"C:\Users\e806872.snap\auxdata\sen-et-conda-Win64\sen-et-snap-scripts\..\python.exe" "C:\Users\e806872.snap\auxdata\sen-et-conda-Win64\sen-et-snap-scripts\sentinel_data_download.py" --aoi_geojson "C:\Users\e806872\roi_geojson.geojson" --start_date 20190512 --end_date 20200610 --platform Sentinel-3 --download_path C:\Users\e806872 --username XXXX --password YYYYY --download_images false --cloud_cover_percentage 99 --limit_tiles $limit_tiles
Searching for scenes on https://scihub.copernicus.eu/apihub

HTTP status 401 Unauthorized:

HTTP Status 401 - Full authentication is required to access this resource

type Status report
message Full authentication is required to access this resource
description This request requires HTTP authentication.


Apache Tomcat/8.0.36

beginPosition:[2019-05-12T00:00:00Z TO 2020-06-10T23:59:59Z] filename:* instrumentshortname:SLSTR platformname:Sentinel-3 productlevel:L2 footprint:"Intersects(MULTIPOLYGON(((-74.1259 10.8227,-74.1297 10.8225,-74.1298 10.8215,-74.1305 10.8215,-74.1305 10.8216,-74.1306 10.8216,-74.1306 10.8217,-74.1308 10.8217,-74.1308 10.8219,-74.1314 10.8218,-74.1314 10.8227,-74.1340 10.8226,-74.1343 10.8219,-74.1358 10.8219,-74.1358 10.8212,-74.1371 10.8212,-74.1373 10.8213,-74.1372 10.8220,-74.1372 10.8222,-74.1373 10.8223,-74.1376 10.8224,-74.1378 10.8223,-74.1380 10.8223,-74.1381 10.8226,-74.1381 10.8228,-74.1380 10.8231,-74.1373 10.8230,-74.1369 10.8231,-74.1367 10.8231,-74.1366 10.8236,-74.1366 10.8237,-74.1366 10.8239,-74.1366 10.8241,-74.1365 10.8243,-74.1364 10.8245,-74.1363 10.8247,-74.1354 10.8247,-74.1353 10.8252,-74.1353 10.8254,-74.1351 10.8255,-74.1348 10.8255,-74.1346 10.8255,-74.1346 10.8263,-74.1363 10.8264,-74.1378 10.8264,-74.1379 10.8265,-74.1380 10.8265,-74.1382 10.8265,-74.1385 10.8265,-74.1387 10.8265,-74.1389 10.8264,-74.1391 10.8266,-74.1392 10.8269,-74.1393 10.8271,-74.1391 10.8272,-74.1385 10.8273,-74.1383 10.8274,-74.1379 10.8275,-74.1376 10.8276,-74.1372 10.8276,-74.1367 10.8277,-74.1362 10.8277,-74.1357 10.8276,-74.1352 10.8276,-74.1350 10.8274,-74.1348 10.8272,-74.1347 10.8271,-74.1344 10.8272,-74.1342 10.8271,-74.1338 10.8271,-74.1336 10.8272,-74.1334 10.8273,-74.1332 10.8274,-74.1330 10.8276,-74.1329 10.8275,-74.1326 10.8278,-74.1325 10.8287,-74.1329 10.8292,-74.1329 10.8293,-74.1332 10.8295,-74.1331 10.8296,-74.1329 10.8299,-74.1326 10.8300,-74.1325 10.8301,-74.1325 10.8303,-74.1325 10.8304,-74.1324 10.8307,-74.1325 10.8309,-74.1324 10.8311,-74.1322 10.8312,-74.1321 10.8313,-74.1320 10.8313,-74.1318 10.8313,-74.1318 10.8314,-74.1307 10.8314,-74.1296 10.8314,-74.1291 10.8314,-74.1287 10.8314,-74.1282 10.8314,-74.1278 10.8313,-74.1276 10.8313,-74.1269 10.8312,-74.1266 10.8311,-74.1262 10.8312,-74.1256 10.8312,-74.1251 10.8311,-74.1246 10.8310,-74.1242 10.8308,-74.1238 10.8307,-74.1235 10.8302,-74.1232 10.8295,-74.1232 10.8294,-74.1231 10.8291,-74.1227 10.8278,-74.1221 10.8255,-74.1213 10.8231,-74.1215 10.8229,-74.1217 10.8229,-74.1217 10.8228,-74.1212 10.8213,-74.1215 10.8213,-74.1210 10.8208,-74.1206 10.8201,-74.1205 10.8198,-74.1196 10.8188,-74.1191 10.8185,-74.1186 10.8181,-74.1183 10.8177,-74.1179 10.8170,-74.1178 10.8161,-74.1203 10.8162,-74.1206 10.8169,-74.1206 10.8173,-74.1209 10.8173,-74.1213 10.8173,-74.1218 10.8173,-74.1220 10.8173,-74.1236 10.8171,-74.1240 10.8182,-74.1245 10.8190,-74.1247 10.8211,-74.1254 10.8211,-74.1255 10.8211,-74.1257 10.8213,-74.1259 10.8216,-74.1259 10.8227))))"
Found 0 scenes
Finished tool execution in 0 seconds

S3 Preprocessing

When I opened S3 image in snap, I can not see sat_zenith_tn,
solar_zenith bands. So , how will I get these bands in observation_geometry product?
Screenshot from 2020-07-02 16-42-16

cant download data

i m trying to download data, i use a 4326 projected geojson file, and 0 scene found

image

Error by download fro sentenil

Dear Sirs
I start to use sen-et in SNAP
by downloading the images I got the following error :
ERROR:'charmap' codec can't decode byte 0x81 in position 285: character maps to
Finished tool execution in 0 seconds
would you please help yo solve the problem of error?
Thank you

Unrealistic values and curios pattern in map of daily evapotranspiration

Hello alltogether, due to Your helpfull support, I could create some maps of ETd for landscapes in the eastern part of Germany with SEN-ET. It´s not simple, but totaly interesting to use! However, when I look at the values of the ETd sometimes it is curios, because they can apear in a range from below 0 (e.g. -7.5 mm to more than 10 mm (e.g. 12.4), which is not realistic (see in the first screen shot). Additionally sometimes a pattern of rectangle tiles is visible in the Output of the 'Sharpen LST' - operator. That pattern also appears in the ETd map (see in the second screeshot). Do You have an idea why this pattern appears? And what might be the reason for the unrealistic ETd values below 0?

SEN-ET_Example_ETd

grafik

Error message when I'm trying to work with local meteorological data

I want to work with local meteorological data. I have created the *nc file with the same variables as ERA5 reanalysis but when I proceed to the next step "Prepare ERA5 reanalysis surface meteorological data I get an error message "unsupported operand type for: "float" and "NoneType". Please see the the attached image.
Any help would be greatly appreciated. Thanks!
error_WRF

Segmentation Fault in Fraction of Green Vegetation estimation.

I have completed S2 and S3 processing as far the Following link:

https://github.com/DHI-GRAS/sen-et-snap-scripts/blob/master/auxdata/graphs/

Then calculated Leaf reflectance and Transmittance. But when I am running Fraction of Green Vegetation estimation , I am getting "Segmentation fault" error. I have tried with altering minimum fraction of vegetation which is green, but got the same error again and again.

Screenshot from 2021-08-27 10-22-48

Screenshot from 2021-08-27 10-22-59

How to overcome this error?

Problem with Estimate land surface energy fluxes operator (3.3.16)

Hi,
I tried to process step 3.3.16 but unfortunately got an error, which I don´t understand.... Can anyone give an advice how to solve this, please?
Best Regards,
Rainer

Here´s a screenshot of the execution output:
grafik

...and here´s a screenshot of the I/O Parameters:
grafik

Problem with downloading Sentinel 3 SLSTR data

Me again, sorry. I have issues also when I try to download Sentinel 3 SLSTR data. This time I don't get any errors just the message that none scenes were found (search date stretches for 3 months and nada). I knew that S3 data were ingested in Pre-Operational Hub till last year but that changed now and it's full in Scihub. I am guessing that the problem might be with the sentinelsat api or I can't figure it right now.Also my OS is Windows 10. (I also attached a picture to be more specific) I
git

error by download S2

Dear Sirs,
when I start to download S2 I got the following massage :
ERROR:HTTPSConnectionPool(host='scihub.copernicus.eu', port=443): Max retries exceeded with url: /apihub/search?format=json&rows=100&start=0 (Caused by SSLError(SSLError("bad handshake: Error([('SSL routines', 'tls_process_server_certificate', 'certificate verify failed')],)",),))
would you please help me to correct the error
Thank you

ModuleNotFoundError: No module named 'jpyutil'

Hi,

once again I have a problem, to get it running properly: it´s the Import-error, that You described in chapter 3.4.4.

" import jpyutil
ModuleNotFoundError: No module named 'jpyutil'"

I tried different versions of python (3.6.0, 3.6.8) and configured SNAP to use with Python but it´s always the same.

Best regards
Rainer

Error when using Graph (sentinel_2_pre_processing.xml)

I am trying to run the SEN-ET plugin with a Sentinel-2 product that I downloaded from Creodias.
When I use the sentinel_2_pre_processing.xml graph I get the following error:
Error: org.esa.snap.core.gpf.graph.GraphException

Untitled

Do you know the solution for this error? Thank you

Error in Sentinel 3 pre-processing graph?

Hi - once again,

I´d like to pre-process a Sentinel 3-file with the corresponding graph. However an error occurs: "Undefined symbol 'cloud_in'". I did not make any changes to the Sentinel 3 file before, the file was downloaded by using the 'Download sentinel data' - operator.

SNAP_Sen3_preprocessing

Regards,
Rainer

Missing/incomplete configuration file

getting below error while downloading ERA5 dataset in .cdsapirc file.
and my format of .cdsapirc file is as below.
url: {api-url}
key: {uid}:{api-key}
p1
p2
p3

please help me reslove this issue

Bundle installation failed

Dear Sirs,
I start to use Sen_et aftel install plugin in SNAP
the first step download sentinel data I got a massage ( Bundle installation failed)
would you please help me
Thank you

Produce maps of vegetation structural parameters

Dear SIrs,
I try to produce maps of vegetation structural parameters but no response
my data work is as folllow
![map_ver_3](https://user-ima
map_ver_1
map_ver_2

ges.githubusercontent.com/43352074/85434527-d9116200-b58e-11ea-9ced-57796a946bde.png)

I change the band name as in image but no sccess

would u please help me
thank you

operator 3.3.15 Estimate net shortwave radiation operator not found layer "solar_zenith_tn"

Error in operator 3.3.15 "Estimate net shortwave radiation operator" not found layer "solar_zenith_tn".

The preprocessing graph of Sentinel-2 output the image "!OUTPUT_sun_zenith_angle!.dim" with band "sun_zenith", and the operator 3.3.15 expected the name band "solar_zenith_th".

I change the name of band in the "!OUTPUT_sun_zenith_angle!.dim" image and the operator its works, but this is the band correct?, or any problem in preprocessing graph of Sentinel-2.

thanks

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.