yumorishita / licsbas2 Goto Github PK

yumorishita/LiCSBAS#228
yumorishita/LiCSBAS#224
yumorishita/LiCSBAS#219

Hello
When I use LiCSBAS_cum2vel.py and put the start and end dates of the whole network, the results should be the same as results/vel.filt.mskd and results/vstd?
To me they are not exactly the same and slightly different.

Hello
When using LiCSBAS_decomposeLOS.py, shouldn't U.geo be used instead of N.geo?

 -f  Text file containing input GeoTIFF file paths of LOS displacement
     (or velocity) and E and N components of LOS unit vector from >=2 directions
     Note: GeoTIFF files can be created by LiCSBAS_flt2geotiff.py
     Format:
         dispfile1 Efile1 Nfile1
         dispfile2 Efile2 Nfile2
         ...

Thank you once again for LiCSBAS!
My issue is that the run remains appended at step 16 (see screenshot and log file). Is it due to not enough RAM (48gb) or what? I am trying to analyze a full frame.
Is it still possible to use the results from step 15? LiCSBAS_plot_ts.py returns an error: "Unable to open object (object 'vel' doesn't exist)".

202307191352batch_LiCSBAS_01_16.log

Hello, thank you for the Licsbas program you developed. The displacements output from Licsbas does not match that from Gnss. Which parameter should we adjust in Licsbas to align them?

LiCSBAS_plot_ts.py ver1.14.0 20230219 Y. Morishita
LiCSBAS_plot_ts.py -i cum.h5

Reading cum.h5
Reading mask
Traceback (most recent call last):
File "/home/morishita/software/LiCSBAS2/bin/LiCSBAS_plot_ts.py", line 408, in
mask_vel = cumh5['mask'][()]
~~~~~^^^^^^^^
File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
File "/home/morishita/software/pyenv/versions/licsbas2-3.11/lib/python3.11/site-packages/h5py/_hl/group.py", line 328, in getitem
oid = h5o.open(self.id, self._e(name), lapl=self._lapl)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
File "h5py/h5o.pyx", line 190, in h5py.h5o.open
KeyError: "Unable to open object (object 'mask' doesn't exist)"

Hi @yumorishita

I have maybe a dumb question I try to find what is the the step to put a reference point, stable along the subsidence how the reference point is calculate / map in the LiCSBAS process ?

I think I couldn't find where is it explained.

Wish you all the best,
Clément

" ValueError: A colormap named "SCM.roma0" is already registered"

yumorishita/LiCSBAS#176 (comment)
yumorishita/LiCSBAS#195 (comment)
yumorishita/LiCSBAS#198

Hello sir
I used LiCSBAS before, now I want to use this on my new Linux and I want to install LiCSBAS2 (because yumorishita/LiCSBAS#202 (comment)).
How do I do this?
I already installed LiCSBAS with the help of wiki but this one doesn't have a wiki. Is it the same?

Currently, the reference point is first selected and the displacement is all zero, but some users don't understand why the displacement is zero. Maybe good to set the point that has max velocity.

Hi, I want to ask about the velocity results that I got, the majority of the AOI experienced upfilt. My research area is on the mainland, is it possible to experience a very massive uplift? The research year is from 2014-2023, could a research period that is too long affect the results? Are there any parameters that need to be adjusted so that the results can be maximized?

Hello Mr. Yumorishita, I've been processing frame 025A_09718_120810 within the timeframe from December 18, 2014, to December 31, 2023. I've processed this data multiple times, but the process always gets stuck at the GEOCml1 process for 4 hours. Could you help me with this issue? Thank you.

Sincerely, Gagah Agung.
202405031029batch_LiCSBAS_01_16.log

Dear Yumorishita,

I had a interrogation about the data which i extract from my result file. I wanted to put the subsidence in a area in mm/year so I did the following command to get the tiff :
LiCSBAS_flt2geotiff.py -i TS_GEOCml1GACOSmaskclip/results/vel -p TS_GEOCml1GACOSmaskclip/info/EQA.dem_par

Because the vel.png show me as well a displacement by year.

But in QGIS with the tiff file it seems I have the same map as this one :

As I understant it's the velocity from the reference date and not a displacement by year.

Compared to this picture which is the displacement every year (the one who interrested me)

What is the input i need in the LiCSBAS_flt2geotiff ?

I wish you a great day.
Clément

Dear Morishita,

running batch_LiCSBAS.sh, I have the following error:

I understand the problem, but I do not see how to overcome it, and I do not understand why there is this problem?
To note: when downloading the files from the COMET website, there has been several "unw" files not downloaded:

I don't know if it can be linked?

I thank you in advance for your help.

Hello Mr. Morishita, I am looking to reprocess my data, specifically the frame with ID 025A_09718_120810. However, I encountered the following error:

(licsbas) gagahap@HP:/mnt/c/frame/cb_1$ ./batch_LiCSBAS.sh

Start step: 01
End step: 16
Log file: log/202406050906batch_LiCSBAS_01_16.log

LiCSBAS01_get_geotiff.py ver1.6.4 20230215 Y. Morishita
LiCSBAS01_get_geotiff.py -f 025A_09718_120810 -s 20141218 -e 20231231 --get_gacos

Frame ID is 025A_09718_120810

025A_09718_120810.geo.E.tif already exist. Skip download.
025A_09718_120810.geo.N.tif already exist. Skip download.
025A_09718_120810.geo.U.tif already exist. Skip download.
025A_09718_120810.geo.hgt.tif already exist. Skip download.

Download baselines
baselines, 5.42KB, 1s, 5.42KB/s
Download network.png
network.png, 700.63KB, 4s, 175.16KB/s
Download metadata.txt
metadata.txt, 244.0B, 1s, 244.0B/s

Searching latest epoch for mli...
Traceback (most recent call last):
File "/home/gagahap/LiCSBAS2/bin/LiCSBAS01_get_geotiff.py", line 500, in
sys.exit(main())
^^^^^^
File "/home/gagahap/LiCSBAS2/bin/LiCSBAS01_get_geotiff.py", line 213, in main
response = requests.get(url)
^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/sessions.py", line 725, in send
history = [resp for resp in gen]
^^^^^^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/sessions.py", line 191, in resolve_redirects
raise TooManyRedirects(
requests.exceptions.TooManyRedirects: Exceeded 30 redirects.

Can you help me to resolving this error? I have attached the log file below. Thank you, sir.

202406050906batch_LiCSBAS_01_16.log

LiCSBAS_plot_ts.py:734: MatplotlibDeprecationWarning: Setting data with a non sequence type is deprecated since 3.7 and will be remove two minor releases later
pax2.set_data(jj, ii)

Hello
Thank you for your good software.
I wanted to ask a question, what data did you use (https://terras.gsi.go.jp/)? I downloaded the coordinates_R3 data, but the list of coordinates is in the ITRF 2005 system, how to convert it in the utm wgs 84 system?

LiCSBAS_plot_ts.py ver1.14.0 20230219 Y. Morishita
LiCSBAS_plot_ts.py -i TS_GEOC_CACOS/cum_filt.h5

Reading TS_GEOC_CACOS/cum_filt.h5
Reading TS_GEOC_CACOS/cum.h5 as 2nd
Reading mask
Reading mask
Reading coh_avg
Reading n_unw
Reading vstd
Reading maxTlen
Reading n_gap
Reading stc
Reading n_ifg_noloop
Reading n_loop_err
Reading resid_rms
Reading slc.mli
Reading hgt
/mnt/rfchen/LiCSBAS2-master/LiCSBAS2-master/bin/LiCSBAS_plot_ts.py:734: MatplotlibDeprecationWarning: Setting data with a non sequence type is deprecated since 3.7 and will be remove two minor releases later
pax2.set_data(jj, ii)
How should I solve this problem?

Processing stops in step 12, returns IndexError: index 0 is out of bounds for axis 0 with size 0
LiCSBAS12_loop_closure.py", line 397

log file attached

202310161537batch_LiCSBAS_11_16.log

Everyone suddenly started facing the error below. This does not seem to be a temporary issue. Perhaps the site access policy was recently changed.

Searching latest epoch for mli...
Traceback (most recent call last):
File "/home/gagahap/LiCSBAS2/bin/LiCSBAS01_get_geotiff.py", line 500, in
sys.exit(main())
^^^^^^
File "/home/gagahap/LiCSBAS2/bin/LiCSBAS01_get_geotiff.py", line 213, in main
response = requests.get(url)
^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/sessions.py", line 725, in send
history = [resp for resp in gen]
^^^^^^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/sessions.py", line 191, in resolve_redirects
raise TooManyRedirects(
requests.exceptions.TooManyRedirects: Exceeded 30 redirects.

yumorishita/LiCSBAS#364 (comment)
#53
yumorishita/LiCSBAS#367
yumorishita/LiCSBAS#366

Hi @yumorishita

I've read your latest paper (2023) and it would be good to put the paper in your GitHub (LiCSBAS2) as a reference.
Anyway, how to generate a cumulative displacement map (geotiff) ? may be I missed this step.

Hi all,
How can I set path for LiCSBAS commands?
I faced this error:

Check LiCSBAS commands
  ERROR: PATH is not set to LiCSBAS commands

I am using anaconda in windows 11.

Hi, has anyone experienced a ValueError on the number of processes for step 12?

Got the message below:

LiCSBAS12_loop_closure.py ver1.6.2 20230822 Y. Morishita
LiCSBAS12_loop_closure.py -d GEOCml1clip -l 2 --multi_prime

loop_thre : 2.0 rad

1st Loop closure check and make png for all possible 0 loops,
with 0 parallel processing...
Traceback (most recent call last):
File "/home/user/LiCSBAS/LiCSBAS2/bin/LiCSBAS12_loop_closure.py", line 890, in
sys.exit(main())
File "/home/user/LiCSBAS/LiCSBAS2/bin/LiCSBAS12_loop_closure.py", line 302, in main
p = q.Pool(_n_para)
File "/usr/lib/python3.8/multiprocessing/context.py", line 119, in Pool
return Pool(processes, initializer, initargs, maxtasksperchild,
File "/usr/lib/python3.8/multiprocessing/pool.py", line 205, in init
raise ValueError("Number of processes must be at least 1")
ValueError: Number of processes must be at least 1

Log file below:
202311220912batch_LiCSBAS_05_16.log

Thank you in advance.

I am a student and doing my dissertation on this topic however I am not been able to proceed forward from this step as the terminal stops here and close automatically without showing any error. The same things happens retrying. Help me please !

yumorishita/LiCSBAS#299

Hello,

I use the batch file.sh and I get this error :

LiCSBAS02_ml_prep.py ver1.7.4 20201119 Y. Morishita
LiCSBAS02_ml_prep.py -i GEOC -n 1
Traceback (most recent call last):
File "/Users/clement.goldmann/LiCSBAS/LiCSBAS2/LiCSBAS2/bin/LiCSBAS02_ml_prep.py", line 452, in
sys.exit(main())
^^^^^^
File "/Users/clement.goldmann/LiCSBAS/LiCSBAS2/LiCSBAS2/bin/LiCSBAS02_ml_prep.py", line 128, in main
cmap_wrap = tools_lib.get_cmap('cm_insar')
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/clement.goldmann/LiCSBAS/LiCSBAS2/LiCSBAS2/LiCSBAS_lib/LiCSBAS_tools_lib.py", line 417, in get_cmap
_cmap = cm_insar()
^^^^^^^^^^
File "/Users/clement.goldmann/LiCSBAS/LiCSBAS2/LiCSBAS2/LiCSBAS_lib/LiCSBAS_tools_lib.py", line 139, in cm_insar
return LSC.from_list('cm_insar', rgbs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/clement.goldmann/opt/anaconda3/envs/LiCSBAS/lib/python3.11/site-packages/matplotlib/colors.py", line 1056, in from_list
r, g, b, a = to_rgba_array(colors).T
^^^^^^^^^^^^^^^^^^^^^
File "/Users/clement.goldmann/opt/anaconda3/envs/LiCSBAS/lib/python3.11/site-packages/matplotlib/colors.py", line 454, in to_rgba_array
raise ValueError("RGBA values should be within 0-1 range")
ValueError: RGBA values should be within 0-1 range

I precise this step works fine with the LiCSBAS original code, I try now with LiCSBAS2 because I got an error on the step 11.

Best regards,
Clément

Hi developer,
I'm experiencing an issue with reshaping arrays in LiCSBAS during time-series deformation calculations. The error message I receive is:
ValueError: cannot reshape array of size 7454688 into shape (2318,1608)
Interestingly, the product of the target shape dimensions (2318*1608 = 3724624) is exactly half of the original array size (7454688)， with different multi-look window size.
Additional note: I have checked the data and confirmed that there are no NaN values present.
Thank you for your assistance!

URL should be updated.
https://gws-access.jasmin.ac.uk/public/nceo_geohazards/LiCSAR_products/

Hello
My question may be related to the basic topics of InSAR, but I ask them.

1.What are the reasons for high number of unclosed loops in some areas or pixels? Vegetation?
2.Can I skip masking these pixels and trust them?

I have attached an aerial image of the study area. Also I processed with nlook=10.

I applied step 0-4 to mask. Then, when I execute step 1-6, it mentioned no mask file .../results/mask
which step I should back to generate mask file ?

Hello Yumorishita,

I still have problem following this issue, i have check and use the new version, but still giving me the same. i hope you could give solution for this one.

Thank you

Tiggi C

LiCSBAS11_check_unw.py ver1.3.3 20210402 Y. Morishita
LiCSBAS11_check_unw.py -d GEOCml1

coh_thre : 0.05
unw_cov_thre : 0.3

Size : 2712 x 2776

Reading unw and cc data...
0/160th unw to identify valid area...
100/160th unw to identify valid area...
0/160th cc and unw...
100/160th cc and unw...

5/160 ifgs are discarded from further processing.
ifg dates unw_cov coh_av
20170317_20170504 0.200 0.055
20170329_20170504 0.238 0.057
20170329_20170516 0.199 0.055
20170410_20170504 0.294 0.060
20170410_20170516 0.244 0.058
Traceback (most recent call last):
File "/home/risk/LiCSBAS2-1.9.0/bin/LiCSBAS11_check_unw.py", line 356, in
sys.exit(main())
^^^^^^
File "/home/risk/LiCSBAS2-1.9.0/bin/LiCSBAS11_check_unw.py", line 331, in main
plot_lib.plot_network(ifgdates, bperp, [], pngfile)
File "/home/risk/LiCSBAS2-1.9.0/LiCSBAS_lib/LiCSBAS_plot_lib.py", line 290, in plot_network
ax.grid(b=True, which='major')
File "/home/risk/.pyenv/versions/miniconda3-latest/lib/python3.12/site-packages/matplotlib/axes/_base.py", line 3196, in grid
self.xaxis.grid(visible, which=which, **kwargs)
File "/home/risk/.pyenv/versions/miniconda3-latest/lib/python3.12/site-packages/matplotlib/axis.py", line 1697, in grid
self.set_tick_params(which='major', **gridkw)
File "/home/risk/.pyenv/versions/miniconda3-latest/lib/python3.12/site-packages/matplotlib/axis.py", line 958, in set_tick_params
kwtrans = self._translate_tick_params(kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/risk/.pyenv/versions/miniconda3-latest/lib/python3.12/site-packages/matplotlib/axis.py", line 1102, in _translate_tick_params
raise ValueError(
ValueError: keyword grid_b is not recognized; valid keywords are ['size', 'width', 'color', 'tickdir', 'pad', 'labelsize', 'labelcolor', 'labelfontfamily', 'zorder', 'gridOn', 'tick1On', 'tick2On', 'label1On', 'label2On', 'length', 'direction', 'left', 'bottom', 'right', 'top', 'labelleft', 'labelbottom', 'labelright', 'labeltop', 'labelrotation', 'grid_agg_filter', 'grid_alpha', 'grid_animated', 'grid_antialiased', 'grid_clip_box', 'grid_clip_on', 'grid_clip_path', 'grid_color', 'grid_dash_capstyle', 'grid_dash_joinstyle', 'grid_dashes', 'grid_data', 'grid_drawstyle', 'grid_figure', 'grid_fillstyle', 'grid_gapcolor', 'grid_gid', 'grid_in_layout', 'grid_label', 'grid_linestyle', 'grid_linewidth', 'grid_marker', 'grid_markeredgecolor', 'grid_markeredgewidth', 'grid_markerfacecolor', 'grid_markerfacecoloralt', 'grid_markersize', 'grid_markevery', 'grid_mouseover', 'grid_path_effects', 'grid_picker', 'grid_pickradius', 'grid_rasterized', 'grid_sketch_params', 'grid_snap', 'grid_solid_capstyle', 'grid_solid_joinstyle', 'grid_transform', 'grid_url', 'grid_visible', 'grid_xdata', 'grid_ydata', 'grid_zorder', 'grid_aa', 'grid_c', 'grid_ds', 'grid_ls', 'grid_lw', 'grid_mec', 'grid_mew', 'grid_mfc', 'grid_mfcalt', 'grid_ms']

I have a questions about LiCSBAS 2

1. what environment is used and installation steps such as LiCSBAS ver 1 ?
2. For p05_clip_range_geo is right "LonMin/LonMax/LatMin/LatMax" ?
3. I'm trying to run LiCSBAS2 use the environment setting from LiCSBAS installation step but the result is error.
   LiCSBAS05op_clip_unw.py ver1.2.5 20210105 Y. Morishita
   LiCSBAS05op_clip_unw.py -i GEOCml1 -o GEOCml1clip -g 106.57/107.02/-6.70/-6.34
   Traceback (most recent call last):
   File "/home/rofiatulainiyah/LiCSBAS/bin/LiCSBAS05op_clip_unw.py", line 345, in
   sys.exit(main())
   ^^^^^^
   File "/home/rofiatulainiyah/LiCSBAS/bin/LiCSBAS05op_clip_unw.py", line 161, in main
   width = int(io_lib.get_param_par(mlipar, 'range_samples'))
   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
   File "/home/rofiatulainiyah/LiCSBAS/LiCSBAS_lib/LiCSBAS_io_lib.py", line 236, in get_param_par
   value = subp.check_output(['grep', field,mlipar]).decode().split()[1].strip()
   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
   File "/home/rofiatulainiyah/miniconda3/envs/licsbas/lib/python3.12/subprocess.py", line 466, in check_output
   return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
   File "/home/rofiatulainiyah/miniconda3/envs/licsbas/lib/python3.12/subprocess.py", line 571, in run
   raise CalledProcessError(retcode, process.args,
   subprocess.CalledProcessError: Command '['grep', 'range_samples', '/mnt/d/047D_09652_111009/GEOCml1/slc.mli.par']' returned non-zero exit status 1.

I downloaded the Gnss displacement data from the Nevada Gnss all station site and ran Licsbas for the frame mentioned in the article.  The output of the displacements of Insar is the same as the licsbas article, but the displacement of Gnss is not the same.  I moved the Gnss displacement vector according to the following formula to los.  Please tell me where is the problem with our work?  los = Vu .  U+Vn.  N + Ve.  E Vu, Vn, and Ve from GNSS U, N, and E from the LiCSBAS

Hey yumorishita,

I wanted to know if velocity map correspond to the LOS displacement or the vertical displacement ?

In the case of LOS i need to convert with the angle, did LICSBAS2 doing this procedure or i need to project GNSS 3D (EW, NS, UD) deformation data to a LOS direction by multiplying LOS unit vector components (E.geo, N.geo, U.geo) and summing them.

I wish you a very nice day,
Clément

Hi Yumorishita,

I found a bug on the line 827.
In the case of not applying the spatial filter, there is no cum_hptlps created on line 812.
Maybe you could add the following under line 812 to solve the problem.

cum_hptlps = cum_hpt

Best,
Kevin

I already processed deformation then I got the result like image that I send. What difference between velocity 1 & 2?