yumorishita / licsbas2 Goto Github PK
View Code? Open in Web Editor NEWLicense: GNU General Public License v3.0
License: GNU General Public License v3.0
Hello
When I use LiCSBAS_cum2vel.py and put the start and end dates of the whole network, the results should be the same as results/vel.filt.mskd and results/vstd?
To me they are not exactly the same and slightly different.
Hello
When using LiCSBAS_decomposeLOS.py, shouldn't U.geo be used instead of N.geo?
-f Text file containing input GeoTIFF file paths of LOS displacement
(or velocity) and E and N components of LOS unit vector from >=2 directions
Note: GeoTIFF files can be created by LiCSBAS_flt2geotiff.py
Format:
dispfile1 Efile1 Nfile1
dispfile2 Efile2 Nfile2
...
LiCSBAS02_ml_prep.py ver1.7.4 20201119 Y. Morishita
LiCSBAS02_ml_prep.py -i GEOC -n 10
Create E.geo
E.geo created
Create N.geo
N.geo created
Create U.geo
U.geo created
Create slc.mli
slc.mli[.png] created
Create hgt
hgt[.png] created
Create unw and cc
6 parallel processing...
0/ 39th IFG...
10/ 39th IFG...
/home/morishita/software/LiCSBAS2/bin/LiCSBAS02_ml_prep.py:440: RuntimeWarning: invalid value encountered in cast
cc = cc.astype(np.uint8) ##nan->0, max255, auto-floored
/home/morishita/software/LiCSBAS2/bin/LiCSBAS02_ml_prep.py:440: RuntimeWarning: invalid value encountered in cast
cc = cc.astype(np.uint8) ##nan->0, max255, auto-floored
/home/morishita/software/LiCSBAS2/bin/LiCSBAS02_ml_prep.py:440: RuntimeWarning: invalid value encountered in cast
cc = cc.astype(np.uint8) ##nan->0, max255, auto-floored
Thank you once again for LiCSBAS!
My issue is that the run remains appended at step 16 (see screenshot and log file). Is it due to not enough RAM (48gb) or what? I am trying to analyze a full frame.
Is it still possible to use the results from step 15? LiCSBAS_plot_ts.py returns an error: "Unable to open object (object 'vel' doesn't exist)".
Hello, thank you for the Licsbas program you developed. The displacements output from Licsbas does not match that from Gnss. Which parameter should we adjust in Licsbas to align them?
LiCSBAS_plot_ts.py ver1.14.0 20230219 Y. Morishita
LiCSBAS_plot_ts.py -i cum.h5
Reading cum.h5
Reading mask
Traceback (most recent call last):
File "/home/morishita/software/LiCSBAS2/bin/LiCSBAS_plot_ts.py", line 408, in
mask_vel = cumh5['mask'][()]
~~~~~^^^^^^^^
File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
File "/home/morishita/software/pyenv/versions/licsbas2-3.11/lib/python3.11/site-packages/h5py/_hl/group.py", line 328, in getitem
oid = h5o.open(self.id, self._e(name), lapl=self._lapl)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
File "h5py/h5o.pyx", line 190, in h5py.h5o.open
KeyError: "Unable to open object (object 'mask' doesn't exist)"
Hi @yumorishita
I have maybe a dumb question I try to find what is the the step to put a reference point, stable along the subsidence how the reference point is calculate / map in the LiCSBAS process ?
I think I couldn't find where is it explained.
Wish you all the best,
Clément
" ValueError: A colormap named "SCM.roma0" is already registered"
yumorishita/LiCSBAS#176 (comment)
yumorishita/LiCSBAS#195 (comment)
yumorishita/LiCSBAS#198
Hello sir
I used LiCSBAS before, now I want to use this on my new Linux and I want to install LiCSBAS2 (because yumorishita/LiCSBAS#202 (comment)).
How do I do this?
I already installed LiCSBAS with the help of wiki but this one doesn't have a wiki. Is it the same?
Currently, the reference point is first selected and the displacement is all zero, but some users don't understand why the displacement is zero. Maybe good to set the point that has max velocity.
Hi, I want to ask about the velocity results that I got, the majority of the AOI experienced upfilt. My research area is on the mainland, is it possible to experience a very massive uplift? The research year is from 2014-2023, could a research period that is too long affect the results? Are there any parameters that need to be adjusted so that the results can be maximized?
Hello Mr. Yumorishita, I've been processing frame 025A_09718_120810 within the timeframe from December 18, 2014, to December 31, 2023. I've processed this data multiple times, but the process always gets stuck at the GEOCml1 process for 4 hours. Could you help me with this issue? Thank you.
Sincerely, Gagah Agung.
202405031029batch_LiCSBAS_01_16.log
Dear Yumorishita,
I had a interrogation about the data which i extract from my result file. I wanted to put the subsidence in a area in mm/year so I did the following command to get the tiff :
LiCSBAS_flt2geotiff.py -i TS_GEOCml1GACOSmaskclip/results/vel -p TS_GEOCml1GACOSmaskclip/info/EQA.dem_par
Because the vel.png show me as well a displacement by year.
But in QGIS with the tiff file it seems I have the same map as this one :
As I understant it's the velocity from the reference date and not a displacement by year.
Compared to this picture which is the displacement every year (the one who interrested me)
What is the input i need in the LiCSBAS_flt2geotiff ?
I wish you a great day.
Clément
LiCSBAS04op_mask_unw.py ver1.3.5 20210105 Y. Morishita
LiCSBAS04op_mask_unw.py -i GEOCml10 -o GEOCml10mask -c 0.2
Calculate coh_avg and define mask (<=0.2)
/home/morishita/software/LiCSBAS2/bin/LiCSBAS04op_mask_unw.py:196: DeprecationWarning: NumPy will stop allowing conversion of out-of-bound Python integers to integer arrays. The conversion of 99999 to int16 will fail in the future.
For the old behavior, usually:
np.array(value).astype(dtype)`
will give the desired result (the cast overflows).
n_coh[n_coh==0] = 99999 #to avoid zero division
Mask defined.
Dear Morishita,
running batch_LiCSBAS.sh, I have the following error:
I understand the problem, but I do not see how to overcome it, and I do not understand why there is this problem?
To note: when downloading the files from the COMET website, there has been several "unw" files not downloaded:
I don't know if it can be linked?
I thank you in advance for your help.
Hello Mr. Morishita, I am looking to reprocess my data, specifically the frame with ID 025A_09718_120810. However, I encountered the following error:
(licsbas) gagahap@HP:/mnt/c/frame/cb_1$ ./batch_LiCSBAS.sh
Start step: 01
End step: 16
Log file: log/202406050906batch_LiCSBAS_01_16.log
LiCSBAS01_get_geotiff.py ver1.6.4 20230215 Y. Morishita
LiCSBAS01_get_geotiff.py -f 025A_09718_120810 -s 20141218 -e 20231231 --get_gacos
Frame ID is 025A_09718_120810
025A_09718_120810.geo.E.tif already exist. Skip download.
025A_09718_120810.geo.N.tif already exist. Skip download.
025A_09718_120810.geo.U.tif already exist. Skip download.
025A_09718_120810.geo.hgt.tif already exist. Skip download.
Download baselines
baselines, 5.42KB, 1s, 5.42KB/s
Download network.png
network.png, 700.63KB, 4s, 175.16KB/s
Download metadata.txt
metadata.txt, 244.0B, 1s, 244.0B/s
Searching latest epoch for mli...
Traceback (most recent call last):
File "/home/gagahap/LiCSBAS2/bin/LiCSBAS01_get_geotiff.py", line 500, in
sys.exit(main())
^^^^^^
File "/home/gagahap/LiCSBAS2/bin/LiCSBAS01_get_geotiff.py", line 213, in main
response = requests.get(url)
^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/sessions.py", line 725, in send
history = [resp for resp in gen]
^^^^^^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/sessions.py", line 191, in resolve_redirects
raise TooManyRedirects(
requests.exceptions.TooManyRedirects: Exceeded 30 redirects.
Can you help me to resolving this error? I have attached the log file below. Thank you, sir.
LiCSBAS_plot_ts.py:734: MatplotlibDeprecationWarning: Setting data with a non sequence type is deprecated since 3.7 and will be remove two minor releases later
pax2.set_data(jj, ii)
Hello
Thank you for your good software.
I wanted to ask a question, what data did you use (https://terras.gsi.go.jp/)? I downloaded the coordinates_R3 data, but the list of coordinates is in the ITRF 2005 system, how to convert it in the utm wgs 84 system?
LiCSBAS_plot_ts.py ver1.14.0 20230219 Y. Morishita
LiCSBAS_plot_ts.py -i TS_GEOC_CACOS/cum_filt.h5
Reading TS_GEOC_CACOS/cum_filt.h5
Reading TS_GEOC_CACOS/cum.h5 as 2nd
Reading mask
Reading mask
Reading coh_avg
Reading n_unw
Reading vstd
Reading maxTlen
Reading n_gap
Reading stc
Reading n_ifg_noloop
Reading n_loop_err
Reading resid_rms
Reading slc.mli
Reading hgt
/mnt/rfchen/LiCSBAS2-master/LiCSBAS2-master/bin/LiCSBAS_plot_ts.py:734: MatplotlibDeprecationWarning: Setting data with a non sequence type is deprecated since 3.7 and will be remove two minor releases later
pax2.set_data(jj, ii)
How should I solve this problem?
Processing stops in step 12, returns IndexError: index 0 is out of bounds for axis 0 with size 0
LiCSBAS12_loop_closure.py", line 397
log file attached
Everyone suddenly started facing the error below. This does not seem to be a temporary issue. Perhaps the site access policy was recently changed.
Searching latest epoch for mli...
Traceback (most recent call last):
File "/home/gagahap/LiCSBAS2/bin/LiCSBAS01_get_geotiff.py", line 500, in
sys.exit(main())
^^^^^^
File "/home/gagahap/LiCSBAS2/bin/LiCSBAS01_get_geotiff.py", line 213, in main
response = requests.get(url)
^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/sessions.py", line 725, in send
history = [resp for resp in gen]
^^^^^^^^^^^^^^^^^^^^^^
File "/home/gagahap/miniconda3/envs/licsbas/lib/python3.12/site-packages/requests/sessions.py", line 191, in resolve_redirects
raise TooManyRedirects(
requests.exceptions.TooManyRedirects: Exceeded 30 redirects.
yumorishita/LiCSBAS#364 (comment)
#53
yumorishita/LiCSBAS#367
yumorishita/LiCSBAS#366
Hi @yumorishita
I've read your latest paper (2023) and it would be good to put the paper in your GitHub (LiCSBAS2) as a reference.
Anyway, how to generate a cumulative displacement map (geotiff) ? may be I missed this step.
Hi all,
How can I set path for LiCSBAS commands?
I faced this error:
Check LiCSBAS commands
ERROR: PATH is not set to LiCSBAS commands
I am using anaconda in windows 11.
LiCSBAS04op_mask_unw.py:175: DeprecationWarning: `n
p.bool` is a deprecated alias for the builtin `bool`. To silence this warning, use `bool`
by itself. Doing this will not modify any behavior and is safe. If you specifically wanted
the numpy scalar type, use `np.bool_` here.
Hi, has anyone experienced a ValueError on the number of processes for step 12?
Got the message below:
LiCSBAS12_loop_closure.py ver1.6.2 20230822 Y. Morishita
LiCSBAS12_loop_closure.py -d GEOCml1clip -l 2 --multi_prime
loop_thre : 2.0 rad
1st Loop closure check and make png for all possible 0 loops,
with 0 parallel processing...
Traceback (most recent call last):
File "/home/user/LiCSBAS/LiCSBAS2/bin/LiCSBAS12_loop_closure.py", line 890, in
sys.exit(main())
File "/home/user/LiCSBAS/LiCSBAS2/bin/LiCSBAS12_loop_closure.py", line 302, in main
p = q.Pool(_n_para)
File "/usr/lib/python3.8/multiprocessing/context.py", line 119, in Pool
return Pool(processes, initializer, initargs, maxtasksperchild,
File "/usr/lib/python3.8/multiprocessing/pool.py", line 205, in init
raise ValueError("Number of processes must be at least 1")
ValueError: Number of processes must be at least 1
Log file below:
202311220912batch_LiCSBAS_05_16.log
Thank you in advance.
Hello,
I use the batch file.sh and I get this error :
LiCSBAS02_ml_prep.py ver1.7.4 20201119 Y. Morishita
LiCSBAS02_ml_prep.py -i GEOC -n 1
Traceback (most recent call last):
File "/Users/clement.goldmann/LiCSBAS/LiCSBAS2/LiCSBAS2/bin/LiCSBAS02_ml_prep.py", line 452, in
sys.exit(main())
^^^^^^
File "/Users/clement.goldmann/LiCSBAS/LiCSBAS2/LiCSBAS2/bin/LiCSBAS02_ml_prep.py", line 128, in main
cmap_wrap = tools_lib.get_cmap('cm_insar')
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/clement.goldmann/LiCSBAS/LiCSBAS2/LiCSBAS2/LiCSBAS_lib/LiCSBAS_tools_lib.py", line 417, in get_cmap
_cmap = cm_insar()
^^^^^^^^^^
File "/Users/clement.goldmann/LiCSBAS/LiCSBAS2/LiCSBAS2/LiCSBAS_lib/LiCSBAS_tools_lib.py", line 139, in cm_insar
return LSC.from_list('cm_insar', rgbs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/clement.goldmann/opt/anaconda3/envs/LiCSBAS/lib/python3.11/site-packages/matplotlib/colors.py", line 1056, in from_list
r, g, b, a = to_rgba_array(colors).T
^^^^^^^^^^^^^^^^^^^^^
File "/Users/clement.goldmann/opt/anaconda3/envs/LiCSBAS/lib/python3.11/site-packages/matplotlib/colors.py", line 454, in to_rgba_array
raise ValueError("RGBA values should be within 0-1 range")
ValueError: RGBA values should be within 0-1 range
I precise this step works fine with the LiCSBAS original code, I try now with LiCSBAS2 because I got an error on the step 11.
Best regards,
Clément
Hi developer,
I'm experiencing an issue with reshaping arrays in LiCSBAS during time-series deformation calculations. The error message I receive is:
ValueError: cannot reshape array of size 7454688 into shape (2318,1608)
Interestingly, the product of the target shape dimensions (2318*1608 = 3724624) is exactly half of the original array size (7454688), with different multi-look window size.
Additional note: I have checked the data and confirmed that there are no NaN values present.
Thank you for your assistance!
URL should be updated.
https://gws-access.jasmin.ac.uk/public/nceo_geohazards/LiCSAR_products/
LiCSBAS2/bin/LiCSBAS01_get_geotiff.py
Line 161 in dfdb8fa
Hello
My question may be related to the basic topics of InSAR, but I ask them.
1.What are the reasons for high number of unclosed loops in some areas or pixels? Vegetation?
2.Can I skip masking these pixels and trust them?
I have attached an aerial image of the study area. Also I processed with nlook=10.
I applied step 0-4 to mask. Then, when I execute step 1-6, it mentioned no mask file .../results/mask
which step I should back to generate mask file ?
Hello Yumorishita,
I still have problem following this issue, i have check and use the new version, but still giving me the same. i hope you could give solution for this one.
Thank you
Tiggi C
LiCSBAS11_check_unw.py ver1.3.3 20210402 Y. Morishita
LiCSBAS11_check_unw.py -d GEOCml1
coh_thre : 0.05
unw_cov_thre : 0.3
Size : 2712 x 2776
Reading unw and cc data...
0/160th unw to identify valid area...
100/160th unw to identify valid area...
0/160th cc and unw...
100/160th cc and unw...
5/160 ifgs are discarded from further processing.
ifg dates unw_cov coh_av
20170317_20170504 0.200 0.055
20170329_20170504 0.238 0.057
20170329_20170516 0.199 0.055
20170410_20170504 0.294 0.060
20170410_20170516 0.244 0.058
Traceback (most recent call last):
File "/home/risk/LiCSBAS2-1.9.0/bin/LiCSBAS11_check_unw.py", line 356, in
sys.exit(main())
^^^^^^
File "/home/risk/LiCSBAS2-1.9.0/bin/LiCSBAS11_check_unw.py", line 331, in main
plot_lib.plot_network(ifgdates, bperp, [], pngfile)
File "/home/risk/LiCSBAS2-1.9.0/LiCSBAS_lib/LiCSBAS_plot_lib.py", line 290, in plot_network
ax.grid(b=True, which='major')
File "/home/risk/.pyenv/versions/miniconda3-latest/lib/python3.12/site-packages/matplotlib/axes/_base.py", line 3196, in grid
self.xaxis.grid(visible, which=which, **kwargs)
File "/home/risk/.pyenv/versions/miniconda3-latest/lib/python3.12/site-packages/matplotlib/axis.py", line 1697, in grid
self.set_tick_params(which='major', **gridkw)
File "/home/risk/.pyenv/versions/miniconda3-latest/lib/python3.12/site-packages/matplotlib/axis.py", line 958, in set_tick_params
kwtrans = self._translate_tick_params(kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/risk/.pyenv/versions/miniconda3-latest/lib/python3.12/site-packages/matplotlib/axis.py", line 1102, in _translate_tick_params
raise ValueError(
ValueError: keyword grid_b is not recognized; valid keywords are ['size', 'width', 'color', 'tickdir', 'pad', 'labelsize', 'labelcolor', 'labelfontfamily', 'zorder', 'gridOn', 'tick1On', 'tick2On', 'label1On', 'label2On', 'length', 'direction', 'left', 'bottom', 'right', 'top', 'labelleft', 'labelbottom', 'labelright', 'labeltop', 'labelrotation', 'grid_agg_filter', 'grid_alpha', 'grid_animated', 'grid_antialiased', 'grid_clip_box', 'grid_clip_on', 'grid_clip_path', 'grid_color', 'grid_dash_capstyle', 'grid_dash_joinstyle', 'grid_dashes', 'grid_data', 'grid_drawstyle', 'grid_figure', 'grid_fillstyle', 'grid_gapcolor', 'grid_gid', 'grid_in_layout', 'grid_label', 'grid_linestyle', 'grid_linewidth', 'grid_marker', 'grid_markeredgecolor', 'grid_markeredgewidth', 'grid_markerfacecolor', 'grid_markerfacecoloralt', 'grid_markersize', 'grid_markevery', 'grid_mouseover', 'grid_path_effects', 'grid_picker', 'grid_pickradius', 'grid_rasterized', 'grid_sketch_params', 'grid_snap', 'grid_solid_capstyle', 'grid_solid_joinstyle', 'grid_transform', 'grid_url', 'grid_visible', 'grid_xdata', 'grid_ydata', 'grid_zorder', 'grid_aa', 'grid_c', 'grid_ds', 'grid_ls', 'grid_lw', 'grid_mec', 'grid_mew', 'grid_mfc', 'grid_mfcalt', 'grid_ms']
I have a questions about LiCSBAS 2
I downloaded the Gnss displacement data from the Nevada Gnss all station site and ran Licsbas for the frame mentioned in the article. The output of the displacements of Insar is the same as the licsbas article, but the displacement of Gnss is not the same. I moved the Gnss displacement vector according to the following formula to los. Please tell me where is the problem with our work? los = Vu . U+Vn. N + Ve. E Vu, Vn, and Ve from GNSS U, N, and E from the LiCSBAS
Hey yumorishita,
I wanted to know if velocity map correspond to the LOS displacement or the vertical displacement ?
In the case of LOS i need to convert with the angle, did LICSBAS2 doing this procedure or i need to project GNSS 3D (EW, NS, UD) deformation data to a LOS direction by multiplying LOS unit vector components (E.geo, N.geo, U.geo) and summing them.
I wish you a very nice day,
Clément
Hi Yumorishita,
I found a bug on the line 827.
In the case of not applying the spatial filter, there is no cum_hptlps created on line 812.
Maybe you could add the following under line 812 to solve the problem.
cum_hptlps = cum_hpt
Best,
Kevin
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.