jimut123 / jimutmap Goto Github PK

Hello,
first of all thank you for this library!
I do have some problems with it, after initializing, the CPU`s are busy and the script is running, but 0%| | 0/117 [00:00<?, ?it/s] - this is not indicating any work done, after hours. The OS is Windows 10, all pre-requisites are installed as mentioned in README.

Greetings !

Some internet connections -such as mine- are slower than others. In my case the attribute 'data-map-printing-background' wasn't loading fast enough so the value of mapData was None and an error was raised.
Code:

time.sleep(15)
baseMap = driver.find_element_by_css_selector("#map-canvas .leaflet-mapkit-mutant")
mapData = baseMap.get_attribute("data-map-printing-background")

The wait time(5 seconds) is not flexible enough for all internet connections, for me a 10-15 seconds wait works best. Maybe it would be better to build a version of the code that is not type-dependent but situation-dependent.

I will create a fork if i find the time.

The script downloads nothing but black tiles at a rate of 0.0017232894897460938 MiB/s

To Reproduce
Steps to reproduce the behavior:
Run either Test.Py or a modified version of it

**Desktop

• OS: [Win 10]
• Browser [Chrome]
• Python 3.7
• Jimutmap 1.4.2

Additional context
Zoom level was 17, Cores 4, Satellites Pro had up to 19 zoom for the region being downloaded, API key auto generated
Screenshots

Program
modifiedtest.txt

Describe the bug
I have a pandas dataframe with locations I wish to download tiles for. I am downloading a limited area around each location. However placing in a loop, I find that often no images are downloaded. Deleting the chromedriver and retrying can fix the issue, but not always

To Reproduce

for index in tqdm(range(len(df))):
    test_lat = df.iloc[index]['lat']
    test_lon = df.iloc[index]['lon']
    extent = 0.01

    min_lat_deg = test_lat - extent
    max_lat_deg = test_lat + extent
    min_lon_deg = test_lon - extent
    max_lon_deg = test_lon + extent

    print(min_lat_deg, max_lat_deg, min_lon_deg, max_lon_deg)

    download_obj = api(
        min_lat_deg = min_lat_deg, # min_lat,
        max_lat_deg = max_lat_deg, # max_lat,
        min_lon_deg = min_lon_deg, # min_lon,
        max_lon_deg = max_lon_deg, # max_lon,
        zoom = 16, # 0 is min, 17 is good
        verbose = False,
        threads_ = 5, 
        container_dir = img_dir
        )

    download_obj.download(getMasks = False)
    time.sleep(2) # wait for download to finish

Expected behavior
Either an exception is raised if there are no images to download, or some mechanism is available to retry

Screenshots
NA

Desktop (please complete the following information):

• OS: macOS
• Browser: chrome
• Version: jimutmap==1.3.9

Additional context
Add any other context about the problem here.

Running the test script all images are totally blank.
How to fix it?

Describe the bug
If we try to download the images with the name lat_long.jpg using the function ret_lat_lon instead of xTiles_yTiles.jpg, the conversion of latitude doesn't seem correct.
Even if we just call the 1st functions on some (xTiles, YTiles) and pass the output (lat, lon) to lat function, results will vary.

To Reproduce
Steps to reproduce the behavior:

1. Easiest way to reproduce this is by calling the functions
   api_=api(min_lat_deg = 23.0,
   max_lat_deg = 23.03,
   min_lon_deg = 72.49,
   max_lon_deg = 72.53, zoom=18)
   api_.ret_xy_tiles(23.0, 72.49), api_.ret_xy_tiles(23.03, 72.53)
2. output is : ((183857, 113855), (183886, 113831))
3. now call the 2nd function:
   api_.ret_lat_lon(183857, 113855), api_.ret_lat_lon(183886, 113831)
4. output is :
   ((21.888705486651332, 72.48916625976562), (21.914930407351424, 72.52899169921875))

Expected behavior
output should be ((23.0, 72.49), (23.03, 72.53))

Desktop (please complete the following information):

• OS: [Windows 10]
• Browser [chrome]

When we the base code

download_obj = api(min_lat_deg = 10,
                      max_lat_deg = 10.2,
                      min_lon_deg = 10,
                      max_lon_deg =  base 11,
                      zoom = 19,
                      verbose = False,
                      threads_ = 5, 
                      container_dir = ".")

it downloads the current image of that specific location. Is there any possible way we can implement a way to get the historical image of any location (within reason).

Also is there any way I can only get satillieste images and none of the other formats

Describe the bug
Hello, i have been trying to use the jimutmap, that i think is an interesting python script for geospatial analysis, i already installed in windows 11 and ubuntu, following all of the steps and properly installing each dependency with their correspondent version (i.e. numpy, opencv, selenium, etc)... the problem that i have been facing in the last days is when i download the tiles from the test.py, i only download black images also for the street maps, i tried different zoom options, and modifying any other parameters, but, same problem, any recommendation?, many thanks in advance for your support... best regards

Screenshots

Desktop (please complete the following information):

• Ubuntu 20.04 and windows 11
• Chrome
• Python version 3.7 and python version 3.9

Hey, thanks for sharing your library :)
I'm pretty new to python and I wonder if the longitude and latitude can be exchanged by variables? I'd like to get them from a city and country so I did the following combination:

from geopy.geocoders import Nominatim
default_user_agent= 'YOURUSERAGENT'
geolocator = Nominatim(user_agent="my_user_agent")
city ="YourCity"
country ="YourCountry"
loc = geolocator.geocode(varcity+','+ varcountry)
print(loc.latitude, loc.longitude)

maxlat = loc.latitude + 0.5
maxlon = loc.longitude + 0.5

print (maxlat, maxlon)


from jimutmap import api

download_obj = api (min_lat_deg = loc.longitude,
                    max_lat_deg = maxlat,
                    min_lon_deg = loc.latitude,
                    max_lon_deg = maxlon,
                    zoom = 19, verbose = False,
                    threads_ = 5,
                    container_dir = "YOUR PATH")

download_obj.download(getMasks = True)

Both parts work separate, but when I bring them together, they either give me black images or telling me
AssertionError
assert min_lon_deg < max_lon_deg

Do you have any clue? :-)

Describe the bug
After installing chrome into wsl along with required dependencies it fails to get token for the map or fails on inicialization of chrome auto installer package (see output below).

To Reproduce
Steps to reproduce the behavior:

1. Run python3 test.py

Expected behavior
Receive satellite images from the scraper into chosen directory.

Screenshots

WARNING:root:Can not find chromedriver for currently installed chrome version.
Traceback (most recent call last):
  File "/home/patrik/jimutmap/test.py", line 15, in <module>
    from jimutmap import api, sanity_check, stitch_whole_tile
  File "/home/patrik/jimutmap/jimutmap/__init__.py", line 19, in <module>
    from .sanity_checker import sanity_check
  File "/home/patrik/jimutmap/jimutmap/sanity_checker.py", line 221, in <module>
    sanity_obj = api(min_lat_deg = 10,
  File "/home/patrik/jimutmap/jimutmap/jimutmap.py", line 86, in __init__
    self._getAPIKey()
  File "/home/patrik/jimutmap/jimutmap/jimutmap.py", line 189, in _getAPIKey
    driver = webdriver.Chrome(executable_path= chromeDriverPath, options=options)
TypeError: WebDriver.__init__() got an unexpected keyword argument 'executable_path'

Desktop

• OS: Windows 10 (WSL with Ubuntu 22.04 LTS)

I came here from a research project requiring satellite images. I noticed somethings that are not mentioned in the project.
First, getting the API access key, as soon as open the developer tools for the network tab, the GET request for tiles starts getting rejected from the server.

If I try doing it from the selenium headless driver, it gets timeout. Did the satellite.pro team patched the scraping vulnerability or is it just a random chance that this is happening?