Comments (7)
Overv
commented on May 21, 2024
How did you go about manually installing the server? Which style did you use?
from openstreetmap-tile-server.
snavruzov
commented on May 21, 2024
I followed a guide from https://switch2osm.org/manually-building-a-tile-server-18-04-lts/ first, and the style of the map looked different, with country name labels, and visible sea, lakes shape.
But when I use your docker option the style is fully different, without country name labels.
P/S. I did git clone from the master and docker build . Can it be a reason of such map view?
from openstreetmap-tile-server.
Overv
commented on May 21, 2024
That is strange, the Docker image should be pretty much identical to the setup of that guide since it is directly based on it. I also don't see them using a different style sheet. Can you check if the results are different if you use the original version of the code?
from openstreetmap-tile-server.
snavruzov
commented on May 21, 2024
I will try it later, for now I tried the version from the docker HUB, first I tried with the default data.osm.pbf(Luxembourg), styles were applied well, then I tried with Europe osm tiles data, it took about two days to import btw, and no success, countries are still hidden, I don't understand why it behaves so.
Can it be that europe-latest.osm.pbf is not complete in some way?
And can I fix the style without re-importing all stuff again?
from openstreetmap-tile-server.
snavruzov
commented on May 21, 2024
Here is docker logs while running import command:
+ '[' import = import ']'
+ CreatePostgressqlConfig
+ cp /etc/postgresql/10/main/postgresql.custom.conf.tmpl /etc/postgresql/10/main/postgresql.custom.conf
+ sudo -u postgres echo 'autovacuum = off'
+ cat /etc/postgresql/10/main/postgresql.custom.conf
# Suggested minimal settings from
# https://ircama.github.io/osm-carto-tutorials/tile-server-ubuntu/
shared_buffers = 128MB
min_wal_size = 1GB
max_wal_size = 2GB
maintenance_work_mem = 256MB
# Suggested settings from
# https://github.com/openstreetmap/chef/blob/master/roles/tile.rb#L38-L45
max_connections = 250
temp_buffers = 32MB
work_mem = 128MB
wal_buffers = 1024kB
wal_writer_delay = 500ms
commit_delay = 10000
# checkpoint_segments = 60 # unrecognized in psql 10.7.1
max_wal_size = 2880MB
random_page_cost = 1.1
track_activity_query_size = 16384
autovacuum_vacuum_scale_factor = 0.05
autovacuum_analyze_scale_factor = 0.02
autovacuum = off
+ service postgresql start
* Starting PostgreSQL 10 database server
...done.
+ sudo -u postgres createuser renderer
+ sudo -u postgres createdb -E UTF8 -O renderer gis
+ sudo -u postgres psql -d gis -c 'CREATE EXTENSION postgis;'
CREATE EXTENSION
+ sudo -u postgres psql -d gis -c 'CREATE EXTENSION hstore;'
CREATE EXTENSION
+ sudo -u postgres psql -d gis -c 'ALTER TABLE geometry_columns OWNER TO renderer;'
ALTER TABLE
+ sudo -u postgres psql -d gis -c 'ALTER TABLE spatial_ref_sys OWNER TO renderer;'
ALTER TABLE
+ '[' '!' -f /data.osm.pbf ']'
+ osmium fileinfo /data.osm.pbf
+ osmium fileinfo /data.osm.pbf
+ grep osmosis_replication_timestamp=
+ cut -b35-44
++ cat /var/lib/mod_tile/replication_timestamp.txt
+ REPLICATION_TIMESTAMP=2019-07-30
+ sudo -u renderer openstreetmap-tiles-update-expire 2019-07-30
--2019-07-31 09:26:12-- http://replicate-sequences.osm.mazdermind.de/?2019-07-30T00:00:00Z
Resolving replicate-sequences.osm.mazdermind.de (replicate-sequences.osm.mazdermind.de)... 188.68.50.52, 2a03:4000:6:d080::1
Connecting to replicate-sequences.osm.mazdermind.de (replicate-sequences.osm.mazdermind.de)|188.68.50.52|:80... connected.
HTTP request sent, awaiting response... 301 Moved Permanently
Location: https://replicate-sequences.osm.mazdermind.de/?2019-07-30T00:00:00Z [following]
--2019-07-31 09:26:12-- https://replicate-sequences.osm.mazdermind.de/?2019-07-30T00:00:00Z
Connecting to replicate-sequences.osm.mazdermind.de (replicate-sequences.osm.mazdermind.de)|188.68.50.52|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 332 [text/plain]
Saving to: '/var/lib/mod_tile/.osmosis/state.txt'
0K 100% 30.3M=0s
2019-07-31 09:26:12 (30.3 MB/s) - '/var/lib/mod_tile/.osmosis/state.txt' saved [332/332]
+ '[' -f /data.poly ']'
+ sudo -u renderer cp /data.poly /var/lib/mod_tile/data.poly
+ sudo -u renderer osm2pgsql -d gis --create --slim -G --hstore --tag-transform-script /home/renderer/src/openstreetmap-carto/openstreetmap-carto.lua -C 2048 --number-processes 1 -S /home/renderer/src/openstreetmap-carto/openstreetmap-carto.style /data.osm.pbf
osm2pgsql version 0.96.0 (64 bit id space)
Allocating memory for dense node cache
Allocating dense node cache in one big chunk
Allocating memory for sparse node cache
Sharing dense sparse
Node-cache: cache=2048MB, maxblocks=32768*65536, allocation method=11
Mid: pgsql, cache=2048
Setting up table: planet_osm_nodes
Setting up table: planet_osm_ways
Setting up table: planet_osm_rels
Using lua based tag processing pipeline with script /home/renderer/src/openstreetmap-carto/openstreetmap-carto.lua
Using projection SRS 3857 (Spherical Mercator)
Setting up table: planet_osm_point
Setting up table: planet_osm_line
Setting up table: planet_osm_polygon
Setting up table: planet_osm_roads
Reading in file: /data.osm.pbf
Using PBF parser.
Processing: Node(2330623k 238.7k/s) Way(281241k 2.12k/s) Relation(4528860 114.08/s) parse time: 182364s
Node stats: total(2330623252), max(6662463793) in 9762s
Way stats: total(281241632), max(709008313) in 132904s
Relation stats: total(4529103), max(9860855) in 39698s
Sorting data and creating indexes for planet_osm_point
Copying planet_osm_point to cluster by geometry finished
Creating geometry index on planet_osm_point
Creating osm_id index on planet_osm_point
Creating indexes on planet_osm_point finished
All indexes on planet_osm_point created in 2136s
Completed planet_osm_point
Sorting data and creating indexes for planet_osm_line
Copying planet_osm_line to cluster by geometry finished
Creating geometry index on planet_osm_line
Creating osm_id index on planet_osm_line
Creating indexes on planet_osm_line finished
All indexes on planet_osm_line created in 3908s
Completed planet_osm_line
Sorting data and creating indexes for planet_osm_polygon
Sorting data and creating indexes for planet_osm_roads
Copying planet_osm_roads to cluster by geometry finished
Creating geometry index on planet_osm_roads
Creating osm_id index on planet_osm_roads
Creating indexes on planet_osm_roads finished
All indexes on planet_osm_roads created in 359s
Completed planet_osm_roads
Stopping table: planet_osm_nodes
Stopped table: planet_osm_nodes in 0s
Stopping table: planet_osm_ways
Building index on table: planet_osm_ways
Stopping table: planet_osm_rels
Connection to database failed: FATAL: the database system is in recovery mode
Error occurred, cleaning up
+ sudo -u postgres psql -d gis -f indexes.sql
psql: FATAL: the database system is in recovery mode
+ service postgresql stop
* Stopping PostgreSQL 10 database server
...done.
+ exit 0```
from openstreetmap-tile-server.
Overv
commented on May 21, 2024
Well yeah, it looks like your import failed. I think the database has either run out of storage or run out of memory and has crashed based on the message
Connection to database failed: FATAL: the database system is in recovery mode
from openstreetmap-tile-server.
snavruzov
commented on May 21, 2024
It's strange since I got 500GB SSD, and 64GB RAM with 14 CPU cores. I guess if you put more thread number it multiplies to cache size as well and cause OOM issues.
So it's OS related issue and can be closed.
from openstreetmap-tile-server.
Related Issues (20)
- During the data import, will it be possible to create the indexes in parallel rather than sequencially? HOT 1
- hangs on startup HOT 3
- Segmentation fault during import HOT 5
- Run container over proxy with UPDATES=ENABLED parameter
- running server If I run the server, does it automatically render for all the files?
- Import command fails for OSM data
- Data/Labels not shown up on maps HOT 1
- How do I force latin names for countries like Greece or China? HOT 6
- Postgis Plugin: ERROR: could not resize shared memory segment "/PostgreSQL.2682777122" to 50438144 bytes: No space left on device HOT 1
- To optimise the rendering HOT 1
- Import not completing HOT 7
- Search filed?
- Postgres in container not working HOT 2
- Tile fetching behind reverse proxy HOT 1
- Postgres says rendrer user already exsists
- Error downloading tile file : i/0 time out HOT 3
- til-server automatic update: how to do? HOT 2
- Running out of space when downloading the planet HOT 3
- postgresql error HOT 1
- Automatize tile rendering of big country HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from openstreetmap-tile-server.