data61 / gnaf Goto Github PK
View Code? Open in Web Editor NEWGNAF geocoder and more
License: Other
gnaf's People
Contributors
Stargazers
Watchers
Forkers
willhackett noma4i socialengineers openlocal jonnermut angus151 goelshivali marwahaha opencagedata unsw-cfrc robmcd dawesi dt-in denis53devgnaf's Issues
Error processing tar file(exit status 1): write /root/gnaf.mv.db: no space left on device
I'm getting this error when building docker. Any tips on how to resolve?
docker build .
.
.
12:39:25.695 [main] INFO a.csiro.data61.gnaf.indexer.Indexer. - done
Error processing tar file(exit status 1): write /root/gnaf.mv.db: no space left on device
Victorian addresses all over Australia
I have plotted a list of dance clubs and calisthenics in Victoria (from Data.gov.au: https://data.sa.gov.au/data/dataset/dance-in-victoria-gfyl/resource/2bf45b00-3442-4fd0-b892-c5b1a3a22540) on Terria map.
Some addresses geocoded to other states and territories:
In addition, the following addresses couldn't be found:
1/8 Blackburn Scout Hall,Blackburn,VIC,3130
Red Studio, Springers Leisure Centre,Keysborough,VIC,3173
Dandenong Workers Club,Dandenong,VIC,3175
4 Wilga Avenue,Selby,VIC,3159
Suite 2,Brighton,VIC,3186
Suite 1,Blackburn,VIC,3130
14 Wilson Avenue,Brunswick,VIC,3056
Studio 8,Hallam,VIC,3803
Fairway Receptions,Ardeer,VIC,3022
The Jessie Morris Community Hall, Corner Devon Road & Oak Street,Oak Park,VIC,3046
Studio 4/40 Green Street,Prahran,VIC,3181
Scout Hall,McKinnon,VIC,3204
1/21 Reserve Rd ,Melton,VIC
Masonic Hall,Berwick,VIC,3806
243 Bay Street,Brighton,VIC,3186
Preston Neighbourhood House,Preston,VIC,3072
South Street,Wodonga,VIC,3690
Gate 2, Centenary Avenue,Melton,VIC,3337
Theo's Church Hall,Surrey Hills,VIC,3127
Unit 5, 15-19 Vesper Drive,Narre Warren,VIC,3805
Scout Hall,Heyfield,VIC,3858
Glengarry Hall,Glengarry,VIC,3854
Guide Hall,Morwell,VIC,3840
address input auto-complete could be improved
This is currently running the same query as the search (so as to handle typing errors), but consequently requires all but the last 2 chars ("maxEdits":2) to start matching a word. One of Lucene's suggesters e.g. AnalyzingInfixSuggester might be more useful in a user interface.
on docker build data.gov.au 404 not found
on docker build .
Step 12/18 : RUN /bin/bash src/main/script/run.sh
---> Running in 8ee8fc68c320
++ sed 's/.*"\(.*\)"/\1/' version.sbt
+ version=1.1-SNAPSHOT
+ scalaVersion=2.11
+ [[ '' != \s\k\i\p ]]
+ [[ -f /root/gnaf.mv.db ]]
+ cd gnaf-db
+ src/main/script/createGnafDb.sh
+ baseDir=/gnaf-db
+ scriptDir=/gnaf-db/src/main/script
+ dataDir=/gnaf-db/data
+ mkdir -p /gnaf-db/data
+ jsonUrl='http://www.data.gov.au/api/3/action/package_show?id=19432f89-dc3a-4ef3-b943-5326ef1dbecc'
+ curl -sL 'http://www.data.gov.au/api/3/action/package_show?id=19432f89-dc3a-4ef3-b943-5326ef1dbecc'
++ jq -r '.result.resources[] | select(.format == "ZIP") | .url' meta.json
+ dataUrl='https://data.gov.au/data/dataset/19432f89-dc3a-4ef3-b943-5326ef1dbecc/resource/4b084096-65e4-4c8e-abbe-5e54ff85f42f/download/aug20_gnaf_pipeseparatedvalue.zip
https://data.gov.au/data/dataset/19432f89-dc3a-4ef3-b943-5326ef1dbecc/resource/fdce090a-b356-4afe-91bb-c78fbf88082a/download/aug20_gnaf_pipeseparatedvalue_gda2020.zip
https://data.gov.au/data/dataset/19432f89-dc3a-4ef3-b943-5326ef1dbecc/resource/5442e900-b685-44fb-b453-75f318267133/download/documents.zip'
++ jq -r '.result.resources[] | select(.format == "ZIP") | .last_modified' meta.json
+ last_modified='2020-08-20T21:44:32.891671
2020-08-20T21:54:36.276391
2020-08-17T06:24:10.330752'
+ zip=/gnaf-db/data/documents.zip
+ [[ -f /gnaf-db/data/documents.zip ]]
+ cd /gnaf-db/data
+ wget 'https://data.gov.au/data/dataset/19432f89-dc3a-4ef3-b943-5326ef1dbecc/resource/4b084096-65e4-4c8e-abbe-5e54ff85f42f/download/aug20_gnaf_pipeseparatedvalue.zip
https://data.gov.au/data/dataset/19432f89-dc3a-4ef3-b943-5326ef1dbecc/resource/fdce090a-b356-4afe-91bb-c78fbf88082a/download/aug20_gnaf_pipeseparatedvalue_gda2020.zip
https://data.gov.au/data/dataset/19432f89-dc3a-4ef3-b943-5326ef1dbecc/resource/5442e900-b685-44fb-b453-75f318267133/download/documents.zip'
--2020-10-08 11:52:57-- https://data.gov.au/data/dataset/19432f89-dc3a-4ef3-b943-5326ef1dbecc/resource/4b084096-65e4-4c8e-abbe-5e54ff85f42f/download/aug20_gnaf_pipeseparatedvalue.zip%0Ahttps://data.gov.au/data/dataset/19432f89-dc3a-4ef3-b943-5326ef1dbecc/resource/fdce090a-b356-4afe-91bb-c78fbf88082a/download/aug20_gnaf_pipeseparatedvalue_gda2020.zip%0Ahttps://data.gov.au/data/dataset/19432f89-dc3a-4ef3-b943-5326ef1dbecc/resource/5442e900-b685-44fb-b453-75f318267133/download/documents.zip
Resolving data.gov.au (data.gov.au)... 13.237.239.146, 13.236.21.177, 54.206.208.213, ...
Connecting to data.gov.au (data.gov.au)|13.237.239.146|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2020-10-08 11:52:58 ERROR 404: Not Found.
Dockerfile broken due to Bintray service shutdown
August 2020 data changed directory structure in zip file
May 2020
$ unzip -l may20_gnaf_pipeseparatedvalue_gda2020.zip | grep Extras
0 2020-05-18 17:17 MAY20_GNAF_PipeSeparatedValue_GDA2020/G-NAF/Extras/
0 2020-05-18 17:17 MAY20_GNAF_PipeSeparatedValue_GDA2020/G-NAF/Extras/GNAF_TableCreation_Scripts/
10919 2020-05-18 02:40 MAY20_GNAF_PipeSeparatedValue_GDA2020/G-NAF/Extras/GNAF_TableCreation_Scripts/add_fk_constraints.sql
8714 2020-05-18 02:40 MAY20_GNAF_PipeSeparatedValue_GDA2020/G-NAF/Extras/GNAF_TableCreation_Scripts/create_tables_ansi.sql
8868 2020-05-18 02:40 MAY20_GNAF_PipeSeparatedValue_GDA2020/G-NAF/Extras/GNAF_TableCreation_Scripts/create_tables_sqlserver.sql
[...]August 2020
$ unzip -l aug20_gnaf_pipeseparatedvalue_gda2020.zip | grep Extras
10919 2020-08-16 22:14 G-NAF/Extras/GNAF_TableCreation_Scripts/add_fk_constraints.sql
8714 2020-08-16 22:14 G-NAF/Extras/GNAF_TableCreation_Scripts/create_tables_ansi.sql
8868 2020-08-16 22:14 G-NAF/Extras/GNAF_TableCreation_Scripts/create_tables_sqlserver.sql
295 2020-08-16 22:14 G-NAF/Extras/GNAF_TableCreation_Scripts/README.txt
2294 2020-08-16 22:14 G-NAF/Extras/GNAF_View_Scripts/address_view.sql
[...]I made changes to the regular expressions that parse the August 2020 output in #8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.