Giter VIP home page Giter VIP logo

memorial_data's Introduction

memorial-data

Data from Memorial (http://memo.ru) in machine readable form:

  • victims of terror of 1930s in Moscow
  • lists of 2614978 victims across Russia
  • geodata for objects of terror

mos.memo.ru

Scraped from source: http://mos.memo.ru

Main datafile is: data/mos.memo.ru/all.csv, includes addresses.

Includes downloading and parsing script.

Portion of these data (Lubyanka area) was geocoded and put on the map here: http://october29.ru/wp/gorod/

License: code - GNU GPL v2 or any later version, data - unknown, possibly CC-BY

Related links:

lists.memo.ru-disk

Data extracted from the MySQL database distributed on "Жертвы политического террора в СССР" disk. CSVs are here: https://github.com/nextgis/memorial_data/blob/master/data/lists.memo.ru-disk/lists.memo.ru-disk.zip

Added SQL queries for create and fill tables.

Date fields convert rule:

day = db_field & 31; // may be empty
month = (db_field >> 5) & 15; // may be empty
year =( (db_field >> 9) & 255) + 1800; 

SQL:

REABDATE_STR = case when REABDATE > 0 then
concat(
if(REABDATE & 31 > 0, concat(lpad( REABDATE & 31,2,'0'),'.'),''),
if((REABDATE >> 5) & 15 > 0, concat(lpad( (REABDATE >> 5) & 15,2,'0'),'.'),''),
if((REABDATE >> 9) & 255 > 0, ((REABDATE >> 9) & 255) + 1800,'')
) 
else null end

Main datafiles are: data/lists.memo.ru-disk, no addresses

License: unknown, possibly CC-BY

Related links:

Topography of terror

Geodata used on the 'Topography of terror' map: http://topos.memo.ru/karta. License: ODbL (OpenStreetMap is a source for building outlines).

Related links:

memorial_data's People

Contributors

kinda-me avatar shoorick avatar simgislab avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

memorial_data's Issues

How i can select data?

Hi
How i can select data?
I built a query:
SELECT
ages.AGE,
books.BOOK,
fnames.FNAME,
lnames.LNAME,
names.NAME,
nations.NATION,
prigovor.PRIGOVOR,
stat.STAT,
sudorg.SUDORG,
works.AWORK,
p.* FROM persons p
LEFT JOIN ages ON p.AGE = ages.AGEID
LEFT JOIN books ON p.BOOK = books.BOOKID
LEFT JOIN fnames ON p.FNAME = fnames.FNAMEID
LEFT JOIN linkbirthye ON p.PERSONID = linkbirthye.PERSONIDL
LEFT JOIN lnames ON p.LNAME = lnames.LNAMEID
LEFT JOIN names ON p.NAME = names.NAMEID
LEFT JOIN nations ON p.NATION = nations.NATIONID
LEFT JOIN prigovor ON p.PRIGOVOR = prigovor.PRIGOVORID
LEFT JOIN stat ON p.STAT = stat.STATID
LEFT JOIN sudorg ON p.SUDORGAN = sudorg.SUDORGID
LEFT JOIN works ON p.AWORK = works.AWORKID

What are link* tables? How can I join them to this data? what is personidl column? Is it another DB?

How to extract birth year?

In the persons page I see birthdate field but it has stange values (59904 for example) and it is not a link to another page af far as I can see. So the question is "How to extract birth year?".

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.