- CNA
- The Strait Times
- SCMP
- Mothership.sg
- The Guardian
- The New York Times
- The Online Citizen
- The Independent SG
- Today Online
python cna/crawler.py
python mothership/ms_sel.py
python mothership/get_data.py
python parse_archive.py
- Today Online has no time stamp. Only published date available.
- Can not crawl from The Independent SG. Auto blocking crawlers.
- Can only crawl 'Today Online' until Jan 22, 2020
- CNA Timestamp
- Strait Times Timestamp
- Mothership Timestamp
- NYT Timestamp
- TOC Timestamp
- Combine with manual data