View Code? Open in Web Editor
NEW
This project forked from asenosen/webtracker
Tracking any web page with history by each HTML element
Shell 0.50%
JavaScript 70.45%
Python 23.90%
CSS 2.83%
HTML 2.07%
Dockerfile 0.25%
webtracker's Introduction
- keep cookies for popular web sites
- timer-based scrapping (30m, 1h, 5h, 24h)
- look at history snapshots
- spread fetching by domain name frequency
- use proxy if too fast even after spreading
- use domain db with
domain and last_fetch fields
- shrink snapshot data
- if the same xpath detected in last 5 snapshots, make link instead of file
- do not send repeated data to client (pass same points)
- back click in graph view -> close graph
- text of selected element in toast
- UA sometimes not used (see tiktok page)
- producthunt
- zenlink
- facebook
- google search query "site tracker"
- spy on people's social pages (LinkedIn, Facebook, Instagram, Tiktok)
- spy on people's activity in internet (forums, resumes, blogs)
- track prices and rating changes in any marketplace (Amazon, Alibaba, Noon and many more)
- track new sections and items on web sites (GitHub, new StackOverflow sites)
- track trends changes in web
- track competitor actions in their web sites
- track information changes on web sites
webtracker's People
Contributors
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent