lmao420blazeit / tw_bot Goto Github PK

TribalWars (TW) scrapper is a high level fast web crawling API built on Requests and BeautifulSoup used to extract structured data (JSON format) and crawl TW pages. It can be used for a wide range of purposes, including simulating web-browser actions undetected, insert and plan custom commands, data mining with the market database, world data and reports analyzes (WIP)

• Client: modified requests.Requets class to throttle the number of requets and avoid bot detection
• Session: session handler singleton which insures the class has only one instance. Each session has a specific crsf_token and session_id cookies and terminates the previous session. Helpful with concurrency.
• User Endpoint (Extends Session): contains get methods for user data
• Actions Endpoint (Extends Session): contains post methods for village_id
• Village Endpoint (Extends Session): contains get methods for village_id
• World: contains get methods for public accessible data. Helpful to monitor user, ally, village activity by tracking attack/defense stats, village/user/ally points, etc

• Python 3.7+
• Works on Linux, Windows, macOS, BSD

Replace JSON format to GraphQL (Graphene) Integrate CURL and Postman for API testing