Giter VIP home page Giter VIP logo

party-scripts's Introduction

party-scripts

Scripts for pulling from kemono.party and coomer.party. Fortunately these do have an API, so these script(s) are a bit of shorthand for pulling contents.

notes

Requires Python 3.10.x+, be sure to install the contents in requirements.txt.

  • Be aware, there's nothing for tackling the DDoS protection.
  • There's some naive assumptions made for accounting for Imgur links which have ?fb or ?fbplay parameter to build links.
  • Just like bdsmlr-scripts, this dumps aria2 compatible contents (optionally with filenames specified with the --aria2-format arg).
  • The expectation is to just provide a list of links to varying kemono.party users/services (beta not accounted for, but it'd be trivial to account for it if you want).
  • It is heavily advisable that you run something like fdupes/jdupes to remove duplicates after downloading the attachments. There's a ton of them unfortunately.
  • The links collected will require some post processing on your part because of the weird formatting differences between all of the services encountered. It should be fairly simple to edit out the weirdness, then run it through a quick cat links.txt | sort | uniq > new_links.txt type of deal to remedy that.
  • The doubling of lxml xpath and bs4 with regex is to find links that may be properly setup as an HTML a tag, but sometimes posts are plain text, and these are not found. Therefore the link regex should pick it up (it might also pick up undesirable text too FYI).

party-scripts's People

Contributors

6fe9d454 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.