Giter VIP home page Giter VIP logo

Comments (5)

felipemarinho97 avatar felipemarinho97 commented on June 29, 2024 2

Hey @ilike2burnthing ! You are right, this site was not designed to be accessed by many people and there is no guarantee that I will not change the operating behavior, DNS address, etc in the future. Also, when receiving many requests from my server IP, Cloudflare protection from BluDV and Comando may start demanding captcha. So, the ideal scenario is to someone self-host both the Jackett and TorrentIndexer in their PC or server.

It may be possible to implement this directly in jackett, but I think will be hard and the performance will be very low.

My suggestion: add a guide suggesting that users deploy jackett + torrent-indexer locally

from jackett.

garfield69 avatar garfield69 commented on June 29, 2024

Both https://bludv.xyz/ and https://comando.la/ are sites that have a one-title-many-torrents structure, in other words, the search results on the sites only present a poster and some details, but you then have to navigate to the details page of every result in order to fetch the list of one or more magnets.
We try to avoid accessing site like this because of the heavy load on the sites servers as a result of multiple http GET requests, one for the results page, and up to 100 others for the torrent details pages from the results.

Therefore this 3rd party indexer service has to also be performing something similar.
The question i have is, does this 3rd party indexer store the results in its own database by running regular fetches on a scheduled basis, or is it performing the fetches live in response to queries?

In any case I'm reluctant to rely on a 3rd party service to front end a couple web sites to perform a task that Jackett would normally do directly for itself to the source web sites, if only they were not O-T-M-T structured.
@ilike2burnthing thoughts?

from jackett.

ilike2burnthing avatar ilike2burnthing commented on June 29, 2024

So this is using https://github.com/felipemarinho97/torrent-indexer, and appears to be a test site.

I'd want to hear from @felipemarinho97 before doing anything with it, as I don't want it to suddenly get 10K requests every 15mins and we end up crippling someone's home server. It also hasn't been touched in 4mths, and before that for 2yrs, so if it's not actively maintained then even if we don't break it, a change to either site could.

And yes, it mentions caching, but I'd want to know what is actually being cached, because if it's still just crawling pages like we would, then there's not much point is using a midde-man.

from jackett.

jackettbot avatar jackettbot commented on June 29, 2024

Hi @bartche,

No response has been received for 7 days. To prevent issue tracker clutter, this issue will now be closed. To re-open the issue, please provide the information requested and the issue will automatically re-open.

from jackett.

ilike2burnthing avatar ilike2burnthing commented on June 29, 2024

@felipemarinho97 has only made 3 contributions since October last year, and their profile shows they are 'on vacation'. If they come back with an answer we can revisit this.

from jackett.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.