sergiotapia / torrentinim Goto Github PK

A very low memory-footprint, self hosted API-only torrent search engine. Sonarr + Radarr Compatible, native support for Linux, Mac and Windows.

License: MIT License

Nim 96.34% Dockerfile 2.49% Makefile 1.17%

self-hosted p2p search-engine torrent bittorrent torrent-search-engine radarr sonarr

torrentinim's People

Contributors

Stargazers

Watchers

torrentinim's Issues

Not understanding how it work

I ran torrentinim with ./torrentinim on macos in the terminal. And it crawl all the torrent site endlessly

I thought it was a torrent search engine which request all the torrent site simultaneously and display the result.

Am i missing something? Why would anyone want to download the whole torrent websites when they can just request only the thing they want?

[Feature request] qBittorrent search plugin

This.

If I have the time, later this week I'll try to write a plugin for qBitorrent

terminal displays all "Insert not successful" messages

MacOS version v0.5.0

The terminal shows nearly all "Insert not successful" messages, one for each item. No other error message or debugging info is displayed.

torrentinim-data.db file is 3.2MB, plenty of disk space left on the computer.

Let me know if I can provide any further information.

[feature request] DHT crawler support

Would it be possible to support a DHT crawler mode, a là BTDig (https://github.com/btdigg-org/dhtcrawler2)?

Would be nice to have even a lite version of that running locally.

`could not load: sqlite3_64.dll` on windows 10

could not load: sqlite3_64.dll
It's all i get from the output in terminal

This project related:

Nim related:

nim-lang/Nim#12097

libwinpthread-1.dll was not found

OS: Windows 11 Pro 23H2 22631.3085

Porter tokenizer yields no search results when querying non-ASCII characters.

Should unicode61 tokenizer be used?

Push tagged releases to Docker Registry

Greetings! I'd like to use Torrentinim in conjunction with docker-compose but I'd prefer to not build the image every time. If you're accepting PRs, I propose:

Build the Dockerfile for every tagged release
Publish the image to ghcr.io/sergiotapia/torrentinim

This could all be added to the existing release-asset.yaml workflow.

Add support for torrentapi

Get a token:
https://torrentapi.org/pubapi_v2.php?get_token=get_token&app_id=miamidogtest

https://torrentapi.org/pubapi_v2.php?mode=search&format=json_extended&sort=seeders&search_string=x265&token=5j2xvghi8c&app_id=miamidogtest

Figure out how to get a list of latest N torrents from this API and periodically ask for latest.
https://github.com/serenader2014/rarbg-api/blob/master/src/utils.js

Compile for other architectures

Currently, only builds for x86_64 are available.

Would be very helpful to compile for other architectures such as arm64, armhf, thanks.

Stuck on "403 Forbidden crawler error..."

403 Forbidden
2024-02-08T13:46:21+00:00 [1337x] Crawler error, restarting...
2024-02-08T13:46:21+00:00 [1337x] Starting 1337x crawl
2024-02-08T13:46:21+00:00 [1337x] Download html: https://1337x.to/cat/Anime/1/
403 Forbidden
2024-02-08T13:46:22+00:00 [1337x] Crawler error, restarting...
2024-02-08T13:46:22+00:00 [1337x] Starting 1337x crawl
2024-02-08T13:46:22+00:00 [1337x] Download html: https://1337x.to/cat/Anime/1/

Maybe add flag/env to disable broken site?

issues related to initDatabase

Hey,
I've cloned master branch and built sources with nimble build (using nim 1.4.8 on MacOS). After successful build I am unable to initialize sqlite database as below:

NUKE_MY_DATABASE=true ./torrentinim

[system] Database nuke requested. Clearing all database tables and data.
/Users/slawek/src-oth/torrentinim/src/torrentinim.nim(23) torrentinim
/Users/slawek/src-oth/torrentinim/src/database.nim(18) initDatabase
/usr/local/Cellar/nim/1.4.8/nim/lib/impure/db_sqlite.nim(227) exec
/usr/local/Cellar/nim/1.4.8/nim/lib/impure/db_sqlite.nim(147) dbError
Error: unhandled exception: near "-": syntax error [DbError]

I believe the problem persist because of lack of quotes around utf-8 here.

Create Docker Container version of Torrentinim

There currently is no Docker container version of Torrentinim on the docker hub. Creating one, would greatly expand the reach of Torrentinim among users.

So I've been trying to set up torrentinim, and bumped into a problem: A bunch of tracker sites are banned around here and thus inaccessible. Of course, I have circumvention methods, but they're primarily a SOCKS proxy.

So I tried to run torrentinim through tsocks. Getting tsocks to work at all took some time, but I'm definite it is working:

$ TSOCKS_CONF_FILE=/xxx/etc/tsocks.conf tsocks wget -qO - https://www.showmemyip.com/ | grep "<title>"
                <title>Show Me My IP! - Your IP address is: xx.xx.xx.xx</title>

But when I try to run torrentinim under tsocks, this happens:

$ TSOCKS_CONF_FILE=/xxx/etc/tsocks.conf tsocks torrentinim                            
2021-08-12T18:28:00+03:00 [eztv] Starting EZTV crawl                                                     
2021-08-12T18:28:00+03:00 [1337x] Starting 1337x crawl                                                   
2021-08-12T18:28:00+03:00 [1337x] Download html: https://1337x.to/cat/Anime/1/
2021-08-12T18:28:00+03:00 [nyaa] Starting Nyaa crawl                                                     
2021-08-12T18:28:00+03:00 [nyaa-pantsu] Starting NyaaPantsu crawl                                        
2021-08-12T18:28:00+03:00 [yts] Starting YTS crawl                                                       
2021-08-12T18:28:00+03:00 [torrentdownloads] Starting TorrentDownloads.me crawl                                                                                                                                    
2021-08-12T18:28:00+03:00 [thepiratebay] Starting ThePirateBay crawl                                     
2021-08-12T18:28:00+03:00 [rarbg] Starting Rarbg crawl                                                   
Torrentinim is running, bambino. http://localhost:50123                                                  
2021-08-12T18:28:00+03:00 [eztv] Crawler error, restarting...                                            
2021-08-12T18:28:00+03:00 [eztv] Starting EZTV crawl                                                     
2021-08-12T18:28:00+03:00 [nyaa] Crawler error, restarting...           
2021-08-12T18:28:00+03:00 [nyaa] Starting Nyaa crawl                                                     
2021-08-12T18:28:00+03:00 [nyaa-pantsu] Crawler error, restarting...                                     
2021-08-12T18:28:00+03:00 [nyaa-pantsu] Starting NyaaPantsu crawl                                        
2021-08-12T18:28:00+03:00 [yts] Crawler error, restarting...                                                                                                                                                       
2021-08-12T18:28:00+03:00 [yts] Starting YTS crawl                                                       
2021-08-12T18:28:00+03:00 [torrentdownloads] Crawler error, restarting...                             
2021-08-12T18:28:00+03:00 [torrentdownloads] Starting TorrentDownloads.me crawl                          
2021-08-12T18:28:00+03:00 [thepiratebay] Crawler error, restarting...                                                                                                                                              
2021-08-12T18:28:00+03:00 [thepiratebay] Starting ThePirateBay crawl                                     
2021-08-12T18:28:00+03:00 [rarbg] Crawler error, restarting...                                           
2021-08-12T18:28:00+03:00 [rarbg] Starting Rarbg crawl

And it just loops infinitely.

Is there any hope of native proxy support? Failing that, any ideas why it's not working?

Release doesn't run on Windows 10 Pro

When trying to run as Administrator:

When I download and manually place the libwinpthread-1.dll file next to the .exe:

App not crawling

Ran ./torrentinim nuke_my_database as first time run on ubuntu 18.04 server.

./torrentinim nuke_my_database
[database] Initializing database
[eztv] Starting EZTV crawl
[1337x] Starting 1337x crawl
[1337x] Download html: https://1337x.to/cat/Anime/1/
[nyaa] Starting Nyaa crawl
[nyaa-pantsu] Starting NyaaPantsu crawl
[nyaa-sukebei] Starting Nyaa Sukebei crawl
[yts] Starting YTS crawl
[torrentdownloads] Starting TorrentDownloads.me crawl
[thepiratebay] Starting ThePirateBay crawl
[rarbg] Starting Rarbg crawl
INFO Jester is making jokes at http://0.0.0.0:50123
Starting 24 threads
Listening on port 50123

And it stops there. I let it run for 1 hour with no other output from the app. Checking the database, its size is 1.1MB. I ran it on another ubuntu 18.04 server box with the same results.
torrentinim-data.db.zip

How to use it on Linux?

Hello,
on Arch Linux, the package i have installed it like this: pamac build torrentinim-bin
$ man torrentinim
No manual entry for torrentinim
$ torrentinim -h
shows no help either, but launch the app which starts crawling some torrents without asking my permission
accidentaly i have found http://localhost:50123 in the output, but this site only notify me that the app is running, so i do not know how to manage the app - see no interface when i have lunched it via command line as shown above. And my Linux Arch based XFCE desktop environment menu does not find the torrentinim launch entry.

So maybe it can be improved to be less confusing to noob.

Search either not picking items up or picking random items

Had a quick look at this and setup a version to trial, but having issues with the search as it seems to either pick up random results, or none at all.

e.g. In my database I have a few like;

When searching from the web I get random results returned (/search?query=surfing&page=1);

Possibly something I am missing? Although this seems to do it for most results I try and return. Any ideas what I could try?

Endless loop when tried to run the program.

My environment: Windows 8.1 64

I tried to run it but the program asked for sqlite3_64.dll. I downloaded the latest sqlite version (64-bit DLL (x64) for SQLite 3.36.0), renamed the sqlite3.dll to sqlite3_64.dll and dropped it into torrentinim directory.

Now when I run the torrentinim, I have an endless(?) "crawler error", like below:

c:\Apps\Torrentinim_windows
λ torrentinim              
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl         
SIGINT: Interrupted by Ctrl-C.                               
                                                             
c:\Apps\Torrentinim_windows                                  
λ

sergiotapia / torrentinim Goto Github PK

torrentinim's People

Contributors

Stargazers

Watchers

Forkers

torrentinim's Issues

Recommend Projects

Recommend Topics

Recommend Org