Resume data too large? (both with fastresume files and sqlite) about qbittorrent HOT 19 OPEN

@ivan-yu, your issue is unrelated to this issue.

from qbittorrent.

It makes sense to limit the size of some input files, such as torrent files, but does it for ones created by qBittorrent itself? It leads to such annoying behavior when qBittorrent cannot load files created by itself earlier so this always was looked like not a good idea for me.

from qbittorrent.

Does this "File size exceeds limit" error happen on qBittorrent 4.6.3 as well?

from qbittorrent.

@androgeosone, can you provide a .torrent file or hash (if it's not a private torrent) for testing?

from qbittorrent.

I have a very similar issue after I upgraded from 4.6.3-2.0.9 to 4.6.4-2.0.10. All my fastresume files cannot be opened.
All the QT file open calls failed with a non-sense large file size just like yours.
I do not have this issue in 4.6.3-2.0.9

Mine is like this

(C) 2024-04-28T16:29:05 - Failed to resume torrent. Torrent: "14ee1e4c0bd612f786393376e94ff872b6e87cfa". Reason: "File size exceeds limit. File: "/usr/local/AppCentral/qbittorrent-native/home/.local/share/qBittorrent/BT_backup/14ee1e4c0bd612f786393376e94ff872b6e87cfa.fastresume". File size: 548318599328. Size limit: 104857600"

from qbittorrent.

@stalkerok, Ok, very well.

@androgeosone, Just curious on your error.
Is 402353016 really the file size of the fastresume file?

from qbittorrent.

Sadly I can't share the original 1.4TB torrent that caused this issue, but researching this issue has led to another one (approx 700GB) that causes the same issue on a Windows Server host with 2x Xeon Gold 6150 CPUs and 768GB of RAM.

The torrent initially starts and works just fine, but eventually the fastresume data (or corresponding blob in sqlite) grows too large and the torrent becomes impossible to resume without a force-recheck on each startup of QB. Needless to say with multi terabyte torrents that can take a long time.

magnet:?xt=urn:btih:658636d2b62cf53b2bae1ddc5e22bf9961b9b585&xt=urn:btmh:122040bfd3136fff559bfe0c72192bb517d252401ef497f4ac52fb7bf82dcae2a1d3

Please be aware the that contents of the above magnet link are pornographic in nature.

from qbittorrent.

@stalkerok, Ok, very well.

@androgeosone, Just curious on your error. Is 402353016 really the file size of the fastresume file?

The .fastresume file size at one point was: 1033073767
I don't know the exact size at the time of that log message - but it was certainly over 1GB. For reference, out of all the other 137 torrents I have loaded at the time, the next largest one is only 4MB-ish fastresume data.

The current sqlite stats:

torrents.db: 2017116160
torrents.db-shm: 3342336
torrents.db-wal: 2021758192

Prior to adding the large torrent the torrents.db was around 24MB - it has bloated by more than 2GB due to the large torrent. No others have been added since.

Edit: Fix typo

from qbittorrent.

I added the test torrent to the main client (on lt 1.2), I'll have to watch it longer, a quick test didn't reveal anything (only used .fastresume).

from qbittorrent.

The issue is on
Libtorrent: 2.0.11.0
not LT 1.2 ?

from qbittorrent.

I don't use lt2.0 on a regular basis and rarely test anything because it's garbage, but a quick test showed that lt2.0 is indeed the problem.
02.05.2024 21:05 - Failed to resume torrent. Torrent: "40bfd3136fff559bfe0c72192bb517d252401ef4". Reason: "File size exceeds limit. File: "/profile/qBittorrent/data/BT_backup/40bfd3136fff559bfe0c72192bb517d252401ef4.fastresume". File size: 176473699. Size limit: 104857600"

from qbittorrent.

@androgeosone
FYI there is a ".torrent file size limit" option in Options dialog (under Advanced tab) that you can adjust to your need. Make it larger than your .fastresume file size then it should load. This only applies if you were using fastresume storage type.

magnet:?xt=urn:btih:658636d2b62cf53b2bae1ddc5e22bf9961b9b585&xt=urn:btmh:122040bfd3136fff559bfe0c72192bb517d252401ef497f4ac52fb7bf82dcae2a1d3

Just want to point out this torrent is a hybrid torrent, might be relevant.

from qbittorrent.

magnet:?xt=urn:btih:658636d2b62cf53b2bae1ddc5e22bf9961b9b585&xt=urn:btmh:122040bfd3136fff559bfe0c72192bb517d252401ef497f4ac52fb7bf82dcae2a1d3

Just want to point out this torrent is a hybrid torrent, might be relevant.

I believe it is content of merkle tree that is saved in resume data for v2/hybrid torrents.

from qbittorrent.

@stalkerok
Is this really not the same as my issue then?

@glassez
I have reported a similar issue (at least the exact same error logs), can LT2.0.10 be the real root cause?
#20772

from qbittorrent.

Make it larger than your .fastresume file size then it should load.

It works, the file size of .fastresume is 172 MB.

from qbittorrent.

@stalkerok Is this really not the same as my issue then?

@glassez I have reported a similar issue (at least the exact same error logs), can LT2.0.10 be the real root cause? #20772

Do you really not see that they are completely different? In your case, it gets an incorrect file size. In this case, the file size does actually exceed the set limit.

from qbittorrent.

@glassez
Thank you for your explanation. I did miss the point of all my error log lines are the same non sense large file size number.

from qbittorrent.

@androgeosone Did you compile the build yourself?

The reason I ask, is that I noticed you were looking in to compiling/wiki - #20100

Qt: 6.6.1
OpenSSL: 3.2.1

These dependencies are not part of the official releases.

".torrent file size limit"

We might need to raise default?!

from qbittorrent.

We might need to raise default?!

Up to 200MB maybe? The .torrent file itself is only 574KB in size.
And change the text a bit, add .fastresume ".fastresume/.torrent file size limit" if this limit affects .fastresume files as well.

from qbittorrent.