Giter VIP home page Giter VIP logo

Comments (7)

miraclx avatar miraclx commented on July 18, 2024

Hi there, can you try a smaller playlist? Create one much like yours with a smaller set of songs, and see that.

It could be that the playlist is private so freyr cannot access it, unsure.

What's the total runtime?

from freyr-js.

JustTooKrul avatar JustTooKrul commented on July 18, 2024

Very odd, but I literally just retried it a number of times and eventually (I would say on the 10th try or so, and with the extra long time out) it just "worked" ... However, it stopped partway through with a message "Program was killed." ... But, I re-tried it a number of times again and eventually it worked again and skipped what was already there and completed.

I kept retrying because it was a new list, so I thought maybe it wouldn't be accessible yet and might take some time to propagate, but then it wouldn't have stopped working after it worked that first time.

I had also downloaded 3-4 other lists, and it worked for those (largest was ~600 or so tracks).

from freyr-js.

miraclx avatar miraclx commented on July 18, 2024

Interesting, there's a chance the kernel is killing the process for excessive memory use

Can you highlight which platform you're running this on, and the resources available

Perhaps we can track how much memory was in use before the process dies

from freyr-js.

JustTooKrul avatar JustTooKrul commented on July 18, 2024

It's a VM, through proxmox, that I have setup to use 4 CPUs and 32GB of memory with a 100GB disk... Hard to know how much this was taking up, since I have a few things running on it (this machine runs Docker, and has a number of images spun up). What else would be helpful to know or what outputs can I run to show you what you need?

from freyr-js.

miraclx avatar miraclx commented on July 18, 2024

Can you time the runtime with verbose logs?

There's different variants of the time command so it's tricky to say which command you should use

But if which time says it's a shell built in, you need to install the binary

Thereafter, test it with either -v, -l or -p

What were gunning for here is a multiline report of multiple data points including memory (resident set size)

from freyr-js.

JustTooKrul avatar JustTooKrul commented on July 18, 2024

So, funny story, it worked when I ran it....

Here is the output (including the summary from freyr):

============ Stats ============
 [•] Runtime: [53m 25.3s]
 [•] Total queries: [01]
 [•] Total tracks: [1046]
     » Skipped: [00]
     ✓ Passed:  [1044]
     ✕ Failed:  [02]
 [•] Output directory: [.]
 [•] Total Output size: 9.83 GB
 [•] Total Network Usage: 4.11 GB
     ♫ Media: 4.00 GB
     ➤ Album Art: 118.91 MB
 [•] Output bitrate: 320k
===============================
        Command being timed: "freyr --timeout 100000 https://music.apple.com/us/playlist/[xxx]"
        User time (seconds): 8345.58
        System time (seconds): 760.41
        Percent of CPU this job got: 283%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 53:30.42
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 28337520
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 786490
        Minor (reclaiming a frame) page faults: 70238115
        Voluntary context switches: 2778902
        Involuntary context switches: 33457041
        Swaps: 0
        File system inputs: 149081320
        File system outputs: 46366520
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

I then tried it again, and it failed....

➤ Tracks: 1077
 [•] Collating...
  [•] Inquiring tracks...(failed: [expecting an array or an iterable object but got [object Null]])
 [i] An error occurred while processing the query (Failed to collect playlist tracks)
============ Stats ============
 [•] Runtime: [23.4s]
 [•] Total queries: [01]
 [•] Total tracks: [00]
     » Skipped: [00]
     ✓ Passed:  [00]
     ✕ Failed:  [00]
 [•] Output directory: [.]
 [•] Total Output size: 0.00 B
 [•] Total Network Usage: 0.00 B
     ♫ Media: 0.00 B
     ➤ Album Art: 0.00 B
 [•] Output bitrate: 320k
===============================
        Command being timed: "freyr --timeout 100000 https://music.apple.com/us/playlist/[xxx]"
        User time (seconds): 1.63
        System time (seconds): 0.19
        Percent of CPU this job got: 7%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 0:24.52
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 128952
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 408
        Minor (reclaiming a frame) page faults: 34364
        Voluntary context switches: 4426
        Involuntary context switches: 3820
        Swaps: 0
        File system inputs: 73688
        File system outputs: 8
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

from freyr-js.

miraclx avatar miraclx commented on July 18, 2024

Thanks for the logs, will investigate

from freyr-js.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.