theultimatec0der / deemixrr Goto Github PK

Hi there,

is it also possible so periodically download Spotify-playlists similar to the feature from the Deemix-GUI?
Would be pretty nice for all the users who mainly use Spotify for listening and Deezer only for downloading :)

Thx in advance and have a great day!

Im trying to install Deemixrr with the compose.yml but during the installing its getting stuck at the line:
mssql_1
Its running now for 1 hour and still no progress.

This is the log:

deemixrr_1 | [cont-init.d] 10-adduser: exited 0.
deemixrr_1 | [cont-init.d] 30-install-deemix: executing...
deemixrr_1 | [cont-init.d] Installing Deemix ...
mssql_1 | 2020-10-17 22:14:45.45 Server Microsoft SQL Server 2017 (RTM-CU13) (KB4466404) - 14.0.3048.4 (X64)
mssql_1 Nov 30 2018 12:57:58
mssql_1 Copyright (C) 2017 Microsoft Corporation
mssql_1 Developer Edition (64-bit) on Linux (Ubuntu 16.04.5 LTS)
2020-10-17 22:14:45.46 Server UTC adjustment: 0:00
2020-10-17 22:14:45.46 Server (c) Microsoft Corporation.
2020-10-17 22:14:45.46 Server All rights reserved.
2020-10-17 22:14:45.46 Server Server process ID is 4124.
2020-10-17 22:14:45.47 Server Logging SQL Server messages in file '/var/opt/mssql/log/errorlog'.
2020-10-17 22:14:45.47 Server Registry startup parameters:
mssql_1 -d /var/opt/mssql/data/master.mdf
mssql_1 -l /var/opt/mssql/data/mastlog.ldf
mssql_1 -e /var/opt/mssql/log/errorlog
2020-10-17 22:14:45.47 Server SQL Server detected 1 sockets with 4 cores per socket and 8 logical processors per socket, 8 total logical processors; using 8 logical processors based on SQL Server licensing. This is an informational message; no user action is required.
2020-10-17 22:14:45.49 Server SQL Server is starting at normal priority base (=7). This is an informational message only. No user action is required.
2020-10-17 22:14:45.49 Server Detected 51366 MB of RAM. This is an informational message; no user action is required.
2020-10-17 22:14:45.50 Server Using conventional memory in the memory manager.
2020-10-17 22:14:45.51 Server Large Page Allocated: 32MB
2020-10-17 22:14:45.90 Server Buffer pool extension is already disabled. No action is necessary.
2020-10-17 22:14:46.11 Server InitializeExternalUserGroupSid failed. Implied authentication will be disabled.
2020-10-17 22:14:46.11 Server Implied authentication manager initialization failed. Implied authentication will be disabled.
2020-10-17 22:14:46.11 Server Successfully initialized the TLS configuration. Allowed TLS protocol versions are ['1.0 1.1 1.2']. Allowed TLS ciphers are ['ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA:ECDHE-ECDSA-AES128-SHA:AES256-GCM-SHA384:AES128-GCM-SHA256:AES256-SHA256:AES128-SHA256:AES256-SHA:AES128-SHA:!DHE-RSA-AES256-GCM-SHA384:!DHE-RSA-AES128-GCM-SHA256:!DHE-RSA-AES256-SHA:!DHE-RSA-AES128-SHA'].
deemixrr_1 | [cont-init.d] Installing Deemix: Done!
deemixrr_1 | [cont-init.d] 30-install-deemix: exited 0.
deemixrr_1 | [cont-init.d] 40-permissions: executing...
deemixrr_1 | [cont-init.d] Setting permissions on /app ...
deemixrr_1 | [cont-init.d] Setting permissions on /app Done!
deemixrr_1 | [cont-init.d] 40-permissions: exited 0.
2020-10-17 22:14:46.16 Server The maximum number of dedicated administrator connections for this instance is '1'
2020-10-17 22:14:46.16 Server Node configuration: node 0: CPU mask: 0x00000000000000ff:0 Active CPU mask: 0x00000000000000ff:0. This message provides a description of the NUMA configuration for this computer. This is an informational message only. No user action is required.
deemixrr_1 | [cont-init.d] 99-custom-scripts: executing...
deemixrr_1 | [custom-init] no custom files found exiting...
deemixrr_1 | [cont-init.d] 99-custom-scripts: exited 0.
deemixrr_1 | [cont-init.d] done.
deemixrr_1 | [services.d] starting services
deemixrr_1 | [services.d] done.
2020-10-17 22:14:46.28 Server Using dynamic lock allocation. Initial allocation of 2500 Lock blocks and 5000 Lock Owner blocks per node. This is an informational message only. No user action is required.
2020-10-17 22:14:46.28 Server In-Memory OLTP initialized on standard machine.
2020-10-17 22:14:46.38 Server Database Instant File Initialization: enabled. For security and performance considerations see the topic 'Database Instant File Initialization' in SQL Server Books Online. This is an informational message only. No user action is required.
ForceFlush is enabled for this instance.
2020-10-17 22:14:46.40 Server Query Store settings initialized with enabled = 1,
2020-10-17 22:14:46.41 spid6s Starting up database 'master'.
2020-10-17 22:14:46.41 Server Software Usage Metrics is disabled.
deemixrr_1 | info: Microsoft.AspNetCore.DataProtection.KeyManagement.XmlKeyManager[0]
deemixrr_1 | User profile is available. Using '/config/.aspnet/DataProtection-Keys' as key repository; keys will not be encrypted at rest.
ForceFlush feature is enabled for log durability.
2020-10-17 22:14:46.94 spid6s Resource governor reconfiguration succeeded.
2020-10-17 22:14:46.94 spid6s SQL Server Audit is starting the audits. This is an informational message. No user action is required.
2020-10-17 22:14:46.96 spid6s SQL Server Audit has started the audits. This is an informational message. No user action is required.
2020-10-17 22:14:47.10 spid6s SQL Trace ID 1 was started by login "sa".
2020-10-17 22:14:47.14 spid6s Server name is '7003c72e517d'. This is an informational message only. No user action is required.
2020-10-17 22:14:47.17 spid22s Starting up database 'msdb'.
2020-10-17 22:14:47.17 spid23s Starting up database 'Deemixrr'.
2020-10-17 22:14:47.17 spid8s Starting up database 'mssqlsystemresource'.
2020-10-17 22:14:47.18 spid24s Always On: The availability replica manager is starting. This is an informational message only. No user action is required.
2020-10-17 22:14:47.19 spid24s Always On: The availability replica manager is waiting for the instance of SQL Server to allow client connections. This is an informational message only. No user action is required.
2020-10-17 22:14:47.19 spid8s The resource database build version is 14.00.3048. This is an informational message only. No user action is required.
2020-10-17 22:14:47.26 spid8s Starting up database 'model'.
2020-10-17 22:14:47.44 spid18s A self-generated certificate was successfully loaded for encryption.
2020-10-17 22:14:47.46 spid18s Server is listening on [ 'any' 1433].
2020-10-17 22:14:47.47 Server Server is listening on [ 127.0.0.1 1434].
2020-10-17 22:14:47.48 Server Dedicated admin connection support was established for listening locally on port 1434.
2020-10-17 22:14:47.52 spid18s SQL Server is now ready for client connections. This is an informational message; no user action is required.
deemixrr_1 | info: Microsoft.EntityFrameworkCore.Infrastructure[10403]
deemixrr_1 | Entity Framework Core 3.1.7 initialized 'AppDbContext' using provider 'Microsoft.EntityFrameworkCore.SqlServer' with options: None
2020-10-17 22:14:47.82 spid23s Parallel redo is started for database 'Deemixrr' with worker pool size [4].
2020-10-17 22:14:47.87 spid8s Polybase feature disabled.
2020-10-17 22:14:47.88 spid8s Clearing tempdb database.
2020-10-17 22:14:47.98 spid6s Parallel redo is shutdown for database 'Deemixrr' with worker pool size [4].
2020-10-17 22:14:48.51 spid8s Starting up database 'tempdb'.
2020-10-17 22:14:48.83 spid8s The tempdb database has 1 data file(s).
2020-10-17 22:14:48.83 spid26s The Service Broker endpoint is in disabled or stopped state.
2020-10-17 22:14:48.83 spid26s The Database Mirroring endpoint is in disabled or stopped state.
2020-10-17 22:14:48.86 spid26s Service Broker manager has started.
2020-10-17 22:14:48.88 spid6s Recovery is complete. This is an informational message only. No user action is required.
deemixrr_1 | info: Microsoft.EntityFrameworkCore.Database.Command[20101]
deemixrr_1 | Executed DbCommand (19ms) [Parameters=[], CommandType='Text', CommandTimeout='30']
deemixrr_1 | SELECT 1
deemixrr_1 | info: Microsoft.EntityFrameworkCore.Database.Command[20101]
deemixrr_1 | Executed DbCommand (13ms) [Parameters=[], CommandType='Text', CommandTimeout='30']
deemixrr_1 | SELECT OBJECT_ID(N'[__EFMigrationsHistory]');
deemixrr_1 | info: Microsoft.EntityFrameworkCore.Database.Command[20101]
deemixrr_1 | Executed DbCommand (1ms) [Parameters=[], CommandType='Text', CommandTimeout='30']
deemixrr_1 | SELECT 1
deemixrr_1 | info: Microsoft.EntityFrameworkCore.Database.Command[20101]
deemixrr_1 | Executed DbCommand (0ms) [Parameters=[], CommandType='Text', CommandTimeout='30']
deemixrr_1 | SELECT OBJECT_ID(N'[__EFMigrationsHistory]');
deemixrr_1 | info: Microsoft.EntityFrameworkCore.Database.Command[20101]
deemixrr_1 | Executed DbCommand (10ms) [Parameters=[], CommandType='Text', CommandTimeout='30']
deemixrr_1 | SELECT [MigrationId], [ProductVersion]
deemixrr_1 | FROM [__EFMigrationsHistory]
deemixrr_1 | ORDER BY [MigrationId];
deemixrr_1 | info: Microsoft.EntityFrameworkCore.Migrations[20405]
deemixrr_1 | No migrations were applied. The database is already up to date.
deemixrr_1 | info: Hangfire.SqlServer.SqlServerObjectsInstaller[0]
deemixrr_1 | Start installing Hangfire SQL objects...
deemixrr_1 | info: Hangfire.SqlServer.SqlServerObjectsInstaller[0]
deemixrr_1 | Hangfire SQL objects installed.
deemixrr_1 | info: Hangfire.BackgroundJobServer[0]
deemixrr_1 | Starting Hangfire Server using job storage: 'SQL Server: mssql@Deemixrr'
deemixrr_1 | info: Hangfire.BackgroundJobServer[0]
deemixrr_1 | Using the following options for SQL Server job storage: Queue poll interval: 00:00:15.
deemixrr_1 | info: Hangfire.BackgroundJobServer[0]
deemixrr_1 | Using the following options for Hangfire Server:
deemixrr_1 | Worker count: 2
deemixrr_1 | Listening queues: 'default'
deemixrr_1 | Shutdown timeout: 00:00:15
deemixrr_1 | Schedule polling interval: 00:00:15
deemixrr_1 | info: Hangfire.Server.BackgroundServerProcess[0]
deemixrr_1 | Server dac2a696124a:3390:2587e730 successfully announced in 146.1286 ms
deemixrr_1 | info: Hangfire.Server.BackgroundServerProcess[0]
deemixrr_1 | Server dac2a696124a:3390:2587e730 is starting the registered dispatchers: ServerWatchdog, ServerJobCancellationWatcher, ExpirationManager, CountersAggregator, Worker, DelayedJobScheduler, RecurringJobScheduler...
deemixrr_1 | info: Hangfire.Server.BackgroundServerProcess[0]
deemixrr_1 | Server dac2a696124a:3390:2587e730 all the dispatchers started
deemixrr_1 | info: Microsoft.Hosting.Lifetime[0]
deemixrr_1 | Now listening on: http://0.0.0.0:5000
deemixrr_1 | info: Microsoft.Hosting.Lifetime[0]
deemixrr_1 | Application started. Press Ctrl+C to shut down.
deemixrr_1 | info: Microsoft.Hosting.Lifetime[0]
deemixrr_1 | Hosting environment: Production
deemixrr_1 | info: Microsoft.Hosting.Lifetime[0]
deemixrr_1 | Content root path: /app
mssql_1 |

Any idea?
Thanks!

The README says "work is ongoing to get everything working again" but I don't see any commit before that, is this actually coming back?

I'm trying to add this to the script at https://github.com/coder8338/appbox_installer for coder8338/appbox_installer#3

However the URL needs to be http://0.0.0.0:5000/deemixrr as we're using an nginx proxy and cannot create subdomains.

Using Kestrel__EndPoints__Http__Url=http://0.0.0.0:5555/deemixrr results in System.InvalidOperationException: A path base can only be configured using IApplicationBuilder.UsePathBase().

Is this possible or a feature you would consider?

The updated size calculation for folders could be rounded to 2 or 3 decimal places so that this kind of thing doesn't happen. We don't really need that level of detail when the units are so large.

Hi,

is it possible to create the container in arm64 for raspberry pi users,

Thank you !

I was about to start setting this up when I noticed that the example docker-compose.yml uses MSSQL as its storage engine. Coming from an open source background I would expect this to either use mysql/mariadb, or even sqlite.

I will admit, I'm biased against MS based products, and would assume the motivation might be familiarity? If there is a performance or feature related argument I would be glad to be educated.

MySQL: Probably an industry standard for many open source projects, likely to already be running on a host machine
MariaDB: Same as above, somewhat better performance and other perks.
Sqlite: Lightweight, can save into main config directory, no dependencies on other images (most of my other services use something like this)
Postgres: Better performance I believe, I'm no expect on it but some admins prefer it
Flat files: Depends on what you are storing, if it is a config file with credentials and a list of artists maybe the DB isn't even a necessary tool?

Often with tools like this, you see the default storage engine sqlite/flat files, with the option for a more performant database for advanced users.

I'm still considering using this tool as-is, but currently have two options:

1. Take the MSSQL requirement, knowing it will run but have reservations and an icky feeling in the back of my mind
2. Try to point it at an existing MySQL container, cross my fingers and hope it works.

An error occurred while processing your request
Request ID: 00-33ca4babf705b646b487fe8043b1ca60-526f04974e027940-00

.arl exists and is readable to all. setup via docker-compose on a QNAP NAS. even when using the arl setup screen it refuses to create / update the arl, any ideas?

Expose a page to allow the user to trigger background jobs to update all playlists (to download more tracks that are not on the filesystem)

Is there any way to set the download format of all songs to MP3 instead of FLAC?

Hello. Is there anyway to create a container the standard docker create way?

eg

docker create \
--name=Plex \
--net=host \
--restart=always \
-e VERSION=docker \
-e PUID=1000 \
-e PGID=1000 \
-e TZ=Europe/London \
-v /mnt/Storage:/data \
-v /mnt/SSD/Containers/Plex/transcode:/transcode \
-v /mnt/SSD/Containers/Plex/db:/config \
linuxserver/plex

Thanks,
Chris

Hi,
great project. Thanks for sharing!
Is it possible to add the option to let Deemixrr only download the latest album/release of an artist?
I have to retagg, rename and move all of the downloads so it would be nice if Deemixrr only loads
the latest and future releases of an artist.

Hi,
It would be nice to have the ability to select what type of releases we want, for exemple download only Albums, not singles or compilations

There appear to be a few different actions that deemixrr handles, but they are always blocked by any download tasks that are being processed. I propose either changing the default priority order, or allowing the user to set task priorities.

suggested order:

1. settings change
2. artist delete
3. playlist delete
4. folder delete
5. playlist add
6. artist add
7. folder add
8. folder scan
9. file download

file downloads should be the lowest priority because they can be the most time consuming task and it appears to block everything else from happening, while not being a cancel or pause-able action.

perhaps show a list of active tasks and allow the user to pause them individually to allow others to complete.

Can you please build and ARM docker image for raspberry pi?

Expose a page to allow the user to trigger background jobs to update all artists (to download more tracks that are not on the filesystem)

Hello,

I followed the Linux instructions and after setting up, every time a page loads it redirects to HTTPS. Whenever it does this, I receive this error.

Would be cool if deemixrr could automatically download new tracks that are added to a playlist as well as an updated playlist file. So the idea is monitor for new tracks added or removed. Check to see if they have been downloaded by checking plex music library. Then add the playlist to plex library.

all the href for the dropdown menu items profile, settings and activities are set to '#'
no pages are loading making the menu items useless

Is there a way to que downloads and schedule for a later time range?

The default configuration provided includes an SSL/TLS connection. This makes it nearly impossible to just stand up a container and access the site using the loopback address because of browser protections and the auto-forwarding that happens inside the container (http->https).

I suggest either building the default container to work without a TLS cert and not force the traffic upgrade on every response, or build in certbot to fetch a tls cert for the domain specified.

I've been trying to play with this on Windows 10 with the Docker desktop app.

The export page for Artists shows the variable names and not the contents of the Artist lists.

https://github.com/TheUltimateC0der/Deemixrr/blob/develop/Deemixrr/Views/Artist/Export.cshtml#L26
https://github.com/TheUltimateC0der/Deemixrr/blob/develop/Deemixrr/Views/Artist/Export.cshtml#L43
https://github.com/TheUltimateC0der/Deemixrr/blob/develop/Deemixrr/Views/Artist/Export.cshtml#L60

Followed the wiki to start the container, then turned it on, once the custom script load it gives me an error:

deemixrr-deemixrr-1 | Unhandled exception. System.IO.IOException: Function not implemented
deemixrr-deemixrr-1 | at System.IO.FileSystemWatcher.StartRaisingEvents()
deemixrr-deemixrr-1 | at System.IO.FileSystemWatcher.StartRaisingEventsIfNotDisposed()
deemixrr-deemixrr-1 | at System.IO.FileSystemWatcher.set_EnableRaisingEvents(Boolean value)
deemixrr-deemixrr-1 | at Microsoft.Extensions.FileProviders.Physical.PhysicalFilesWatcher.TryEnableFileSystemWatcher()
deemixrr-deemixrr-1 | at Microsoft.Extensions.FileProviders.Physical.PhysicalFilesWatcher.CreateFileChangeToken(String filter)
deemixrr-deemixrr-1 | at Microsoft.Extensions.FileProviders.PhysicalFileProvider.Watch(String filter)
deemixrr-deemixrr-1 | at Microsoft.Extensions.Configuration.FileConfigurationProvider.<.ctor>b__1_0()
deemixrr-deemixrr-1 | at Microsoft.Extensions.Primitives.ChangeToken.OnChange(Func` 1 changeTokenProducer, Action changeTokenConsumer)
deemixrr-deemixrr-1 | at Microsoft.Extensions.Configuration.FileConfigurationProvider..ctor(FileConfigurationSource source)
deemixrr-deemixrr-1 | at Microsoft.Extensions.Configuration.Json.JsonConfigurationSource.Build(IConfigurationBuilder builder)
deemixrr-deemixrr-1 | at Microsoft.Extensions.Configuration.ConfigurationBuilder.Build()
deemixrr-deemixrr-1 | at Microsoft.Extensions.Hosting.HostBuilder.BuildAppConfiguration()
deemixrr-deemixrr-1 | at Microsoft.Extensions.Hosting.HostBuilder.Build()
deemixrr-deemixrr-1 | at Deemixrr.Program.Main(String[] args) in /src/Deemixrr/Program.cs:line 11
deemixrr-deemixrr-1 | qemu: uncaught target signal 6 (Aborted) - core dumped

The link https://github.com/TheUltimateC0der/Deemixrr/wiki/Host-your-own in your document to wiki seems to be missing.

It should be possible for a user to get notified about the expiration of the .arl file.

It seems that the arl token expires every 90 days.