djdembeck / bragibooks Goto Github PK

Need to handle both Captcha and OTP within the browser get auth page.

https://audible.readthedocs.io/en/latest/auth/authorization.html#captcha
https://audible.readthedocs.io/en/latest/auth/authorization.html#fa-otp-code

This should be it's own feature branch after #19 merges

Hi

I just came across your repo whilst trying to find a tool that can add metadata to Audiobooks, prior to this, I was going to role my own. But I noticed we have to manually find the ASIN ourself, which is difficult for large libraries.

I was wondeirng if you could use this class to add search functionality to the interface:

https://github.com/projx/Audnexus.bundle/blob/main/Contents/Code/search_tools.py

Is there a way to add an --url-prefix for the docker? You could use FORCE_SCRIPT_NAME = '/bragibooks' on that, so people could use reverse proxies with bragibooks.

Thanks

I'm getting a 500 server error when I attempt to process a directory containing a single mp3 or m4b file:

Internal Server Error: /import/match
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/django/core/handlers/exception.py", line 47, in inner
    response = get_response(request)
  File "/usr/local/lib/python3.9/site-packages/django/core/handlers/base.py", line 181, in _get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/usr/local/lib/python3.9/site-packages/django/views/generic/base.py", line 69, in view
    return self.dispatch(request, *args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/django/views/generic/base.py", line 101, in dispatch
    return handler(request, *args, **kwargs)
  File "/home/app/web/importer/views.py", line 125, in post
    input_data = helpers.get_directory(
  File "/usr/local/lib/python3.9/site-packages/m4b_merge/helpers.py", line 81, in get_directory
    num_of_files = find_num_of_files(path_to_use, return_find_ext)
  File "/usr/local/lib/python3.9/site-packages/m4b_merge/helpers.py", line 27, in find_num_of_files
    list_of_files = os.listdir(Path(path_to_check))
NotADirectoryError: [Errno 20] Not a directory: '/input/<filename>.mp3'

Hi,

I just saw your docker and tried to run it.
Unfortunately, it immediately drops this error.

Attaching to bragibooks
bragibooks    | Traceback (most recent call last):
bragibooks    |   File "/home/app/web/manage.py", line 23, in <module>
bragibooks    |     f = open(SECRET_PATH, "w")
bragibooks    | PermissionError: [Errno 13] Permission denied: '/config/secret_key.txt'
bragibooks exited with code 1

compose:

version: '3.7'
services:
  bragibooks:
    image: ghcr.io/djdembeck/bragibooks:main
    container_name: bragibooks
    volumes:
      - $DOCKERDIR/bragibooks/config:/config
      - $MEDIADIR/Audiobook_Correction/input:/input
      - $MEDIADIR/Audiobook_Correction/output:/output
    environment:
      - LOG_LEVEL: ERROR
    networks:
      - traefik

Hello, I've been running Bragibooks in a Docker Container for months now. I went to use it today for some audio books, and the container isn't working. I've tried updating the image. I removed the container and image and did a new docker-compose up, but I still see this same error. Any help you could offer would be appreciated because I love Bragibooks.

Here is my docker-compose.yml

version: '3.3'
services
    bragibooks:
        container_name: bragibooks
        environment:
          - UID=1000
          - GID=1000
          - LOG_LEVEL=WARNING
        volumes:
          - /docker/containers/bragibooks/config:/config
          - /docker/downloads/completed/Audiobooks:/input
          - /storage/audiobooks:/output
        ports:
          - 8001:8000
        restart: unless-stopped
        image: ghcr.io/djdembeck/bragibooks:main

Here is what I'm seeing in the container's logs.

Starting with UID: 1000, GID: 1000
useradd: user 'user' already exists
Traceback (most recent call last):
  File "/home/app/web/manage.py", line 45, in <module>
    main()
  File "/home/app/web/manage.py", line 41, in main
    execute_from_command_line(sys.argv)
  File "/usr/local/lib/python3.9/site-packages/django/core/management/__init__.py", line 446, in execute_from_command_line
    utility.execute()
  File "/usr/local/lib/python3.9/site-packages/django/core/management/__init__.py", line 386, in execute
    settings.INSTALLED_APPS
  File "/usr/local/lib/python3.9/site-packages/django/conf/__init__.py", line 87, in __getattr__
    self._setup(name)
  File "/usr/local/lib/python3.9/site-packages/django/conf/__init__.py", line 74, in _setup
    self._wrapped = Settings(settings_module)
  File "/usr/local/lib/python3.9/site-packages/django/conf/__init__.py", line 183, in __init__
    mod = importlib.import_module(self.SETTINGS_MODULE)
  File "/usr/local/lib/python3.9/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
  File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 850, in exec_module
  File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
  File "/home/app/web/bragibooks_proj/settings.py", line 62, in <module>
    CSRF_TRUSTED_ORIGINS = os.getenv("CSRF_TRUSTED_ORIGINS").split(',')
AttributeError: 'NoneType' object has no attribute 'split

Even docker exec immediately dumps me right back to the host.

root@frontend:/docker# docker exec -it bragibooks /bin/bash
root@0994a652e319:/home/app/web# 
root@frontend:/docker# docker exec -it bragibooks /bin/bash
Error response from daemon: Container 0994a652e319b21da7ec1dcf55f72b5ad3fc1564504ece619e27c5d8fed37e48 is restarting, wait until the container is running

As a user of Bragibooks I would like to get an e-mail when conversion has finished.

After submitting the ASINs the process might take quite some time, depending on the amounts of books to create and their respective durations. Due to various reasons it may happen, that the browser tab is not still open, when the process finishes. Therefore I would like to be able to provide credentials for a SMTP server which Bragibooks would use to send a copy of the "Confirm" page upon finalization of the pipeline.

The e-mail could be plain text, to keep formatting easier. Or, could just list the ASINs and which of those finished with or without errors,

This is a pretty small bug report since it doesn't impact book management. If a book has a playback time longer than 24 hours, the playback timeon the confirm screen will only display times past a full day. For an example, this book has a playback time of roughly 28:30 but bragibooks only shows 4:30.

I've been getting a Server Error (500) when trying to process multi-file books. What I've found in the log is that it always errors with the @eaDir file (an invisible folder that Synology automatically generates to create metadata).
If I process a single file in the input folder (full length .mp3) it works without issues.
I'm starting to think the issue is the @eaDir file/folder, which is being processed as a NoneType in python.

(made a new issue next to #67 because rights don't seem to be an issue for me. I get the Server Error after submitting ASIN.

Waiting on upstream tool to resolve:
sandreas/m4b-tool#143

I’m running bragibooks on my M1 Mac mini, and right now it’s forced to emulate the amd64 build. Is there any way to get an arm64 build? I’m guessing it would drastically improve the speeds I’m seeing.

OS: Unraid
Build: Both main and Develop have the issue

Ive got the container built, and the application running, but when I try to log in to Audible I get this error:

Internal Server Error: /import/auth
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/django/core/handlers/exception.py", line 47, in inner
response = get_response(request)
File "/usr/local/lib/python3.8/site-packages/django/core/handlers/base.py", line 181, in _get_response
response = wrapped_callback(request, *callback_args, **callback_kwargs)
File "/usr/local/lib/python3.8/site-packages/django/views/generic/base.py", line 70, in view
return self.dispatch(request, *args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/django/views/generic/base.py", line 98, in dispatch
return handler(request, *args, **kwargs)
TypeError: post() takes 1 positional argument but 2 were given

I don't believe I have OTP enabled on my account, but a bit more direction that the line of terminal access would be helpful for other users determining when and how to utilize the functionality if the need arises.

Hi, Running the docker image with input/output/config mapped to values of current directory.

Container fires up. Import Tab shows me my first book to convert, select, next, go with defaults on the initial config, Submit ASINs I have entered B00QXW6NY6 and B00PCV52EQ (com and co.uk respectively) co.uk gives me bad ASIN number, com ASIN sits and whirls for a while then gives me Server Error (500)

I've tried opening up permissions in case it was related, changing UID/GID deleting and recreating etc. I've tried with a couple of books from different authors incase it was a particular book/author issue.

log attached.
bragibooks.txt

Any chance webhooks can be added?
Would be nice to use bragibooks to trigger a Plex library scan with autoscan.

Sometimes when submitting a directory for processing the webserver would kick back an error:500 and refuse to continue. [/input/Book 01] 💀

This issue was resolved if I changed the directory name.
[/input/Book 001] 😄

However if I change any other directory to the same name it once again results in an error:500
[/input/Book abcd] ----> [/input/Book 01] 💀

I thought it might have something to do with the directory already existing in [/input/done] but was able to have other directories of the same name move to ASIN selection. 🤔

I installed bragibooks on my M1 Mac mini in an attempt to avoid the slowness I’ve experienced with the Docker version. I followed the installation instructions, but I received the following error after submitting a list of ASINs:

Internal Server Error: /import/match
Traceback (most recent call last):
  File "/opt/homebrew/lib/python3.9/site-packages/django/core/handlers/exception.py", line 47, in inner
    response = get_response(request)
  File "/opt/homebrew/lib/python3.9/site-packages/django/core/handlers/base.py", line 181, in _get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/opt/homebrew/lib/python3.9/site-packages/django/views/generic/base.py", line 70, in view
    return self.dispatch(request, *args, **kwargs)
  File "/opt/homebrew/lib/python3.9/site-packages/django/views/generic/base.py", line 98, in dispatch
    return handler(request, *args, **kwargs)
  File "/Users/sean/bragibooks/importer/views.py", line 102, in post
    helpers.validate_asin(asin)
TypeError: validate_asin() missing 1 required positional argument: 'asin'

This is because session data isn't cleared out:

• On submission
• After merging files.

Really, the fix for this is to move to a class which can communicate data between functions in place of session

I just installed Docker for the first time and successfully installed Bragibooks, or so the terminal thing tells me (I'm on Linux Mint).

How do I run the program now? From the screenshots I gather it has a GUI but how do I get there? I tried using that line of code you listed under the info on the Docker again, but it tells me this:

sudo docker run --rm -d --name bragibooks -v /home/ReaderGuy42/Music/test -v /home/ReaderGuy42/Music/t2 -v /appdata/bragibooks/config:/config -p 8000:8000/tcp -e LOG_LEVEL=WARNING ghcr.io/djdembeck/bragibooks:main
docker: Error response from daemon: Conflict. The container name "/bragibooks" is already in use by container "2dd09b8eb8bc56a11e6838b057d33329584f36294b44af3ebb2e618f1261ad42". You have to remove (or rename) that container to be able to reuse that name.
See 'docker run --help'.

I have no idea what to do now, so any pointers are appreciated :) Thanks!

Hi - great app @djdembeck

I have setup using Docker ghcr.io/djdembeck/bragibooks:main
Within the docker I have set up the input and output folders - as per instructions.

Assume input = location of audiobooks to be merged - on the import page
Assume output = location of final merged, tagged, m4b

What is the 'Directory for copy of original input files' on the settings page?

When I ran a merge -

• I can select a folder with multiple mp3s (2)
• I can add the ASIN and click submit

This is the following log file output: -
0 remaining / 2 total, preparing next task \ could not convert /input/Siege and Storm/Siege and Storm Part 1.mp3 to /mnt/downloads/media/books/output/Leigh Bardugo/Siege and Storm/Siege and Storm-tmpfiles/1-finished.m4b Input path vs junk dir: /input/Siege and Storm /mnt/downloads/rutorrent/readarr Couldn't find junk dir relative to input Using existing chapter data Internal Server Error: /import/match Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/django/core/handlers/exception.py", line 47, in inner response = get_response(request) File "/usr/local/lib/python3.9/site-packages/django/core/handlers/base.py", line 181, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/local/lib/python3.9/site-packages/django/views/generic/base.py", line 70, in view return self.dispatch(request, *args, **kwargs) File "/usr/local/lib/python3.9/site-packages/django/views/generic/base.py", line 98, in dispatch return handler(request, *args, **kwargs) File "/home/app/web/importer/views.py", line 138, in post merge_object.run_m4b_merge() File "/home/app/web/utils/merge.py", line 37, in run_m4b_merge self.m4b.run_merge() File "/usr/local/lib/python3.9/site-packages/m4b_merge/m4b_helper.py", line 251, in run_merge self.merge_multiple_files() File "/usr/local/lib/python3.9/site-packages/m4b_merge/m4b_helper.py", line 304, in merge_multiple_files self.fix_chapters() File "/usr/local/lib/python3.9/site-packages/m4b_merge/m4b_helper.py", line 424, in fix_chapters with open(chapter_file) as f: FileNotFoundError: [Errno 2] No such file or directory: '/mnt/downloads/media/books/output/Leigh Bardugo/Siege and Storm/Siege and Storm.chapters.txt'

Not sure if it is something to do with folder configurations? Input path vs junk dir: Couldn't find junk dir relative to input

Could you help me troubleshoot my implementation?

Hi,

My preferred directory scheme is:

Author

• Book (Year) [ASIN]
  • Book - Subtitle (Year)

Please add support for ASIN an output scheme keyword. This would also be helpful considering that Audnexus.bundle can quickmatch if there is an ASIN present in the folder name.

Such as:
/Author/Book Year/Title
/Author/Series/Book/Title

This will need to be paired with an m4b-merge update

Can probably detect if a timestamp is shorter than x seconds and start numbered chapters after that.

Instead of hard coded html

This will allow CLI to validate ASINs, while allowing Django to also use it before model creation.

I'm probablly not using the app correctly, but I'm always getting a bad asin :

Hi, I'm trying to run bragibooks behind a reverse proxy w/ https. However CSRF verification fails, because django isn't aware of the external hostname. Is there any way around this? Looks like you can set CSRF_TRUSTED_ORIGINS in settings.py for this, but I don't think the Docker image exposes it. Thanks!

Forbidden (Origin checking failed - https://mydomain.example.com does not match any trusted origins.): /import/

For example:
author/series_name series_position - title: subtitle (year)/author - series_name series_position - title: subtitle (year)

Will produce the folder without a series name:
- Brave New World (2008)

I'm sure that this is user error, but I had been using Bragibooks successfully until my last two imports. Now, when I type in the ASIN (#1250814936) and Submit it, it returns a Server 500 error. I saw this other closed ticket, but I'm already running the main branch.

This is the message in the log file. I tried turning the log level up to INFO, but I didn't get anything more verbose than I was get at WARNING.

Operations to perform:,
  Apply all migrations: auth, contenttypes, importer, sessions,
Running migrations:,
  No migrations to apply.,
[2021-12-03 14:40:03 +0000] [11] [INFO] Starting gunicorn 20.1.0,
[2021-12-03 14:40:03 +0000] [11] [INFO] Listening at: http://0.0.0.0:8000 (11),
[2021-12-03 14:40:03 +0000] [11] [INFO] Using worker: gthread,
[2021-12-03 14:40:03 +0000] [12] [INFO] Booting worker with pid: 12,
[2021-12-03 14:40:03 +0000] [13] [INFO] Booting worker with pid: 13,
Internal Server Error: /import/match,
Traceback (most recent call last):,
  File "/usr/local/lib/python3.9/site-packages/django/core/handlers/exception.py", line 47, in inner,
    response = get_response(request),
  File "/usr/local/lib/python3.9/site-packages/django/core/handlers/base.py", line 181, in _get_response,
    response = wrapped_callback(request, *callback_args, **callback_kwargs),
  File "/usr/local/lib/python3.9/site-packages/django/views/generic/base.py", line 70, in view,
    return self.dispatch(request, *args, **kwargs),
  File "/usr/local/lib/python3.9/site-packages/django/views/generic/base.py", line 98, in dispatch,
    return handler(request, *args, **kwargs),
  File "/home/app/web/importer/views.py", line 105, in post,
    helpers.validate_asin(existing_settings.api_url, asin),
AttributeError: 'NoneType' object has no attribute 'api_url'

This is running in Docker with the following docker-compose.yml

version: '3.3'
services:
    bragibooks:
        container_name: bragibooks
        environment:
          - PUID=1000
          - PGID=1000
          - LOG_LEVEL=INFO
        volumes:
          - /docker/containers/bragibooks/config:/config
          - /docker/downloads/completed/Audiobooks:/input
          - /storage/audiobooks:/output
        ports:
          - 8001:8000
        restart: unless-stopped
        image: ghcr.io/djdembeck/bragibooks:main

Any advice it greatly appreciated!

Hi,

I try to use your docker but at first start i have this issue

Operations to perform:

  Apply all migrations: auth, contenttypes, importer, sessions

Running migrations:

  No migrations to apply.

[2022-01-08 15:26:41 +0000] [11] [INFO] Starting gunicorn 20.1.0

[2022-01-08 15:26:41 +0000] [11] [INFO] Listening at: http://0.0.0.0:8000 (11)

[2022-01-08 15:26:41 +0000] [11] [INFO] Using worker: gthread

[2022-01-08 15:26:41 +0000] [12] [INFO] Booting worker with pid: 12

[2022-01-08 15:26:41 +0000] [13] [INFO] Booting worker with pid: 13

Internal Server Error: /import/

Traceback (most recent call last):

  File "/usr/local/lib/python3.9/site-packages/django/core/handlers/exception.py", line 47, in inner

    response = get_response(request)

  File "/usr/local/lib/python3.9/site-packages/django/core/handlers/base.py", line 181, in _get_response

    response = wrapped_callback(request, *callback_args, **callback_kwargs)

  File "/usr/local/lib/python3.9/site-packages/django/views/generic/base.py", line 70, in view

    return self.dispatch(request, *args, **kwargs)

  File "/usr/local/lib/python3.9/site-packages/django/views/generic/base.py", line 98, in dispatch

    return handler(request, *args, **kwargs)

  File "/usr/local/lib/python3.9/site-packages/django/views/generic/base.py", line 159, in get

    context = self.get_context_data(**kwargs)

  File "/home/app/web/importer/views.py", line 34, in get_context_data

    for path in sorted(

  File "/usr/local/lib/python3.9/pathlib.py", line 1160, in iterdir

    for name in self._accessor.listdir(self):

PermissionError: [Errno 13] Permission denied: '/input'

What i've done wrong? i try to find but i cannot see.

Thanks for your help!

Need to check if path already exists either on lookup or on creation.

• /config for aud_auth and django secret
• /output
• /input

This issue lists Renovate updates and detected dependencies. Read the Dependency Dashboard docs to learn more.

Pending Branch Automerge

These updates await pending status checks before automerging. Click on a checkbox to abort the branch automerge, and create a PR instead.

• chore: Upgrade docker/build-push-action digest to 729f7f4
• chore: Upgrade docker/login-action digest to d910b14
• chore: Upgrade docker/metadata-action digest to 2ee3d30

Open

These updates have all been created already. Click a checkbox below to force a retry/rebase of any.

• chore: Upgrade actions/checkout action to v4

Detected dependencies

• Check this box to trigger a request for Renovate to run again on this repository

Main processor is getting too big, should break it up into multiple files

I'm having a lot of trouble getting this setup on my Synology. Granted I'm no expert but I read over some of the previous closed issues related to mine and couldn't figure out how to sort the problem out. I was looking in the Shared Folders permissions area to offer permissions but couldn't find a system user that seemed to be correct.

Not sure if I've missed something along the way but if anyone who's had experience with that setup is willing to give me some pointers I'd greatly appreciate it.

Are there any logs I can look at to debug that?
Also could there be an option to just delete the completed books or should I link output/done to /dev/null?

Currently just throws this and halts other actions

input_data = helpers.get_directory(
File "/usr/local/lib/python3.8/site-packages/m4b_merge/helpers.py", line 59, in get_directory
path_to_use = return_find_ext[0]
TypeError: 'NoneType' object is not subscriptable

See below:

I am correctly using the Audible.com ASINs but Bragi always comes back and says either 'incorrect ASIN' or it ends up crashing and giving me a Server 500 error. Any idea on how this can be fixed?

Not sure if I missed implementing this or had some issue with it and excluded from codebase. Either way, needs to be added

Test case: https://www.audible.com/pd/Tin-Man-A-Galaxys-Edge-Prequel-Audiobook/1774242834