ptr727 / plexcleaner Goto Github PK

View Code? Open in Web Editor NEW

245.0 5.0 12.0 321.8 MB

Utility to optimize media files for Direct Play in Plex, Emby, Jellyfin

License: MIT License

C# 92.74% Dockerfile 6.11% Shell 1.15%

csharp plex ffmpeg mediainfo mkvtoolnix handbrake 7zip emby jellyfin video

plexcleaner's People

Contributors

Stargazers

Watchers

Forkers

scottharman bhartman21 franciscoalro kleinriese toomaah samadxyz ernestins m-e-m-f-i-s richlander mdnoyanred aseques newrain7803

plexcleaner's Issues

Add support for Matroska BCP 47 language tags

See: https://gitlab.com/mbunkus/mkvtoolnix/-/wikis/Languages-in-Matroska-and-MKVToolNix

Add the ability to verify language tag correctness, and rewrite invalid tags using IETF format.

FFmpeg v5 PPA fails to install on Ubuntu Focal

FFmpeg 5 PPA no longer installs on Ubuntu.

Error in GitHub Actions pipeline:
https://github.com/ptr727/PlexCleaner/runs/5531596900?check_suite_focus=true

Error in docker build:

#8 62.22 Some packages could not be installed. This may mean that you have
#8 62.22 requested an impossible situation or if you are using the unstable
#8 62.22 distribution that some required packages have not yet been created
#8 62.22 or been moved out of Incoming.
#8 62.22 The following information may help to resolve the situation:
#8 62.22
#8 62.22 The following packages have unmet dependencies:
#8 62.30 ffmpeg : Depends: libavcodec59 (= 7:5.0-2ubuntu0~20.04.sav1)
#8 62.30 Depends: libavdevice59 (= 7:5.0-2ubuntu0~20.04.sav1) but it is not going to be installed
#8 62.30 Depends: libavfilter8 (= 7:5.0-2ubuntu0~20.04.sav1)
#8 62.30 Depends: libavformat59 (= 7:5.0-2ubuntu0~20.04.sav1)
#8 62.31 E: Unable to correct problems, you have held broken packages.

PPA bug report:
https://bugs.launchpad.net/savos/+bug/1965181

MediaInfo segmentation fault on Alpine

$ mediainfo --version
MediaInfo Command line,
MediaInfoLib - v23.03
~ $ mediainfo --Output=XML "/media/VC1 - foo.mkv"
Segmentation fault

Waiting for next MediaInfo version to address the issue.

Question: DefaultSettings Re-encode

Apologies, I couldn't find a way to just ask you a question.

I primarily use a Roku and saw your note "Some H.264 video profiles like "Constrained Baseline@30" cause hangs on Roku, re-encode to H.264 "High@40"."

The default settings show:
"Format": "h264",
"Profile": "Constrained Baseline@30"

So does that mean it is encoding FROM Constrained Baseline@30 or should I change that in the file to High@40 since I'm 99% Roku based?

Retrieve SRT subtitles using original file details

Retrieve SRT subtitles using original file details, before the sourced file gets modified.

Add support for logic to retain `FlagOriginal` tagged tracks

Add logic to use FlagOriginal for logic to retain said tracks, vs. needing to e.g. specify all tracks to retain.
See: https://gitlab.com/mbunkus/mkvtoolnix/-/issues/3011
See: https://datatracker.ietf.org/doc/draft-ietf-cellar-matroska/
See: #134

Move test flags from JSON to commandline

Move test flags to commandline options.
Too easy to forget to reset the flag and modify production content.

    // Create short video clips, useful during testing
    // Note the media files will be overwritten with short clips
    "TestSnippets": false

  "ProcessOptions": {
    // Do not make any modifications, useful during testing
    "TestNoModify": false,

Unrecognized command or argument '/PlexCleaner/PlexCleaner.dll'.

After updating to commandline beta 3 error: Unrecognized command or argument '/PlexCleaner/PlexCleaner.dll'.

Release develop builds as pre-release

Using GitVersion mainline mode fails when master contains pre-release tags.
Figure out how to use mainline mode and release master and develop to releases.
Possibly using the isPreRelease option.

Refresh sidecar files when tool version changes

Sidecar file contents can be out of date if teh creating tool version changed.
Find a way to dynamically re-create sidecar files when the tool version has changed.
E.g. write tool version in sidecar header.
E.g. compare sidecar modified date with last tool update date.

Encode mono to stereo

Some of my old video files have a mono channel that is only played in the left ear. Would it be possible to

map the mono input channel to a stereo output
copy the mono channel to L and R

Remux with keep logic is flawed in case of tool failure

In public static bool Convert::ReMuxToMkv(string inputname, MediaInfo keep, out string outputname)
On error in one of the tools, when keep is not null, the mediainfo type must match the converter type of hte other tool.
E.g. if an IO error occurs during MKV remux, FfMpeg remux will fail because keep is not null and media type is not FfMpeg.

Create dedicated Docker Hub Readme

Readme is too large for docker hub: File size exceeds the maximum allowed 25000 bytes.
Create a static summary docker hub readme.

Tools folder or 7-Zip does not exist

C:\PlexCleaner>PlexCleaner.exe --settings PlexCleaner.json checkfornewtools
4/2/2020 10:42:26 PM : Loading settings from : "PlexCleaner.json"
4/2/2020 10:42:26 PM : Tools folder or 7-Zip does not exist : "C:\PlexCleaner\Tools"

I have the folder Tools created there and have a 7Zip folder in their as well.

Handbrake PPA does not support Ubuntu Jammy

Docker using ubuntu:latest tag switched from Focal to Jammy in April.
Handbrake PPA does not currently support Jammy:
The repository 'https://ppa.launchpadcontent.net/stebbins/handbrake-releases/ubuntu jammy Release' does not have a Release file

Reverting to using ubuntu:focal in Docker builds.

Reported here, currently unresolved.

HandBrakeCLI hangs or runs extremely slowly in parallel mode

When running in parallel mode HandBrakeCLI appears to hang after 20+ hours.

Have been unable to replicate in non-parallel mode, and have thus far failed to attach the debugger to investigate stdout or stderr process capture.

2023-02-12 05:56:52.232 +00:00 [INF] <18> "Process" (77.35%) Before : "/media/Series/Grand Designs New Zealand/Season 7/Grand Designs New Zealand - S07E04 - Round House.mkv"
2023-02-12 05:56:52.233 +00:00 [INF] <18> Reading media info from tools : "Grand Designs New Zealand - S07E04 - Round House.mkv"
2023-02-12 05:56:52.233 +00:00 [INF] <18> Executing MediaInfo : "--Output=XML \"/media/Series/Grand Designs New Zealand/Season 7/Grand Designs New Zealand - S07E04 - Round House.mkv\""
2023-02-12 05:56:52.599 +00:00 [INF] <18> Executing MkvMerge : "--identify \"/media/Series/Grand Designs New Zealand/Season 7/Grand Designs New Zealand - S07E04 - Round House.mkv\" --identification-format json"
2023-02-12 05:56:52.737 +00:00 [INF] <18> Executing FfProbe : "-loglevel quiet -show_streams -show_format -print_format json \"/media/Series/Grand Designs New Zealand/Season 7/Grand Designs New Zealand - S07E04 - Round House.mkv\""
2023-02-12 05:56:52.929 +00:00 [INF] <18> "MediaInfo" : Type: "VideoInfo", Format: "AVC", HDR: "", Codec: "V_MPEG4/ISO/AVC", Language: "und", Id: 1, Number: 0, Title: "", Default: True, Profile: "High@4", Interlaced: False, ClosedCaptions: False, State: None, HasErrors: False, HasTags: False
2023-02-12 05:56:52.929 +00:00 [INF] <18> "MediaInfo" : Type: "AudioInfo", Format: "E-AC-3", Codec: "A_EAC3", Language: "eng", Id: 2, Number: 1, Title: "", Default: True, State: None, HasErrors: False, HasTags: False
2023-02-12 05:56:52.929 +00:00 [INF] <18> "MediaInfo" : Type: "SubtitleInfo", Format: "UTF-8", Codec: "S_TEXT/UTF8", Language: "eng", Id: 3, Number: 2, Title: "", Default: False, Forced: False, State: None, HasErrors: False, HasTags: False
2023-02-12 05:56:52.929 +00:00 [INF] <18> "MkvMerge" : Type: "VideoInfo", Format: "AVC/H.264/MPEG-4p10", HDR: "", Codec: "V_MPEG4/ISO/AVC", Language: "und", Id: 0, Number: 1, Title: "", Default: True, Profile: "", Interlaced: False, ClosedCaptions: False, State: None, HasErrors: False, HasTags: False
2023-02-12 05:56:52.930 +00:00 [INF] <18> "MkvMerge" : Type: "AudioInfo", Format: "E-AC-3", Codec: "A_EAC3", Language: "eng", Id: 1, Number: 2, Title: "", Default: True, State: None, HasErrors: False, HasTags: False
2023-02-12 05:56:52.930 +00:00 [INF] <18> "MkvMerge" : Type: "SubtitleInfo", Format: "SubRip/SRT", Codec: "S_TEXT/UTF8", Language: "eng", Id: 2, Number: 3, Title: "", Default: False, Forced: False, State: None, HasErrors: False, HasTags: False
2023-02-12 05:56:52.930 +00:00 [INF] <18> "FfProbe" : Type: "VideoInfo", Format: "h264", HDR: "", Codec: "H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10", Language: "und", Id: 0, Number: 0, Title: "", Default: True, Profile: "High@40", Interlaced: False, ClosedCaptions: False, State: None, HasErrors: False, HasTags: False
2023-02-12 05:56:52.930 +00:00 [INF] <18> "FfProbe" : Type: "AudioInfo", Format: "eac3", Codec: "ATSC A/52B (AC-3, E-AC-3)", Language: "eng", Id: 1, Number: 1, Title: "", Default: True, State: None, HasErrors: False, HasTags: False
2023-02-12 05:56:52.930 +00:00 [INF] <18> "FfProbe" : Type: "SubtitleInfo", Format: "subrip", Codec: "SubRip subtitle", Language: "eng", Id: 2, Number: 2, Title: "", Default: False, Forced: False, State: None, HasErrors: False, HasTags: False
2023-02-12 05:56:52.941 +00:00 [INF] <18> Sidecar created : State: None : "Grand Designs New Zealand - S07E04 - Round House.PlexCleaner"
2023-02-12 05:56:52.941 +00:00 [INF] <18> Finding Closed Captions in video stream : "Grand Designs New Zealand - S07E04 - Round House.mkv"
2023-02-12 05:56:52.941 +00:00 [INF] <18> Executing FfProbe : "-hide_banner \"/media/Series/Grand Designs New Zealand/Season 7/Grand Designs New Zealand - S07E04 - Round House.mkv\""
2023-02-12 05:56:53.166 +00:00 [INF] <18> Removing Closed Captions from video stream : "Grand Designs New Zealand - S07E04 - Round House.mkv"
2023-02-12 05:56:53.166 +00:00 [INF] <18> "Closed Captions" : Type: "VideoInfo", Format: "h264", HDR: "", Codec: "H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10", Language: "und", Id: 0, Number: 0, Title: "", Default: True, Profile: "High@40", Interlaced: False, ClosedCaptions: True, State: None, HasErrors: False, HasTags: False
2023-02-12 05:56:53.166 +00:00 [INF] <18> Removing Closed Captions using FfMpeg : "Grand Designs New Zealand - S07E04 - Round House.mkv"
2023-02-12 05:56:53.166 +00:00 [INF] <18> Executing FfMpeg : "-analyzeduration 2147483647 -probesize 2147483647 -i \"/media/Series/Grand Designs New Zealand/Season 7/Grand Designs New Zealand - S07E04 - Round House.mkv\" -max_muxing_queue_size 1024 -abort_on empty_output -hide_banner -nostats -map 0 -c copy -bsf:v \"filter_units=remove_types=6\" -f matroska \"/media/Series/Grand Designs New Zealand/Season 7/Grand Designs New Zealand - S07E04 - Round House.tmp\""
2023-02-12 05:57:15.782 +00:00 [INF] <18> Waiting for IO to flush : 5s : "Grand Designs New Zealand - S07E04 - Round House.mkv"
2023-02-12 05:57:20.783 +00:00 [INF] <18> Reading media info from tools : "Grand Designs New Zealand - S07E04 - Round House.mkv"
2023-02-12 05:57:20.787 +00:00 [INF] <18> Executing MediaInfo : "--Output=XML \"/media/Series/Grand Designs New Zealand/Season 7/Grand Designs New Zealand - S07E04 - Round House.mkv\""
2023-02-12 05:57:20.968 +00:00 [INF] <18> Executing MkvMerge : "--identify \"/media/Series/Grand Designs New Zealand/Season 7/Grand Designs New Zealand - S07E04 - Round House.mkv\" --identification-format json"
2023-02-12 05:57:21.153 +00:00 [INF] <18> Executing FfProbe : "-loglevel quiet -show_streams -show_format -print_format json \"/media/Series/Grand Designs New Zealand/Season 7/Grand Designs New Zealand - S07E04 - Round House.mkv\""
2023-02-12 05:57:21.426 +00:00 [INF] <18> "MediaInfo" : Type: "VideoInfo", Format: "AVC", HDR: "", Codec: "V_MPEG4/ISO/AVC", Language: "und", Id: 1, Number: 0, Title: "", Default: True, Profile: "High@4", Interlaced: False, ClosedCaptions: False, State: None, HasErrors: False, HasTags: False
2023-02-12 05:57:21.427 +00:00 [INF] <18> "MediaInfo" : Type: "AudioInfo", Format: "E-AC-3", Codec: "A_EAC3", Language: "eng", Id: 2, Number: 1, Title: "", Default: True, State: None, HasErrors: False, HasTags: False
2023-02-12 05:57:21.429 +00:00 [INF] <18> "MediaInfo" : Type: "SubtitleInfo", Format: "UTF-8", Codec: "S_TEXT/UTF8", Language: "eng", Id: 3, Number: 2, Title: "", Default: False, Forced: False, State: None, HasErrors: False, HasTags: False
2023-02-12 05:57:21.429 +00:00 [INF] <18> "MkvMerge" : Type: "VideoInfo", Format: "AVC/H.264/MPEG-4p10", HDR: "", Codec: "V_MPEG4/ISO/AVC", Language: "und", Id: 0, Number: 1, Title: "", Default: True, Profile: "", Interlaced: False, ClosedCaptions: False, State: None, HasErrors: False, HasTags: False
2023-02-12 05:57:21.432 +00:00 [INF] <18> "MkvMerge" : Type: "AudioInfo", Format: "E-AC-3", Codec: "A_EAC3", Language: "eng", Id: 1, Number: 2, Title: "", Default: True, State: None, HasErrors: False, HasTags: False
2023-02-12 05:57:21.432 +00:00 [INF] <18> "MkvMerge" : Type: "SubtitleInfo", Format: "SubRip/SRT", Codec: "S_TEXT/UTF8", Language: "eng", Id: 2, Number: 3, Title: "", Default: False, Forced: False, State: None, HasErrors: False, HasTags: False
2023-02-12 05:57:21.432 +00:00 [INF] <18> "FfProbe" : Type: "VideoInfo", Format: "h264", HDR: "", Codec: "H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10", Language: "und", Id: 0, Number: 0, Title: "", Default: True, Profile: "High@40", Interlaced: False, ClosedCaptions: False, State: None, HasErrors: False, HasTags: False
2023-02-12 05:57:21.433 +00:00 [INF] <18> "FfProbe" : Type: "AudioInfo", Format: "eac3", Codec: "ATSC A/52B (AC-3, E-AC-3)", Language: "eng", Id: 1, Number: 1, Title: "", Default: True, State: None, HasErrors: False, HasTags: False
2023-02-12 05:57:21.433 +00:00 [INF] <18> "FfProbe" : Type: "SubtitleInfo", Format: "subrip", Codec: "SubRip subtitle", Language: "eng", Id: 2, Number: 2, Title: "", Default: False, Forced: False, State: None, HasErrors: False, HasTags: False
2023-02-12 05:57:21.454 +00:00 [INF] <18> Sidecar updated : State: ClearedCaptions : "Grand Designs New Zealand - S07E04 - Round House.PlexCleaner"
2023-02-12 05:57:21.466 +00:00 [INF] <18> Counting interlaced frames : "Grand Designs New Zealand - S07E04 - Round House.mkv"
2023-02-12 05:57:21.467 +00:00 [INF] <18> Executing FfMpeg : "-analyzeduration 2147483647 -probesize 2147483647 -i \"/media/Series/Grand Designs New Zealand/Season 7/Grand Designs New Zealand - S07E04 - Round House.mkv\" -max_muxing_queue_size 1024 -abort_on empty_output -hide_banner -nostats -hide_banner -nostats -xerror -filter:v idet -an -f rawvideo -y /dev/null"
2023-02-12 06:11:20.438 +00:00 [INF] <18> FfMpeg Idet: Interlaced: True (11.74 % > 5.00 %), Interlaced: 17427, Progressive: 131022, Undetermined: 11217, Total: 159666 : "Grand Designs New Zealand - S07E04 - Round House.mkv"
2023-02-12 06:11:20.439 +00:00 [WRN] <18> Idet reported interlaced, metadata reported not interlaced : "Grand Designs New Zealand - S07E04 - Round House.mkv"
2023-02-12 06:11:20.439 +00:00 [INF] <18> Deinterlacing interlaced video : "Grand Designs New Zealand - S07E04 - Round House.mkv"
2023-02-12 06:11:20.439 +00:00 [INF] <18> "Interlaced" : Type: "VideoInfo", Format: "h264", HDR: "", Codec: "H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10", Language: "und", Id: 0, Number: 0, Title: "", Default: True, Profile: "High@40", Interlaced: True, ClosedCaptions: False, State: None, HasErrors: False, HasTags: False
2023-02-12 06:11:20.439 +00:00 [INF] <18> Executing HandBrake : "--input \"/media/Series/Grand Designs New Zealand/Season 7/Grand Designs New Zealand - S07E04 - Round House.mkv\" --output \"/media/Series/Grand Designs New Zealand/Season 7/Grand Designs New Zealand - S07E04 - Round House.tmp1\" --format av_mkv --encoder x265 --encoder-preset medium --quality 20 --comb-detect --decomb --subtitle none --all-audio --aencoder copy --audio-fallback ac3"

Not Observing Optimizations on x264 to x265 (HEVC)

I'm running the latest version via docker (v2.10.7) and wired PlexCleaner up to sabnzbd to process as a post-processing script.

I have noticed that with the default JSON config, even when I have an x264 file get processed, it basically doesn't do anything in terms of compression when I execute plexcleaner against it (same file size, not much discernable difference).

Here is an output of a recent file (it was an x264 1080p file, ~4.4GB file)

--------------
docker run --rm -v /media/tower/Storage/Completed/_tv/tv.show.S11E23.1080p.WEB.H264-CAKES:/clean:rw -v /opt/plexcleaner:/config ptr727/plexcleaner /PlexCleaner/PlexCleaner --settingsfile /config/PlexCleaner.json --logfile /config/PlexCleaner.log process --mediafiles /clean --parallel --threadcount 10
0 15:54:42 [INF] <1> Loading settings from : "/config/PlexCleaner.json"
15:54:43 [INF] <1> Logging output to : "/config/PlexCleaner.log"
15:54:43 [INF] <1> Application Version : "2.10.7+727e8e2131.727e8e21317b32c7d9c1d9675f11dfe2fba26f47", Runtime Version : "6.0.10"
15:54:43 [INF] <1> Parallel Processing: True : Thread Count: 10, Processor Count: 20
15:54:43 [INF] <1> Executing FfMpeg : "-version"
15:54:43 [INF] <1> FfMpeg : Version: "5.1.2", Path: "ffmpeg"
15:54:43 [INF] <1> Executing FfProbe : "-version"
15:54:43 [INF] <1> FfProbe : Version: "5.1.2", Path: "ffprobe"
15:54:43 [INF] <1> Executing MkvMerge : "--version"
15:54:43 [INF] <1> MkvMerge : Version: "71.1.0", Path: "mkvmerge"
15:54:43 [INF] <1> Executing MkvPropEdit : "--version"
15:54:43 [INF] <1> MkvPropEdit : Version: "71.1.0", Path: "mkvpropedit"
15:54:43 [INF] <1> Executing MkvExtract : "--version"
15:54:43 [INF] <1> MkvExtract : Version: "71.1.0", Path: "mkvextract"
15:54:43 [INF] <1> Executing MediaInfo : "--version"
15:54:43 [INF] <1> MediaInfo : Version: "22.09", Path: "mediainfo"
15:54:43 [INF] <1> Executing HandBrake : "--version"
15:54:43 [INF] <1> HandBrake : Version: "1.5.1", Path: "HandBrakeCLI"
15:54:43 [INF] <1> Executing SevenZip : ""
15:54:43 [INF] <1> SevenZip : Version: "16.02", Path: "7z"
15:54:43 [INF] <1> Creating file and folder list ...
15:54:43 [INF] <9> Enumerating files in "/clean" ...
15:54:43 [INF] <1> Discovered 1 files from 1 directories
15:54:43 [INF] <1> Process Options: TestSnippets: False, TestNoModify: False, ReProcess: 0, ReVerify: False, FileIgnoreList: 0
15:54:43 [INF] <1> Starting "Process", processing 1 files ...
15:54:43 [INF] <13> "Process" (0.00%) Before : "/clean/tv.show.s11e23.1080p.web.h264-cakes.mkv"
15:54:43 [INF] <13> Reading media info from tools : "tv.show.s11e23.1080p.web.h264-cakes.mkv"
15:54:43 [INF] <13> Executing MediaInfo : "--Output=XML \"/clean/tv.show.s11e23.1080p.web.h264-cakes.mkv\""
15:54:44 [INF] <13> Executing MkvMerge : "--identify \"/clean/tv.show.s11e23.1080p.web.h264-cakes.mkv\" --identification-format json"
15:54:44 [INF] <13> Executing FfProbe : "-loglevel quiet -show_streams -show_format -print_format json \"/clean/tv.show.s11e23.1080p.web.h264-cakes.mkv\""
15:54:45 [INF] <13> "MediaInfo" : Type: "VideoInfo", Format: "AVC", HDR: "", Codec: "V_MPEG4/ISO/AVC", Language: "und", Id: 1, Number: 0, Title: "", Default: True, Profile: "High@4", Interlaced: False, ClosedCaptions: False, State: None, HasErrors: False, HasTags: False
15:54:45 [INF] <13> "MediaInfo" : Type: "AudioInfo", Format: "E-AC-3", Codec: "A_EAC3", Language: "eng", Id: 2, Number: 1, Title: "", Default: True, State: None, HasErrors: False, HasTags: False
15:54:45 [INF] <13> "MediaInfo" : Type: "SubtitleInfo", Format: "UTF-8", Codec: "S_TEXT/UTF8", Language: "eng", Id: 3, Number: 2, Title: "English [SDH]", Default: False, Forced: False, State: None, HasErrors: False, HasTags: True
15:54:45 [INF] <13> "MkvMerge" : Type: "VideoInfo", Format: "AVC/H.264/MPEG-4p10", HDR: "", Codec: "V_MPEG4/ISO/AVC", Language: "und", Id: 0, Number: 1, Title: "", Default: True, Profile: "", Interlaced: False, ClosedCaptions: False, State: None, HasErrors: False, HasTags: False
15:54:45 [INF] <13> "MkvMerge" : Type: "AudioInfo", Format: "E-AC-3", Codec: "A_EAC3", Language: "eng", Id: 1, Number: 2, Title: "", Default: True, State: None, HasErrors: False, HasTags: False
15:54:45 [INF] <13> "MkvMerge" : Type: "SubtitleInfo", Format: "SubRip/SRT", Codec: "S_TEXT/UTF8", Language: "eng", Id: 2, Number: 3, Title: "English [SDH]", Default: False, Forced: False, State: None, HasErrors: False, HasTags: True
15:54:45 [INF] <13> "FfProbe" : Type: "VideoInfo", Format: "h264", HDR: "", Codec: "H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10", Language: "und", Id: 0, Number: 0, Title: "", Default: True, Profile: "High@40", Interlaced: False, ClosedCaptions: False, State: None, HasErrors: False, HasTags: False
15:54:45 [INF] <13> "FfProbe" : Type: "AudioInfo", Format: "eac3", Codec: "ATSC A/52B (AC-3, E-AC-3)", Language: "eng", Id: 1, Number: 1, Title: "", Default: True, State: None, HasErrors: False, HasTags: False
15:54:45 [INF] <13> "FfProbe" : Type: "SubtitleInfo", Format: "subrip", Codec: "SubRip subtitle", Language: "eng", Id: 2, Number: 2, Title: "English [SDH]", Default: False, Forced: False, State: None, HasErrors: False, HasTags: True
15:54:45 [INF] <13> Sidecar created : State: None : "tv.show.s11e23.1080p.web.h264-cakes.PlexCleaner"
15:54:45 [INF] <13> Finding Closed Captions in video stream : "tv.show.s11e23.1080p.web.h264-cakes.mkv"
15:54:45 [INF] <13> Executing FfProbe : "-hide_banner \"/clean/tv.show.s11e23.1080p.web.h264-cakes.mkv\""
15:54:45 [INF] <13> Counting interlaced frames : "tv.show.s11e23.1080p.web.h264-cakes.mkv"
15:54:45 [INF] <13> Executing FfMpeg : "-analyzeduration 2147483647 -probesize 2147483647 -i \"/clean/tv.show.s11e23.1080p.web.h264-cakes.mkv\" -max_muxing_queue_size 1024 -abort_on empty_output -hide_banner -nostats -hide_banner -nostats -xerror -filter:v idet -an -f rawvideo -y /dev/null"
16:08:57 [INF] <13> FfMpeg Idet: Interlaced: False (0.13 % > 5.00 %), Interlaced: 195, Progressive: 144256, Undetermined: 2543, Total: 146994 : "tv.show.s11e23.1080p.web.h264-cakes.mkv"
16:08:57 [INF] <13> Setting unknown language tracks to "eng" : "tv.show.s11e23.1080p.web.h264-cakes.mkv"
16:08:57 [INF] <13> "Known" : Type: "AudioInfo", Format: "E-AC-3", Codec: "A_EAC3", Language: "eng", Id: 1, Number: 2, Title: "", Default: True, State: None, HasErrors: False, HasTags: False
16:08:57 [INF] <13> "Known" : Type: "SubtitleInfo", Format: "SubRip/SRT", Codec: "S_TEXT/UTF8", Language: "eng", Id: 2, Number: 3, Title: "English [SDH]", Default: False, Forced: False, State: None, HasErrors: False, HasTags: True
16:08:57 [INF] <13> "Unknown" : Type: "VideoInfo", Format: "AVC/H.264/MPEG-4p10", HDR: "", Codec: "V_MPEG4/ISO/AVC", Language: "und", Id: 0, Number: 1, Title: "", Default: True, Profile: "", Interlaced: False, ClosedCaptions: False, State: None, HasErrors: False, HasTags: False
16:08:57 [INF] <13> Executing MkvPropEdit : "\"/clean/tv.show.s11e23.1080p.web.h264-cakes.mkv\" --flush-on-close --edit track:@1 --set language=eng"
16:08:57 [INF] <13> Waiting for IO to flush : 5s : "tv.show.s11e23.1080p.web.h264-cakes.mkv"
16:09:02 [INF] <13> Reading media info from tools : "tv.show.s11e23.1080p.web.h264-cakes.mkv"
16:09:02 [INF] <13> Executing MediaInfo : "--Output=XML \"/clean/tv.show.s11e23.1080p.web.h264-cakes.mkv\""
16:09:11 [INF] <13> Executing MkvMerge : "--identify \"/clean/tv.show.s11e23.1080p.web.h264-cakes.mkv\" --identification-format json"
16:09:11 [INF] <13> Executing FfProbe : "-loglevel quiet -show_streams -show_format -print_format json \"/clean/tv.show.s11e23.1080p.web.h264-cakes.mkv\""
16:09:11 [INF] <13> "MediaInfo" : Type: "VideoInfo", Format: "AVC", HDR: "", Codec: "V_MPEG4/ISO/AVC", Language: "eng", Id: 1, Number: 0, Title: "", Default: True, Profile: "High@4", Interlaced: False, ClosedCaptions: False, State: None, HasErrors: False, HasTags: False
16:09:11 [INF] <13> "MediaInfo" : Type: "AudioInfo", Format: "E-AC-3", Codec: "A_EAC3", Language: "eng", Id: 2, Number: 1, Title: "", Default: True, State: None, HasErrors: False, HasTags: False
16:09:11 [INF] <13> "MediaInfo" : Type: "SubtitleInfo", Format: "UTF-8", Codec: "S_TEXT/UTF8", Language: "eng", Id: 3, Number: 2, Title: "English [SDH]", Default: False, Forced: False, State: None, HasErrors: False, HasTags: True
16:09:11 [INF] <13> "MkvMerge" : Type: "VideoInfo", Format: "AVC/H.264/MPEG-4p10", HDR: "", Codec: "V_MPEG4/ISO/AVC", Language: "eng", Id: 0, Number: 1, Title: "", Default: True, Profile: "", Interlaced: False, ClosedCaptions: False, State: None, HasErrors: False, HasTags: False
16:09:11 [INF] <13> "MkvMerge" : Type: "AudioInfo", Format: "E-AC-3", Codec: "A_EAC3", Language: "eng", Id: 1, Number: 2, Title: "", Default: True, State: None, HasErrors: False, HasTags: False
16:09:11 [INF] <13> "MkvMerge" : Type: "SubtitleInfo", Format: "SubRip/SRT", Codec: "S_TEXT/UTF8", Language: "eng", Id: 2, Number: 3, Title: "English [SDH]", Default: False, Forced: False, State: None, HasErrors: False, HasTags: True
16:09:11 [INF] <13> "FfProbe" : Type: "VideoInfo", Format: "h264", HDR: "", Codec: "H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10", Language: "eng", Id: 0, Number: 0, Title: "", Default: True, Profile: "High@40", Interlaced: False, ClosedCaptions: False, State: None, HasErrors: False, HasTags: False
16:09:11 [INF] <13> "FfProbe" : Type: "AudioInfo", Format: "eac3", Codec: "ATSC A/52B (AC-3, E-AC-3)", Language: "eng", Id: 1, Number: 1, Title: "", Default: True, State: None, HasErrors: False, HasTags: False
16:09:11 [INF] <13> "FfProbe" : Type: "SubtitleInfo", Format: "subrip", Codec: "SubRip subtitle", Language: "eng", Id: 2, Number: 2, Title: "English [SDH]", Default: False, Forced: False, State: None, HasErrors: False, HasTags: True
16:09:11 [INF] <13> Sidecar updated : State: SetLanguage : "tv.show.s11e23.1080p.web.h264-cakes.PlexCleaner"
16:09:11 [INF] <13> Calculating bitrate info : "tv.show.s11e23.1080p.web.h264-cakes.mkv"
16:09:11 [INF] <13> Executing FfProbe : "-loglevel error -show_packets -show_entries packet=codec_type,stream_index,pts_time,dts_time,duration_time,size -print_format json \"/clean/tv.show.s11e23.1080p.web.h264-cakes.mkv\""
16:12:47 [INF] <13> "Video" : Length: 00:51:03, Minimum: "8Kbps", Maximum: "23.100Mbps", Average: "11.100Mbps", Exceeded: 0, Duration: 00:00:00
16:12:47 [INF] <13> "Audio" : Length: 00:51:03, Minimum: "266.200Kbps", Maximum: "655.400Kbps", Average: "639.900Kbps", Exceeded: 0, Duration: 00:00:00
16:12:47 [INF] <13> "Combined" : Length: 00:51:03, Minimum: "274.200Kbps", Maximum: "23.700Mbps", Average: "11.800Mbps", Exceeded: 0, Duration: 00:00:00
16:12:47 [INF] <13> Verifying media streams : "tv.show.s11e23.1080p.web.h264-cakes.mkv"
16:12:47 [INF] <13> Executing FfMpeg : "-analyzeduration 2147483647 -probesize 2147483647 -i \"/clean/tv.show.s11e23.1080p.web.h264-cakes.mkv\" -max_muxing_queue_size 1024 -abort_on empty_output -hide_banner -nostats -hide_banner -nostats -loglevel error -xerror -f null -"
16:19:02 [INF] <13> Sidecar updated : State: SetLanguage, Verified : "tv.show.s11e23.1080p.web.h264-cakes.PlexCleaner"
16:19:02 [INF] <13> Clearing all tags from media file : "tv.show.s11e23.1080p.web.h264-cakes.mkv"
16:19:02 [INF] <13> Executing MkvPropEdit : "\"/clean/tv.show.s11e23.1080p.web.h264-cakes.mkv\" --flush-on-close --tags all: --delete title --edit track:@3 --delete name"
16:19:03 [INF] <13> Waiting for IO to flush : 5s : "tv.show.s11e23.1080p.web.h264-cakes.mkv"
16:19:08 [INF] <13> Reading media info from tools : "tv.show.s11e23.1080p.web.h264-cakes.mkv"
16:19:08 [INF] <13> Executing MediaInfo : "--Output=XML \"/clean/tv.show.s11e23.1080p.web.h264-cakes.mkv\""
16:19:11 [INF] <13> Executing MkvMerge : "--identify \"/clean/tv.show.s11e23.1080p.web.h264-cakes.mkv\" --identification-format json"
16:19:11 [INF] <13> Executing FfProbe : "-loglevel quiet -show_streams -show_format -print_format json \"/clean/tv.show.s11e23.1080p.web.h264-cakes.mkv\""
16:19:11 [INF] <13> "MediaInfo" : Type: "VideoInfo", Format: "AVC", HDR: "", Codec: "V_MPEG4/ISO/AVC", Language: "eng", Id: 1, Number: 0, Title: "", Default: True, Profile: "High@4", Interlaced: False, ClosedCaptions: False, State: None, HasErrors: False, HasTags: False
16:19:11 [INF] <13> "MediaInfo" : Type: "AudioInfo", Format: "E-AC-3", Codec: "A_EAC3", Language: "eng", Id: 2, Number: 1, Title: "", Default: True, State: None, HasErrors: False, HasTags: False
16:19:11 [INF] <13> "MediaInfo" : Type: "SubtitleInfo", Format: "UTF-8", Codec: "S_TEXT/UTF8", Language: "eng", Id: 3, Number: 2, Title: "", Default: False, Forced: False, State: None, HasErrors: False, HasTags: False
16:19:11 [INF] <13> "MkvMerge" : Type: "VideoInfo", Format: "AVC/H.264/MPEG-4p10", HDR: "", Codec: "V_MPEG4/ISO/AVC", Language: "eng", Id: 0, Number: 1, Title: "", Default: True, Profile: "", Interlaced: False, ClosedCaptions: False, State: None, HasErrors: False, HasTags: False
16:19:11 [INF] <13> "MkvMerge" : Type: "AudioInfo", Format: "E-AC-3", Codec: "A_EAC3", Language: "eng", Id: 1, Number: 2, Title: "", Default: True, State: None, HasErrors: False, HasTags: False
16:19:11 [INF] <13> "MkvMerge" : Type: "SubtitleInfo", Format: "SubRip/SRT", Codec: "S_TEXT/UTF8", Language: "eng", Id: 2, Number: 3, Title: "", Default: False, Forced: False, State: None, HasErrors: False, HasTags: False
16:19:11 [INF] <13> "FfProbe" : Type: "VideoInfo", Format: "h264", HDR: "", Codec: "H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10", Language: "eng", Id: 0, Number: 0, Title: "", Default: True, Profile: "High@40", Interlaced: False, ClosedCaptions: False, State: None, HasErrors: False, HasTags: False
16:19:11 [INF] <13> "FfProbe" : Type: "AudioInfo", Format: "eac3", Codec: "ATSC A/52B (AC-3, E-AC-3)", Language: "eng", Id: 1, Number: 1, Title: "", Default: True, State: None, HasErrors: False, HasTags: False
16:19:11 [INF] <13> "FfProbe" : Type: "SubtitleInfo", Format: "subrip", Codec: "SubRip subtitle", Language: "eng", Id: 2, Number: 2, Title: "", Default: False, Forced: False, State: None, HasErrors: False, HasTags: False
16:19:11 [INF] <13> Sidecar updated : State: SetLanguage, Verified, ClearedTags : "tv.show.s11e23.1080p.web.h264-cakes.PlexCleaner"
16:19:11 [INF] <13> "Process" (100.00%) After : "/clean/tv.show.s11e23.1080p.web.h264-cakes.mkv"
16:19:11 [INF] <1> Completed "Process"
16:19:11 [INF] <1> Processing time : 00:24:28.2273725
16:19:11 [INF] <1> Total files : 1
16:19:11 [INF] <1> Error files : 0
16:19:11 [INF] <1> Modified files : 1
16:19:11 [INF] <1> Modified: SetLanguage, Verified, ClearedTags : "/clean/tv.show.s11e23.1080p.web.h264-cakes.mkv"
16:19:11 [INF] <1> VerifyFailed files : 0
16:19:11 [INF] <1> Deleting empty folders ...
16:19:11 [INF] <13> Looking for empty folders in "/clean"
16:19:11 [INF] <1> Deleted folders : 1

--------------
Clean succeeded (0h:24m:31s)

and here is my plexcleaner.json file:

{
  "$schema": "https://raw.githubusercontent.com/ptr727/PlexCleaner/develop/PlexCleaner.schema.json",
  "SchemaVersion": 2,
  "ToolsOptions": {
    "UseSystem": true,
    "RootPath": "",
    "RootRelative": false,
    "AutoUpdate": false
  },
  "ConvertOptions": {
    "EnableH265Encoder": true,
    "VideoEncodeQuality": 20,
    "AudioEncodeCodec": "ac3"
  },
  "ProcessOptions": {
    "DeleteEmptyFolders": true,
    "DeleteUnwantedExtensions": true,
    "KeepExtensions": [
      ".partial~",
      ".nfo",
      ".jpg",
      ".srt",
      ".smi",
      ".ssa",
      ".ass",
      ".vtt"
    ],
    "ReMux": true,
    "ReMuxExtensions": [
      ".avi",
      ".m2ts",
      ".ts",
      ".vob",
      ".mp4",
      ".m4v",
      ".asf",
      ".wmv"
    ],
    "DeInterlace": true,
    "ReEncode": true,
    "ReEncodeVideo": [
      {
        "Format": "mpeg2video"
      },
      {
        "Format": "vc1"
      },
      {
        "Format": "wmv3"
      },
      {
        "Format": "msrle"
      },
      {
        "Format": "rawvideo"
      },
      {
        "Format": "indeo5"
      },
      {
        "Format": "h264",
        "Profile": "Constrained Baseline@30"
      },
      {
        "Format": "mpeg4",
        "Codec": "dx50"
      },
      {
        "Format": "msmpeg4v2",
        "Codec": "mp42"
      },
      {
        "Format": "msmpeg4v3",
        "Codec": "div3"
      }
    ],
    "ReEncodeAudioFormats": [
      "flac",
      "mp2",
      "vorbis",
      "wmapro",
      "opus",
      "wmav2",
      "adpcm_ms",
      "pcm_u8",
      "pcm_s16le"
    ],
    "SetUnknownLanguage": true,
    "DefaultLanguage": "eng",
    "RemoveUnwantedLanguageTracks": true,
    "KeepLanguages": [
      "eng"
    ],
    "RemoveDuplicateTracks": true,
    "PreferredAudioFormats": [
      "truehd atmos",
      "truehd",
      "dts-hd master audio",
      "dts-hd high resolution audio",
      "dts",
      "e-ac-3",
      "ac-3"
    ],
    "RemoveTags": true,
    "UseSidecarFiles": true,
    "SidecarUpdateOnToolChange": false,
    "Verify": true,
    "RestoreFileTimestamp": false,
    "FileIgnoreList": []
  },
  "MonitorOptions": {
    "MonitorWaitTime": 60,
    "FileRetryWaitTime": 5,
    "FileRetryCount": 2
  },
  "VerifyOptions": {
    "AutoRepair": true,
    "DeleteInvalidFiles": false,
    "RegisterInvalidFiles": false,
    "MinimumDuration": 300,
    "VerifyDuration": 0,
    "IdetDuration": 0,
    "MaximumBitrate": 100000000,
    "MinimumFileAge": 0
  }
}

The resulting file is still 4.4GB. Did it even do anything?
Do I need to adjust the config in some way? I expect the x264->x265 to give me at least "some" compression...
If it's not doing the conversion.. how can I force this? I want anything non x264 to be x265, my main goal here is optimal disk usage.

Thanks!

Add support for hardware accelerated GPU encoding

Add support for hardware accelerated GPU encoding, e.g. NVidia Cuda, Intel QuickSync, etc.

See:
https://trac.ffmpeg.org/wiki/HWAccelIntro
https://handbrake.fr/docs/en/latest/technical/video-nvenc.html
https://handbrake.fr/docs/en/latest/technical/video-qsv.html
https://developer.nvidia.com/blog/nvidia-ffmpeg-transcoding-guide/
https://arstech.net/ffmpeg-gpu-transcoding-examples/
https://superuser.com/questions/1296374/best-settings-for-ffmpeg-with-nvenc

The code will need refactoring as the FFmpeg and Handbrake commandline options are dynamically generated, and for e.g. ffmpeg both the global and encoder options need to be set.

An option is to remove the discrete options for H264/265, quality, and audio codec should be removed and the user allowed to construct their own commandline in the JSON configuration, thus allowing for custom configurations.

Some way to run in parallel?

I've noticed that the ffmpeg options won't utilize all cores -- is there a setting that allows configuring a target number of cores and/or running multiple threads when processing a large number of files? I'm on a 5950x so I'd like to max it out as it process 7k files rather than wait 3x as long.

Would it work if I run several instances of PlexCleaner at the same time, or would that cause synchronization issues as the instances try to tackle the same files at the same time?

HanbrakeCLI PPA provided by stebbins is no longer maintained

GitHub action builds started failing around 19 June 2022.
Issues is that the John Stebbins PPA for Handbrake is no longer being maintained, no longer available.

Old way of installing by PPA:
https://handbrake.fr/docs/en/1.0.0/get-handbrake/where-to-get-handbrake.html
https://launchpad.net/~stebbins
https://launchpad.net/~stebbins/+archive/ubuntu/handbrake-snapshots

New way of installing by flatpak:
https://handbrake.fr/docs/en/1.5.0/get-handbrake/download-and-install.html

But flatpak install requires different CLI command: flatpak run fr.handbrake.HandBrakeCLI vs. HandBrakeCLI

Figure out how to install from alternate PPA, or how to install from flatpak and launch using flatpak, or maybe compile from code.

Log details of modified content to file

Add option to log details of all modified content to a file.

Keep machine from sleeping while processing

Embed SRT subtitles in the MKV file

Crash on no audio stream

Some of my video files don't have an audio channel. This causes PlexCleaner to crash. I've noticed this with the MJPEG codec (AVI, wmv). Not sure about other codecs.

The First() call throws an error:

PlexCleaner/PlexCleaner/ProcessFile.cs

Lines 1013 to 1016 in eb592ee

 bitrateInfo.Calculate(packetList, 

 FfProbeInfo.Video.First().Id, 

 FfProbeInfo.Audio.First().Id, 

 Program.Config.VerifyOptions.MaximumBitrate / 8);

Unhandled exception: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation.
 ---> System.InvalidOperationException: Sequence contains no elements
   at System.Linq.ThrowHelper.ThrowNoElementsException()
   at System.Linq.Enumerable.First[TSource](IEnumerable`1 source)
   at PlexCleaner.ProcessFile.GetBitrateInfo(BitrateInfo& bitrateInfo) in D:\a\PlexCleaner\PlexCleaner\PlexCleaner\ProcessFile.cs:line 1013
   at PlexCleaner.ProcessFile.VerifyBitrate() in D:\a\PlexCleaner\PlexCleaner\PlexCleaner\ProcessFile.cs:line 623
   at PlexCleaner.ProcessFile.Verify(Boolean conditional, Boolean& modified) in D:\a\PlexCleaner\PlexCleaner\PlexCleaner\ProcessFile.cs:line 542
   at PlexCleaner.Process.ProcessFile(FileInfo fileinfo, Boolean& modified, States& state, FileInfo& processInfo) in D:\a\PlexCleaner\PlexCleaner\PlexCleaner\Process.cs:line 268
   at PlexCleaner.Process.<>c__DisplayClass3_0.<ProcessFiles>b__0(FileInfo fileInfo) in D:\a\PlexCleaner\PlexCleaner\PlexCleaner\Process.cs:line 114
   at PlexCleaner.Process.ProcessFilesDriver(List`1 fileList, String taskName, Func`2 taskFunc) in D:\a\PlexCleaner\PlexCleaner\PlexCleaner\Process.cs:line 542
   at PlexCleaner.Process.ProcessFiles(List`1 fileList) in D:\a\PlexCleaner\PlexCleaner\PlexCleaner\Process.cs:line 111
   at PlexCleaner.Program.ProcessCommand(CommandLineOptions options) in D:\a\PlexCleaner\PlexCleaner\PlexCleaner\Program.cs:line 109
   --- End of inner exception stack trace ---
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Span`1& arguments, Signature sig, Boolean constructor, Boolean wrapExceptions)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at System.Delegate.DynamicInvokeImpl(Object[] args)
   at System.Delegate.DynamicInvoke(Object[] args)
   at System.CommandLine.NamingConventionBinder.ModelBindingCommandHandler.InvokeAsync(InvocationContext context)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_0.<<BuildInvocationChain>b__0>d.MoveNext()
--- End of stack trace from previous location ---
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass22_0.<<UseParseErrorReporting>b__0>d.MoveNext()
--- End of stack trace from previous location ---
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass15_0.<<UseHelp>b__0>d.MoveNext()
--- End of stack trace from previous location ---
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass26_0.<<UseVersionOption>b__0>d.MoveNext()
--- End of stack trace from previous location ---
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass24_0.<<UseTypoCorrections>b__0>d.MoveNext()
--- End of stack trace from previous location ---
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<<UseSuggestDirective>b__23_0>d.MoveNext()
--- End of stack trace from previous location ---
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass21_0.<<UseParseDirective>b__0>d.MoveNext()
--- End of stack trace from previous location ---
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<<UseDebugDirective>b__8_0>d.MoveNext()
--- End of stack trace from previous location ---
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<<RegisterWithDotnetSuggest>b__7_0>d.MoveNext()
--- End of stack trace from previous location ---
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass11_0.<<UseExceptionHandler>b__0>d.MoveNext()

HandBrake converts all subtitles to ASS vs. passthrough

HandBrake will convert closed captions and subtitle tracks to ASS format.

The behavior is "intentional", but undesirable.
https://forum.handbrake.fr/viewtopic.php?f=6&t=34522&p=161536

Issue is tracked here.
HandBrake/HandBrake#160

As workaround run handbrake with no subtitles in output, and then remux subtitles back in.

Add support for H265/AVC encoding

Add support for for configuring an option to use H265 encoding instead of hardcoded H264.

Refresh Plex library after changing media files

See:
https://support.plex.tv/articles/201638786-plex-media-server-url-commands/
https://forums.plex.tv/t/how-to-refresh-a-single-series-via-url-the-plexweb-client-is-able-to-do-so-so-there-must-be-a-way/176841

Add Shields.io pre-release badge when supported

See badges/shields#7913

FFmpeg removes IETF language tags

FFmpeg removes IETF BCP-47 language tags from MKV files during remuxing or encoding.

See FFmpeg Trac issue ticket.

See Matroska IETF Draft Spec
See Languages in Matroska and MKVToolNix WiKi
See Matroska EBML LanguageIETF tag

Summary: When FFmpeg creates MKV files from MKV files, the LanguageIETF tags from the original file is not written, and the language granularity is lost.

Create media file snippet: mkvmerge --split parts:00:00:00-00:01:00 --output MKV-IETF-Snippet.mkv MKV-IETF.mkv

MkvMerge: mkvmerge --identify MKV-IETF-Snippet.mkv --identification-format json

"language": "eng", "language_ietf": "en"
"language": "spa", "language_ietf": "es-ES"
"language": "srp", "language_ietf": "sr-Latn-RS"

MediaInfo: mediainfo --Output=XML MKV-IETF-Snippet.mkv

<Language>en</Language>
<Language>es-ES</Language>
<Language>sr-Latn-RS</Language>

FfProbe: ffprobe -loglevel quiet -show_streams -show_format -print_format json MKV-IETF-Snippet.mkv

"language": "eng"
"language": "spa"
"language": "srp"

ReMux using FfMpeg: ffmpeg -i MKV-IETF-Snippet.mkv -map 0 -codec copy -f matroska MKV-IETF-Snippet-FfMpeg.mkv

MkvMerge differences:

"language_ietf", ``: "en": Removed the IETF language tag
"language_ietf", ``: "es-ES": Removed the IETF language tag
"language_ietf", ``: "sr-Latn-RS": Removed the IETF language tag

MedaInfo difference:

<Default>No</Default>, <Default>Yes</Default>: Track changed from not default to default
<Language>en-US</Language>, <Language>en</Language>: Removed the IETF language tag granularity
<Language>es-ES</Language>, <Language>es</Language>: Removed the IETF language tag granularity
<Language>sr-Latn-RS</Language>, <Language>sr</Language>: Removed the IETF language tag granularity

FfProbe differences:

"default": 0, "default": 1: Changed track from not default to default

Docker logs grow "out of control"

Logs are simply growing out of control, eventually filling the filesystem.

https://i.imgur.com/OhqFzMv.png

restarting the containers doesn't clear the logs.

Add Shields.io badge for GHCR when available

See: badges/shields#5594

Prefer DTS over AC3 by changing the track order

Check if more than two audio or subtitle tracks of the same language exists, and prefer DTS over AC3 by changing the track order.

alpine: mediainfo not found

Is this a new issue that can be reproduced?

This is a new issue that can be reproduced.

Which operating systems reproduce the issue?

Windows
Docker
Other

Version information.

OS Version: Synology DSM 6
Docker Version: Docker version 20.10.3, build b35e731
Docker Image: alpine
PlexCleaner getversioninfo: 3.2.31

Steps to reproduce?

Steps to reproduce:

install alpine branch
run config
[ERR] <1> MediaInfo not found : "mediainfo"

Expectation:

docker should include all required tools

Commandline.

/ # /PlexCleaner/PlexCleaner \
>   --logfile /media/PlexCleaner/PlexCleaner.log \
>   process \
>   --settingsfile /media/PlexCleaner/PlexCleaner.json \
>   --mediafiles /media/Movies \
>   --mediafiles /media/TV

Relevant log output.

Press Ctrl+C or Ctrl+Z or Ctrl+Q to exit.
22:11:25 [INF] <1> Loading settings from : "/media/PlexCleaner/PlexCleaner.json"
22:11:26 [INF] <1> Logging output to : "/media/PlexCleaner/PlexCleaner.log"
22:11:26 [INF] <1> Application Version : "PlexCleaner : 3.2.31+154c388a24 (Release)", Runtime Version : "7.0.8"
22:11:26 [INF] <1> Parallel Processing: False : Thread Count: 1, Processor Count: 2
22:11:26 [INF] <1> Executing FfMpeg : "-version"
22:11:26 [INF] <1> FfMpeg : Version: "6.0", Path: "ffmpeg"
22:11:26 [INF] <1> Executing FfProbe : "-version"
22:11:26 [INF] <1> FfProbe : Version: "6.0", Path: "ffprobe"
22:11:26 [INF] <1> Executing MkvMerge : "--version"
22:11:26 [INF] <1> MkvMerge : Version: "78.0", Path: "mkvmerge"
22:11:26 [INF] <1> Executing MkvPropEdit : "--version"
22:11:26 [INF] <1> MkvPropEdit : Version: "78.0", Path: "mkvpropedit"
22:11:26 [INF] <1> Executing MkvExtract : "--version"
22:11:27 [INF] <1> MkvExtract : Version: "78.0", Path: "mkvextract"
22:11:27 [INF] <1> Executing MediaInfo : "--version"
22:11:27 [ERR] <1> MediaInfo not found : "mediainfo"
22:11:27 [INF] <1> Exit Code : 1

Settings file.

{
  "$schema": "https://raw.githubusercontent.com/ptr727/PlexCleaner/main/PlexCleaner.schema.json",
  "SchemaVersion": 3,
  "ToolsOptions": {
    "UseSystem": true,
    "RootPath": "",
    "RootRelative": false,
    "AutoUpdate": false
  },
  "ProcessOptions": {
    "KeepOriginalLanguage": true,
    "SetIetfLanguageTags": true,
    "SetTrackFlags": true,
    "SetUnknownLanguage": true,
    "DefaultLanguage": "en",
    "RemoveUnwantedLanguageTracks": false,
    "RemoveDuplicateTracks": false,
    "RemoveTags": true,
    "UseSidecarFiles": true,
    "SidecarUpdateOnToolChange": false,
    "Verify": true,
    "RestoreFileTimestamp": false,
    "FileIgnoreList": []
  },
  "ConvertOptions": {
    "FfMpegOptions": {
      "Video": "libx264 -crf 22 -preset medium",
      "Audio": "ac3",
      "Global": "-analyzeduration 2147483647 -probesize 2147483647",
      "Output": "-max_muxing_queue_size 1024 -abort_on empty_output"
    },
    "HandBrakeOptions": {
      "Video": "x264 --quality 22 --encoder-preset medium",
      "Audio": "copy --audio-fallback ac3"
    }
  },
  "VerifyOptions": {
    "AutoRepair": true,
    "DeleteInvalidFiles": false,
    "RegisterInvalidFiles": false,
    "MaximumBitrate": 100000000
  },
  "MonitorOptions": {
    "MonitorWaitTime": 60,
    "FileRetryWaitTime": 5,
    "FileRetryCount": 2
  }
}

Log file.

No response

Media file information.

No response

Workaround

use debian

Remove subtitles that cannot DirectPlay

Reenable the file watcher when directory disappears

Reenable the file watcher when directory disappears.
System.ComponentModel.Win32Exception (0x80004005): The specified network name is no longer available

[Question] Is this similar to Tdarr?

As title, is the an alternative of Tdarr?
Will this plugin eat up a lot of resources to transcode video and subtitle like Tdarr?

HandBrake removes IETF language tags

HandBrake removes IETF BCP-47 language tags from MKV files during encoding.

See related FFmpeg issue ticket for a similar problem.

See HandBrake forum post, I could not create a HandBrake GitHub issue.
See related HandBrake GUI issue

See Matroska IETF Draft Spec
See Languages in Matroska and MKVToolNix WiKi
See Matroska EBML LanguageIETF tag

Summary: When HandBrake creates MKV files from MKV files, the LanguageIETF tags from the original file is not written, and the language granularity is lost.

Create media file snippet: mkvmerge --split parts:00:00:00-00:01:00 --output MKV-IETF-Snippet.mkv MKV-IETF.mkv

MkvMerge: mkvmerge --identify MKV-IETF-Snippet.mkv --identification-format json

"language": "eng", "language_ietf": "en"
"language": "spa", "language_ietf": "es-ES"
"language": "srp", "language_ietf": "sr-Latn-RS"

MediaInfo: mediainfo --Output=XML MKV-IETF-Snippet.mkv

<Language>en</Language>
<Language>es-ES</Language>
<Language>sr-Latn-RS</Language>

Encode using HandBrake: HandBrakeCLI --input MKV-IETF-Snippet.mkv --output MKV-IETF-Snippet-HandBrake.mkv --format av_mkv --encoder x264 --quality 22 --encoder-preset medium --all-audio --aencoder copy --audio-fallback ac3 --all-subtitles

Notice that some of the extended languages are not recognized in the console output:

[20:00:40]  * subtitle track 1, English [UTF-8] (track 0, id 0x2, Text) -> Passthrough
[20:00:40]  * subtitle track 2, English [UTF-8] (track 1, id 0x3, Text) -> Passthrough
[20:00:40]    + name: SDH
[20:00:40]  * subtitle track 3, ????????? [UTF-8] (track 2, id 0x4, Text) -> Passthrough
[20:00:40]  * subtitle track 4, cestina [UTF-8] (track 3, id 0x5, Text) -> Passthrough
[20:00:40]  * subtitle track 5, dansk [UTF-8] (track 4, id 0x6, Text) -> Passthrough
[20:00:40]  * subtitle track 6, español [UTF-8] (track 5, id 0x7, Text) -> Passthrough
[20:00:40]    + name: Spanish (Latin America)
[20:00:40]  * subtitle track 7, español [UTF-8] (track 6, id 0x8, Text) -> Passthrough
[20:00:40]    + name: Spanish (Latin America) (SDH)
[20:00:40]  * subtitle track 8, español [UTF-8] (track 7, id 0x9, Text) -> Passthrough
[20:00:40]    + name: Spanish (Spain)
[20:00:40]  * subtitle track 9, suomi [UTF-8] (track 8, id 0xa, Text) -> Passthrough
[20:00:40]  * subtitle track 10, hrvatski [UTF-8] (track 9, id 0xb, Text) -> Passthrough
[20:00:40]  * subtitle track 11, magyar [UTF-8] (track 10, id 0xc, Text) -> Passthrough
[20:00:40]  * subtitle track 12, ?????????? [UTF-8] (track 11, id 0xd, Text) -> Passthrough
[20:00:40]  * subtitle track 13, Nederlands [UTF-8] (track 12, id 0xe, Text) -> Passthrough
[20:00:40]  * subtitle track 14, norsk [UTF-8] (track 13, id 0xf, Text) -> Passthrough
[20:00:40]  * subtitle track 15, polski [UTF-8] (track 14, id 0x10, Text) -> Passthrough
[20:00:40]  * subtitle track 16, Portugues [UTF-8] (track 15, id 0x11, Text) -> Passthrough
[20:00:40]  * subtitle track 17, româna [UTF-8] (track 16, id 0x12, Text) -> Passthrough
[20:00:40]  * subtitle track 18, slovenscina [UTF-8] (track 17, id 0x13, Text) -> Passthrough
[20:00:40]  * subtitle track 19, srpski [UTF-8] (track 18, id 0x14, Text) -> Passthrough
[20:00:40]  * subtitle track 20, svenska [UTF-8] (track 19, id 0x15, Text) -> Passthrough

MkvMerge --identify differences:

"language_ietf", ``: "en": Removed the IETF language tag
"language_ietf", ``: "es-ES": Removed the IETF language tag
"language_ietf", ``: "sr-Latn-RS": Removed the IETF language tag

Tested using master:

> ./HandBrakeCLI --version
[20:06:57] Compile-time hardening features are enabled
[20:06:57] qsv: is available on this system
Cannot load nvEncodeAPI64.dll
[20:06:57] vcn: not available on this system
[20:06:57] hb_init: starting libhb thread
[20:06:57] thread 1 started ("libhb")
HandBrake 20230329184118-13ae00bdf-master

HandBrake has exited.

NullReferenceException

I have been getting this error consistently. It does not seem to be tied to a particular file, but happens when I am about 15% through running process on a large folder of nested movies and tv shows.

Windows 10
PlexCleaner 2.8.13
not running in parallel mode (also happens in parallel mode though)

error:

10:52:22 [ERR] <1> "ProcessFilesDriver"
System.AggregateException: One or more errors occurred. (Object reference not set to an instance of an object.)
 ---> System.NullReferenceException: Object reference not set to an instance of an object.
   at PlexCleaner.SidecarFile.ReadJson() in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/SidecarFile.cs:line 487
   at PlexCleaner.SidecarFile.Read(Boolean& current, Boolean verify) in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/SidecarFile.cs:line 128
   at PlexCleaner.SidecarFile.Open(Boolean modified) in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/SidecarFile.cs:line 232
   at PlexCleaner.ProcessFile.Refresh(Boolean modified) in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/ProcessFile.cs:line 1399
   at PlexCleaner.Process.ProcessFile(String fileName, Boolean& modified, States& state, String& processName) in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/Process.cs:line 470
   at PlexCleaner.Process.<>c__DisplayClass5_0.<ProcessFiles>b__0(String fileName) in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/Process.cs:line 220
   at PlexCleaner.Process.<>c__DisplayClass16_0.<ProcessFilesDriver>b__1(IGrouping`2 keyPair) in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/Process.cs:line 727
   at System.Linq.Parallel.ForAllOperator`1.ForAllEnumerator`1.MoveNext(TInput& currentElement, Int32& currentKey)
   at System.Linq.Parallel.ForAllSpoolingTask`2.SpoolingWork()
   at System.Linq.Parallel.SpoolingTaskBase.Work()
   at System.Linq.Parallel.QueryTask.BaseWork(Object unused)
   at System.Linq.Parallel.QueryTask.RunTaskSynchronously(Object o)
   at System.Threading.Tasks.Task.InnerInvoke()
   at System.Threading.Tasks.Task.<>c.<.cctor>b__272_0(Object obj)
   at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state)
--- End of stack trace from previous location ---
   at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot, Thread threadPoolThread)
   --- End of inner exception stack trace ---
   at System.Linq.Parallel.QueryTaskGroupState.QueryEnd(Boolean userInitiatedDispose)
   at System.Linq.Parallel.SpoolingTask.SpoolForAll[TInputOutput,TIgnoreKey](QueryTaskGroupState groupState, PartitionedStream`2 partitions, TaskScheduler taskScheduler)
   at System.Linq.Parallel.DefaultMergeHelper`2.System.Linq.Parallel.IMergeHelper<TInputOutput>.Execute()
   at System.Linq.Parallel.MergeExecutor`1.Execute()
   at System.Linq.Parallel.MergeExecutor`1.Execute[TKey](PartitionedStream`2 partitions, Boolean ignoreOutput, ParallelMergeOptions options, TaskScheduler taskScheduler, Boolean isOrdered, CancellationState cancellationState, Int32 queryId)
   at System.Linq.Parallel.PartitionedStreamMerger`1.Receive[TKey](PartitionedStream`2 partitionedStream)
   at System.Linq.Parallel.ForAllOperator`1.WrapPartitionedStream[TKey](PartitionedStream`2 inputStream, IPartitionedStreamRecipient`1 recipient, Boolean preferStriping, QuerySettings settings)
   at System.Linq.Parallel.UnaryQueryOperator`2.UnaryQueryOperatorResults.ChildResultsRecipient.Receive[TKey](PartitionedStream`2 inputStream)
   at System.Linq.Parallel.PartitionerQueryOperator`1.PartitionerQueryOperatorResults.GivePartitionedStream(IPartitionedStreamRecipient`1 recipient)
   at System.Linq.Parallel.UnaryQueryOperator`2.UnaryQueryOperatorResults.GivePartitionedStream(IPartitionedStreamRecipient`1 recipient)
   at System.Linq.Parallel.QueryOperator`1.GetOpenedEnumerator(Nullable`1 mergeOptions, Boolean suppressOrder, Boolean forEffect, QuerySettings querySettings)
   at System.Linq.Parallel.ForAllOperator`1.RunSynchronously()
   at System.Linq.ParallelEnumerable.ForAll[TSource](ParallelQuery`1 source, Action`1 action)
   at PlexCleaner.Process.ProcessFilesDriver(List`1 fileList, String taskName, Func`2 taskFunc) in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/Process.cs:line 714
10:52:22 [INF] <1> Completed "Process"
10:52:22 [INF] <1> Processing time : 00:00:01.9141056
10:52:22 [INF] <1> Total files : 11513
10:52:22 [INF] <1> Error files : 0
10:52:22 [INF] <1> Modified files : 0
10:52:22 [INF] <1> VerifyFailed files : 0
10:52:22 [INF] <1> Deleting empty folders ...
10:52:22 [INF] <1> Looking for empty folders in "D:\\Plex"
10:52:22 [INF] <1> Deleted folders : 0

Compare folder name with file name and rename to match

HEVC can't direct play in most environments, might be good to add to default ReEncodeVideo list

I was processing a large list of files and I noticed some were HEVC and didn't get automatically converted. HEVC as far as I can tell doesn't work in direct play in any players I've tried, so I added it to my list as follows:

    "ReEncodeVideo": [
    ...
      {
        "Format": "hevc"
      },
     ...

and now I have no issues. Just thought I'd report this as it might be a good idea to add it to the defaults

Retain original creation date

The newly created video files all have the creation and modification timestamp of today. This messes up my photo's collection. Would it be possible to add a flag that causes PlexCleaner to copy the original dates?

Some sort of bitrate related bug

I have some mkv files that throw this error when I try to run them through plex cleaner:

 ---> (Inner Exception #4) System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at PlexCleaner.BitrateInfo.Calculate(List`1 packetList, Int32 videoStream, Int32 audioStream, Int32 threshold) in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/BitrateInfo.cs:line 0
   at PlexCleaner.ProcessFile.GetBitrateInfo(BitrateInfo& bitrateInfo) in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/ProcessFile.cs:line 1497
   at PlexCleaner.ProcessFile.VerifyBitrate() in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/ProcessFile.cs:line 1067
   at PlexCleaner.ProcessFile.Verify(Boolean& modified) in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/ProcessFile.cs:line 957
   at PlexCleaner.Process.ProcessFile(String fileName, Boolean& modified, States& state, String& processName) in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/Process.cs:line 430
   at PlexCleaner.Process.<>c__DisplayClass5_0.<ProcessFiles>b__0(String fileName) in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/Process.cs:line 177
   at PlexCleaner.Process.<>c__DisplayClass16_0.<ProcessFilesDriver>b__1(IGrouping`2 keyPair) in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/Process.cs:line 736
   at System.Linq.Parallel.ForAllOperator`1.ForAllEnumerator`1.MoveNext(TInput& currentElement, Int32& currentKey)
   at System.Linq.Parallel.ForAllSpoolingTask`2.SpoolingWork()
   at System.Linq.Parallel.SpoolingTaskBase.Work()
   at System.Linq.Parallel.QueryTask.BaseWork(Object unused)
   at System.Linq.Parallel.QueryTask.<>c.<.cctor>b__10_0(Object o)
   at System.Threading.Tasks.Task.InnerInvoke()
   at System.Threading.Tasks.Task.<>c.<.cctor>b__272_0(Object obj)
   at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state)
--- End of stack trace from previous location ---
   at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state)
   at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot, Thread threadPoolThread)<---

My workaround right now is to handbrake them manually first, but I'm guessing this might be a simple index out of bounds fix

"Assertion failed" as soon as it encounters an .SRT

Log:
https://pastebin.com/raw/7G42Pii7
Docker Stack:

version: '3.3'
services:
    plexcleaner:
        image: ptr727/plexcleaner
        container_name: plexcleaner
        environment:
          - PUID=1000
          - PGID=100
          - TZ=Europe/Oslo
        command: /PlexCleaner/PlexCleaner --settingsfile /config/PlexCleaner.json process --mediafiles /DATA00/media
        volumes:
          - /srv/dev-disk-by-label-DATA01/Docker_Config/PLEXCLEANER:/config
          - /srv/dev-disk-by-label-DATA00:/DATA00/media:rw

PlexCleaner.json:

{
  "SchemaVersion": 1,
  "ToolsOptions": {
    "UseSystem": false,
    "RootPath": ".\\Tools\\",
    "RootRelative": true,
    "AutoUpdate": true
  },
  "ConvertOptions": {
    "EnableH265Encoder": false,
    "VideoEncodeQuality": 20,
    "AudioEncodeCodec": "aac"
  },
  "ProcessOptions": {
    "DeleteEmptyFolders": true,
    "DeleteUnwantedExtensions": false,
    "KeepExtensions": ".partial~",
    "ReMux": false,
    "ReMuxExtensions": ".avi,.m2ts,.ts,.vob,.mp4,.m4v,.asf,.wmv",
    "DeInterlace": true,
    "ReEncode": false,
    "ReEncodeVideoFormats": "mpeg2video,mpeg4,msmpeg4v3,msmpeg4v2,vc1,h264",
    "ReEncodeVideoCodecs": "*,dx50,div3,mp42,*,*",
    "ReEncodeVideoProfiles": "*,*,*,*,*,Constrained Baseline@30",
    "ReEncodeAudioFormats": "flac,mp2,vorbis,wmapro,pcm_s16le",
    "SetUnknownLanguage": false,
    "DefaultLanguage": "eng",
    "RemoveUnwantedLanguageTracks": true,
    "KeepLanguages": "eng,nor,swe,dan",
    "RemoveDuplicateTracks": true,
    "PreferredAudioFormats": "truehd atmos,truehd,dts-hd master audio,dts-hd high resolution audio,dts,e-ac-3,ac-3",
    "RemoveTags": true,
    "UseSidecarFiles": true,
    "SidecarUpdateOnToolChange": false,
    "Verify": false,
    "FileIgnoreList": []
  },
  "MonitorOptions": {
    "MonitorWaitTime": 60,
    "FileRetryWaitTime": 5,
    "FileRetryCount": 2
  },
  "VerifyOptions": {
    "AutoRepair": true,
    "DeleteInvalidFiles": false,
    "RegisterInvalidFiles": true,
    "MinimumDuration": 300,
    "VerifyDuration": 0,
    "IdetDuration": 0,
    "MaximumBitrate": 100000000,
    "MinimumFileAge": 0
  }
}

Add progress % to processing

Maybe output {datetime : %} {blahblah}.

unable get ffmpeg

Is this a new issue that can be reproduced?

This is a new issue that can be reproduced.

Which operating systems reproduce the issue?

Windows
Docker
Other

Version information.

OS Version: E.g. Windows 10 Pro 22H2.

Steps to reproduce?

I just ran the command line

Commandline.

PlexCleaner checkfornewtools --settingsfile PlexCleaner.json

Relevant log output.

PlexCleaner checkfornewtools --settingsfile PlexCleaner.json
14:10:05 [INF] <1> Loading settings from : "PlexCleaner.json"
14:10:05 [INF] <1> Application Version : "3.1.24+d77820f206.d77820f2063b22373fb736670320c391a4488e7d", Runtime Version : "7.0.5", Debug Build: False
14:10:05 [INF] <1> Parallel Processing: False : Thread Count: 1, Processor Count: 16
14:10:05 [INF] <1> Checking for new tools ...
14:10:05 [INF] <1> Getting latest version of FfMpeg ...
14:10:36 [ERR] <1> "GetContentInfo"
System.AggregateException: One or more errors occurred. (A task was canceled.)
 ---> System.Threading.Tasks.TaskCanceledException: A task was canceled.
   at System.Threading.Tasks.Task.GetExceptions(Boolean includeTaskCanceledExceptions)
   at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
   at System.Threading.Tasks.Task`1.GetResultCore(Boolean waitCompletionNotification)
   at InsaneGenius.Utilities.Download.GetContentInfo(Uri uri, Int64& size, DateTime& modifiedTime)
   at PlexCleaner.Tools.GetUrlDetails(MediaToolInfo mediaToolInfo) in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/Tools.cs:line 339
   at PlexCleaner.Tools.CheckForNewTools() in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/Tools.cs:line 265
   at PlexCleaner.Program.CheckForNewToolsCommand(CommandLineOptions options) in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/Program.cs:line 160
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at System.Delegate.DynamicInvokeImpl(Object[] args)
   at System.CommandLine.NamingConventionBinder.ModelBindingCommandHandler.InvokeAsync(InvocationContext context)
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[TStateMachine](TStateMachine& stateMachine)
   at System.CommandLine.NamingConventionBinder.ModelBindingCommandHandler.InvokeAsync(InvocationContext context)
   at System.CommandLine.NamingConventionBinder.ModelBindingCommandHandler.Invoke(InvocationContext context)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_0.<<BuildInvocationChain>b__0>d.MoveNext()
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[TStateMachine](TStateMachine& stateMachine)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_0.<BuildInvocationChain>b__0(InvocationContext invocationContext, Func`2 _)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_2.<BuildInvocationChain>b__3(InvocationContext c)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass17_0.<<UseParseErrorReporting>b__0>d.MoveNext()
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[TStateMachine](TStateMachine& stateMachine)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass17_0.<UseParseErrorReporting>b__0(InvocationContext context, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_2.<BuildInvocationChain>b__3(InvocationContext c)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass12_0.<<UseHelp>b__0>d.MoveNext()
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[TStateMachine](TStateMachine& stateMachine)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass12_0.<UseHelp>b__0(InvocationContext context, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_2.<BuildInvocationChain>b__3(InvocationContext c)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass22_0.<<UseVersionOption>b__0>d.MoveNext()
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[TStateMachine](TStateMachine& stateMachine)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass22_0.<UseVersionOption>b__0(InvocationContext context, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_2.<BuildInvocationChain>b__3(InvocationContext c)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass19_0.<<UseTypoCorrections>b__0>d.MoveNext()
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[TStateMachine](TStateMachine& stateMachine)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass19_0.<UseTypoCorrections>b__0(InvocationContext context, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_2.<BuildInvocationChain>b__3(InvocationContext c)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<<UseSuggestDirective>b__18_0>d.MoveNext()
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[TStateMachine](TStateMachine& stateMachine)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<UseSuggestDirective>b__18_0(InvocationContext context, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_2.<BuildInvocationChain>b__3(InvocationContext c)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass16_0.<<UseParseDirective>b__0>d.MoveNext()
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[TStateMachine](TStateMachine& stateMachine)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass16_0.<UseParseDirective>b__0(InvocationContext context, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_2.<BuildInvocationChain>b__3(InvocationContext c)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<<RegisterWithDotnetSuggest>b__5_0>d.MoveNext()
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[TStateMachine](TStateMachine& stateMachine)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<RegisterWithDotnetSuggest>b__5_0(InvocationContext context, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_2.<BuildInvocationChain>b__3(InvocationContext c)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<UseEnvironmentVariableDirective>b__6_0(InvocationContext context, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_2.<BuildInvocationChain>b__3(InvocationContext c)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass8_0.<<UseExceptionHandler>b__0>d.MoveNext()
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[TStateMachine](TStateMachine& stateMachine)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass8_0.<UseExceptionHandler>b__0(InvocationContext context, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_2.<BuildInvocationChain>b__3(InvocationContext c)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<<CancelOnProcessTermination>b__1_0>d.MoveNext()
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[TStateMachine](TStateMachine& stateMachine)
   at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<CancelOnProcessTermination>b__1_0(InvocationContext context, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_1.<BuildInvocationChain>b__2(InvocationContext ctx, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_1.<BuildInvocationChain>b__2(InvocationContext ctx, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_1.<BuildInvocationChain>b__2(InvocationContext ctx, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_1.<BuildInvocationChain>b__2(InvocationContext ctx, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_1.<BuildInvocationChain>b__2(InvocationContext ctx, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_1.<BuildInvocationChain>b__2(InvocationContext ctx, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_1.<BuildInvocationChain>b__2(InvocationContext ctx, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_1.<BuildInvocationChain>b__2(InvocationContext ctx, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_1.<BuildInvocationChain>b__2(InvocationContext ctx, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_1.<BuildInvocationChain>b__2(InvocationContext ctx, Func`2 next)
   at System.CommandLine.Invocation.InvocationPipeline.<Invoke>g__FullInvocationChain|3_0(InvocationContext context)
   at System.CommandLine.Invocation.InvocationPipeline.Invoke(IConsole console)
   at System.CommandLine.CommandExtensions.Invoke(Command command, String[] args, IConsole console)
   at PlexCleaner.CommandLineOptions.Invoke() in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/CommandLineOptions.cs:line 30
   at PlexCleaner.Program.Main() in /home/runner/work/PlexCleaner/PlexCleaner/PlexCleaner/Program.cs:line 44
--- End of stack trace from previous location ---

   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
   at System.Threading.Tasks.Task`1.GetResultCore(Boolean waitCompletionNotification)
   at InsaneGenius.Utilities.Download.GetContentInfo(Uri uri, Int64& size, DateTime& modifiedTime)
14:10:36 [ERR] <1> FfMpeg : Failed to get latest version
14:10:36 [INF] <1> Exit Code : 1

Settings file.

{
"$schema": "https://raw.githubusercontent.com/ptr727/PlexCleaner/main/PlexCleaner.schema.json",
"SchemaVersion": 3,
"ToolsOptions": {
"UseSystem": false,
"RootPath": ".\Tools\",
"RootRelative": true,
"AutoUpdate": true
},
"ProcessOptions": {
"KeepOriginalLanguage": true,
"RemoveClosedCaptions": true,
"SetIetfLanguageTags": true,
"SetTrackFlags": true,
"KeepExtensions": [
".partial~",
".nfo",
".jpg",
".srt",
".smi",
".ssa",
".ass",
".vtt"
],
"ReMuxExtensions": [
".avi",
".m2ts",
".ts",
".vob",
".mp4",
".m4v",
".asf",
".wmv"
],
"ReEncodeVideo": [
{
"Format": "mpeg2video"
},
{
"Format": "vc1"
},
{
"Format": "wmv3"
},
{
"Format": "msrle"
},
{
"Format": "rawvideo"
},
{
"Format": "indeo5"
},
{
"Format": "h264",
"Profile": "Constrained Baseline@30"
},
{
"Format": "mpeg4",
"Codec": "dx50"
},
{
"Format": "msmpeg4v2",
"Codec": "mp42"
},
{
"Format": "msmpeg4v3",
"Codec": "div3"
}
],
"ReEncodeAudioFormats": [
"flac",
"mp2",
"vorbis",
"wmapro",
"opus",
"wmav2",
"adpcm_ms",
"pcm_u8",
"pcm_s16le"
],
"KeepLanguages": [
"en",
"af",
"zh",
"in"
],
"PreferredAudioFormats": [
"truehd atmos",
"truehd",
"dts-hd master audio",
"dts-hd high resolution audio",
"dts",
"e-ac-3",
"ac-3"
],
"DeleteEmptyFolders": true,
"DeleteUnwantedExtensions": true,
"ReMux": true,
"DeInterlace": true,
"ReEncode": true,
"SetUnknownLanguage": true,
"DefaultLanguage": "en",
"RemoveUnwantedLanguageTracks": false,
"RemoveDuplicateTracks": false,
"RemoveTags": true,
"UseSidecarFiles": true,
"SidecarUpdateOnToolChange": false,
"Verify": true,
"RestoreFileTimestamp": false,
"FileIgnoreList": []
},
"ConvertOptions": {
"FfMpegOptions": {
"Video": "libx264 -crf 22 -preset medium",
"Audio": "ac3",
"Global": "-analyzeduration 2147483647 -probesize 2147483647",
"Output": "-max_muxing_queue_size 1024 -abort_on empty_output"
},
"HandBrakeOptions": {
"Video": "x264 --quality 22 --encoder-preset medium",
"Audio": "copy --audio-fallback ac3"
}
},
"VerifyOptions": {
"AutoRepair": true,
"DeleteInvalidFiles": false,
"RegisterInvalidFiles": false,
"MaximumBitrate": 100000000
},
"MonitorOptions": {
"MonitorWaitTime": 60,
"FileRetryWaitTime": 5,
"FileRetryCount": 2
}
}

Log file.

No response

Media file information.

No response

Refactor codec encoding options

PlexCleaner/PlexCleaner.json

Lines 42 to 51 in 782f706

 // Re-encode the video if the format, codec, and profile values match 

 // * will match anything, the number of filter entries must match 

 // Use FFProbe attribute naming, and the `printmediainfo` command to get media info 

 "ReEncodeVideoFormats": "mpeg2video,mpeg4,msmpeg4v3,msmpeg4v2,vc1,h264,wmv3", 

 "ReEncodeVideoCodecs": "*,dx50,div3,mp42,*,*,*", 

 "ReEncodeVideoProfiles": "*,*,*,*,*,Constrained Baseline@30,*", 

 // Re-encode matching audio codecs 

 // If the video format is not H264 or H265, video will automatically be converted to H264 to avoid audio sync issues 

 // Use FFProbe attribute naming, and the `printmediainfo` command to get media info 

 "ReEncodeAudioFormats": "flac,mp2,vorbis,wmapro,pcm_s16le,opus,wmav2",

Use JSON array instead of comma delimited strings.
Add wildcard matching to codecs, e.g. *pcm to match any pcm format.

Distinguish between Chinese languages

The "chi" language tag is used for different types of written Chinese, figure out a way to specify the sub-types.

4/27/2020 1:22:10 PM : Keep : Subtitle : MuxingMode : , Forced : False, Track : Format : SubRip/SRT, Codec : S_TEXT/UTF8, Language : chi, Id : 5, Number : 6, State : Keep, Title : Simplified Chinese
4/27/2020 1:22:11 PM : Remove : Subtitle : MuxingMode : , Forced : False, Track : Format : SubRip/SRT, Codec : S_TEXT/UTF8, Language : chi, Id : 6, Number : 7, State : Remove, Title : Traditional Chinese, Default : False
4/27/2020 1:22:11 PM : Remove : Subtitle : MuxingMode : , Forced : False, Track : Format : SubRip/SRT, Codec : S_TEXT/UTF8, Language : chi, Id : 7, Number : 8, State : Remove, Title : (Yue Chinese), Default : False

FFprobe closed_captions JSON tag not set

ffprobe does not identify closed captions when using JSON output mode.

Unformatted output:

./ffprobe.exe D:\Temp\CC.mkv
  Stream #0:0(eng): Video: h264 (High), yuv420p(tv, bt709, progressive), 1920x1080, Closed Captions, SAR 1:1 DAR 16:9, 29.97 fps, 29.97 tbr, 1k tbn (default)

Note the Closed Captions attribute.

JSON output:

./ffprobe.exe -loglevel quiet -print_format json -show_streams -show_format D:\Temp\CC.mkv
{
    "streams": [
        {
            "index": 0,
            "codec_name": "h264",
            "codec_long_name": "H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10",
...
            "closed_captions": 0,

Note the closed_captions attribute is 0, expect it to be 1.

Asked for help or alternatives here:
https://www.reddit.com/r/ffmpeg/comments/tcnhto/how_to_detect_closed_captions_in_video_stream/
https://forum.videohelp.com/threads/405123-Detect-embedded-closed-captions-in-video-stream-using-ffprobe-json-output

Discovered an abandoned patch for exactly this issue, seems there was some internal disagreement:
https://patchwork.ffmpeg.org/project/ffmpeg/patch/MN2PR04MB59815313285AA685E37D09AEBAB09@MN2PR04MB5981.namprd04.prod.outlook.com/
https://patchwork.ffmpeg.org/project/ffmpeg/list/?series=&submitter=&state=*&q=closed_captions&archive=both&delegate=
https://www.mail-archive.com/[email protected]/msg126211.html

diff --git a/fftools/ffprobe.c b/fftools/ffprobe.c
index 90e895bbf9..f5c6335a13 100644
--- a/fftools/ffprobe.c
+++ b/fftools/ffprobe.c
@@ -2655,9 +2655,9 @@  static int show_stream(WriterContext *w, AVFormatContext *fmt_ctx, int stream_id
         if (dec_ctx) {
             print_int("coded_width",  dec_ctx->coded_width);
             print_int("coded_height", dec_ctx->coded_height);
-            print_int("closed_captions", !!(dec_ctx->properties & FF_CODEC_PROPERTY_CLOSED_CAPTIONS));
-            print_int("film_grain", !!(dec_ctx->properties & FF_CODEC_PROPERTY_FILM_GRAIN));
         }
+        print_int("closed_captions", !!(par->properties & FF_CODEC_PROPERTY_CLOSED_CAPTIONS));
+        print_int("film_grain", !!(par->properties & FF_CODEC_PROPERTY_FILM_GRAIN));
         print_int("has_b_frames", par->video_delay);
         sar = av_guess_sample_aspect_ratio(fmt_ctx, stream, NULL);
         if (sar.num) {

My request to the ffmpeg-devel list to reconsider:
https://www.mail-archive.com/[email protected]/msg133559.html

MkvToolJsonSchema Failed to lookup ISO639 Language from IETF LanguageIetf

Error on file

16:04:08 [WRN] <11> MkvToolJsonSchema : Failed to lookup ISO639 Language from IETF LanguageIetf : "cpe" !-> "cpe"

https://www.loc.gov/standards/iso639-2/php/code_list.php

looking at cpe its a english language and the video file with cpe plays in english

PlexCleaner.json

{
  "$schema": "https://raw.githubusercontent.com/ptr727/PlexCleaner/develop/PlexCleaner.schema.json",
  "SchemaVersion": 3,
  "ToolsOptions": {
    "UseSystem": false,
    "RootPath": ".\\Tools\\",
    "RootRelative": true,
    "AutoUpdate": false
  },
  "ProcessOptions": {
    "KeepOriginalLanguage": true,
    "RemoveClosedCaptions": true,
    "SetIetfLanguageTags": true,
    "SetTrackFlags": true,
    "KeepExtensions": [
      ".partial~",
      ".nfo",
      ".jpg",
      ".srt",
      ".smi",
      ".ssa",
      ".ass",
      ".vtt",
      ".mp3"
    ],
    "ReMuxExtensions": [
      ".avi",
      ".mxf",
      ".m2p",
      ".ps",
      ".m2ts",
      ".mts",
      ".ts",
      ".tsv",
      ".vob",
      ".evo",
      ".3gp",
      ".3g2",
      ".f4v",
      ".flv",
      ".mp4",
      ".m4v",
      ".asf",
      ".wmv",
      ".dv",
      ".mov",
      ".qt",
      ".ogg",
      ".ogv",
      ".ogx",
      ".webm",
      ".rmvb",
      ".divx"
    ],
    "ReEncodeVideo": [
      {
        "Format": "mpeg2video"
      },
      {
        "Format": "vc1"
      },
      {
        "Format": "wmv3"
      },
      {
        "Format": "msrle"
      },
      {
        "Format": "rawvideo"
      },
      {
        "Format": "indeo5"
      },
      {
        "Format": "h264",
        "Profile": "Constrained Baseline@30"
      },
      {
        "Format": "mpeg4",
        "Codec": "dx50"
      },
      {
        "Format": "msmpeg4v2",
        "Codec": "mp42"
      },
      {
        "Format": "msmpeg4v3",
        "Codec": "div3"
      }
    ],
    "ReEncodeAudioFormats": [
      "flac",
      "mp2",
      "vorbis",
      "wmapro",
      "opus",
      "wmav2",
      "adpcm_ms",
      "pcm_u8",
      "pcm_s16le"
    ],
    "KeepLanguages": [
      "en",
      "cpe"
    ],
    "PreferredAudioFormats": [
      "truehd atmos",
      "truehd",
      "dts-hd master audio",
      "dts-hd high resolution audio",
      "dts",
      "e-ac-3",
      "ac-3"
    ],
    "DeleteEmptyFolders": true,
    "DeleteUnwantedExtensions": true,
    "ReMux": true,
    "DeInterlace": true,
    "ReEncode": true,
    "SetUnknownLanguage": true,
    "DefaultLanguage": "en",
    "RemoveUnwantedLanguageTracks": true,
    "RemoveDuplicateTracks": true,
    "RemoveTags": true,
    "UseSidecarFiles": true,
    "SidecarUpdateOnToolChange": false,
    "Verify": true,
    "RestoreFileTimestamp": false,
    "FileIgnoreList": []
  },
  "ConvertOptions": {
    "FfMpegOptions": {
      "Video": "h264_nvenc -crf 20 -preset medium",
      "Audio": "ac3",
      "Global": "-analyzeduration 2147483647 -probesize 2147483647 -hwaccel cuda -hwaccel_output_format cuda",
      "Output": "-max_muxing_queue_size 1024 -abort_on empty_output"
    },
    "HandBrakeOptions": {
      "Video": "nvenc_h264 --quality 20 --encoder-preset medium",
      "Audio": "copy --audio-fallback ac3"
    }
  },
  "VerifyOptions": {
    "AutoRepair": true,
    "DeleteInvalidFiles": false,
    "RegisterInvalidFiles": false,
    "MinimumDuration": 300,
    "VerifyDuration": 0,
    "IdetDuration": 0,
    "MaximumBitrate": 100000000,
    "MinimumFileAge": 0
  },
  "MonitorOptions": {
    "MonitorWaitTime": 60,
    "FileRetryWaitTime": 5,
    "FileRetryCount": 2
  }
}

I added cpe to the keep languages with english eng etc its a odd one because cpe is a english language but rather than rename it to en or eng it looks like its renaming it from cpe to cpe

Convert DIVX to H264 or just re-tag as DIVX as XVID

Convert DIVX to H264 or just re-tag as DIVX as XVID using e.g. cfourcc.

	bitrateInfo.Calculate(packetList,
	FfProbeInfo.Video.First().Id,
	FfProbeInfo.Audio.First().Id,
	Program.Config.VerifyOptions.MaximumBitrate / 8);

	// Re-encode the video if the format, codec, and profile values match
	// * will match anything, the number of filter entries must match
	// Use FFProbe attribute naming, and the `printmediainfo` command to get media info
	"ReEncodeVideoFormats": "mpeg2video,mpeg4,msmpeg4v3,msmpeg4v2,vc1,h264,wmv3",
	"ReEncodeVideoCodecs": ",dx50,div3,mp42,,,",
	"ReEncodeVideoProfiles": ",,,,,Constrained Baseline@30,",
	// Re-encode matching audio codecs
	// If the video format is not H264 or H265, video will automatically be converted to H264 to avoid audio sync issues
	// Use FFProbe attribute naming, and the `printmediainfo` command to get media info
	"ReEncodeAudioFormats": "flac,mp2,vorbis,wmapro,pcm_s16le,opus,wmav2",

ptr727 / plexcleaner Goto Github PK

plexcleaner's People

Contributors

Stargazers

Watchers

Forkers

plexcleaner's Issues

Is this a new issue that can be reproduced?

Which operating systems reproduce the issue?

Version information.

Steps to reproduce?

Commandline.

Relevant log output.

Settings file.

Log file.

Media file information.

Workaround

Is this a new issue that can be reproduced?

Which operating systems reproduce the issue?

Version information.

Steps to reproduce?

Commandline.

Relevant log output.

Settings file.

Log file.

Media file information.

Error on file

PlexCleaner.json

Recommend Projects

Recommend Topics

Recommend Org