vergilgao / docker-mdc Goto Github PK
View Code? Open in Web Editor NEWhttps://github.com/yoshiko2/Movie_Data_Capture 的 docker镜像，帮助你更优雅的管理硬盘中的大姐姐们。
License: GNU General Public License v3.0
docker-mdc's People
Contributors
Stargazers
Watchers
Forkers
squallnk aunsetre chanh0 547555909 anson338 zhende luoluoluo2019 oguoliang84cn hmilyfyj yellowei-dev gamedog2008 lostiv n1f2c3 feiniao6 wook2021 plhys dec880126 kkfuzi lihansunbai gzhuotao y921231 srsman jinzaizhichi congyoubing777 xxzj990 vandebiao zj19843210 xiaoyaodejian zjiuxin devilmaycry4 yinof cmz0228 zhoulijun89 wzhich kurtice garfieldyu manlongdan aiwatch silkl2g ximliu zhwilson1994 welcomefrank showerxu nanitool hadeschan1985 gpf0710 jimdev5277 mankezhou 549234993 mildc zindsia b1fly shukaizhe navyd romejiang xayocn asfn d68fbe50 553531284 gmy771810930 frosty5689 saukes benzking lockcp hanfish223 seven3s lzh3083 lwlxyy goldenhairs road-tech bombvillian li929752433 hzp1716 drixn0 summershrimp anguszh mz247 hoganchou carrysue duxphp slte findlayfeng miaomi9 zhu0823 jiang123574 iamjimmycheng2 chenui joey0217 zrnzrn50 karas17 iamjimmycheng xmfx11docker-mdc's Issues
日志出现：unsupported operand type(s) for /: 'str' and 'str'
如题请问这是什么问题
最新的版本开启不了，报错如下
延迟更新说明
最近主库更新了6.1.3，因为从6.x开始，主库引入了人脸识别导致二进制文件编译速度骤降，同时二进制文件的体积也逐渐膨胀，所以之前更新的编译成二进制的设计已经失去了意义。
我会找时间将镜像的构建方式改回使用源码运行，在主库做到能剥离人脸识别模块可以独立编译之前，都不会再尝试二进制编译了。
docker版本已经删除了吗，dockerhub上已经搜不到了。。
求解。。
对于有账号密码的socks5代理怎么填？
由于水平问题，只能创建带账号密码的代理，不知道这种代理怎么填？
【6.2.2】新的稳定版已发布，欢迎使用
此次更新幅度较大
- 更新至上游6.2.2版本
- 修复人脸识别未生效的问题
- 通过环境变量启动程序的方法已经废弃，程序将在启动时检测是否存在配置文件，如果不存在，将会在config映射目录下创建，并且退出。请修改配置文件后再次启动程序。Breaking Change!
- 环境变量PUID,PGID已经修改为UID GID Breaking Change!
- UMASK的默认值改为002 Breaking Change!
未来可能引入新的配置方式，在上游版本造成升级配置文件不兼容时可以自动生成新的配置
mgstage这个好像有点问题，原版的没有问题，但是搭建docker后挂削识别到mgstage这个网站后会提示错误
搜刮目录可以设置多个吗？
设置了两个目录，其中一个目录装载路径设置为/app/data1，搜刮出现错误，源文件也被删除了。
具体错误如下：
| 2022-01-02 01:12:23 | stdout | [+]All finished!!! |
|---|---|---|
| 2022-01-02 01:12:23 | stdout | [+]Used 53.33s |
| 2022-01-02 01:11:41 | stdout | [-]Move [/app/data1/gvh-256-C.mp4] to failed folder |
| 2022-01-02 01:11:41 | stdout | [-] can only concatenate str (not "int") to str |
| 2022-01-02 01:11:41 | stdout | [-] [/app/data1/gvh-256-C.mp4] ERROR: |
| 2022-01-02 01:11:41 | stdout | [+]Wrote! data/output/辻井ほのか,鈴木真夕/GVH-256/GVH-256-C.nfo |
| 2022-01-02 01:11:41 | stdout | [+]Image Cutted! data/output/辻井ほのか,鈴木真夕/GVH-256/GVH-256-C-poster.jpg |
| 2022-01-02 01:11:40 | stdout | [+]Image Downloaded! data/output/辻井ほのか,鈴木真夕/GVH-256/GVH-256-C-fanart.jpg |
| 2022-01-02 01:11:36 | stdout | [-]Connect retry 1/3 |
| 2022-01-02 01:11:30 | stdout | [!]Making Data for [/app/data1/gvh-256-C.mp4], the number is [gvh-256] |
| 2022-01-02 01:11:30 | stdout | [!] - 100.% [1/1] - |
| 2022-01-02 01:11:30 | stdout | [+]Find 1 movies |
| 2022-01-02 01:11:30 | stdout | [*]严禁在墙内宣传本项目 |
| 2022-01-02 01:11:30 | stdout | [*]====================================================== |
| 2022-01-02 01:11:30 | stdout | [*] 4.7.2 |
| 2022-01-02 01:11:30 | stdout | [*]================== AV Data Capture =================== |
lxml.etree.XMLSyntaxError: Opening and ending tag mismatch
**2022-02-20 03:11:02,stdout,[18] Failed to execute script 'Movie_Data_Capture' due to unhandled exception!
2022-02-20 03:11:02,stdout,"lxml.etree.XMLSyntaxError: Opening and ending tag mismatch: input line 6 and body, line 7, column 12
"**
2022-02-20 03:11:02,stdout," File "/root/.local/share/mdc/mapping_actor.xml", line 7
"
2022-02-20 03:11:02,stdout," File "src/lxml/parser.pxi", line 654, in lxml.etree._raiseParseError
"
2022-02-20 03:11:02,stdout," File "src/lxml/parser.pxi", line 725, in lxml.etree._handleParseResult
"
2022-02-20 03:11:02,stdout," File "src/lxml/parser.pxi", line 615, in lxml.etree._ParserContext._handleParseResultDoc
"
2022-02-20 03:11:02,stdout," File "src/lxml/parser.pxi", line 1177, in lxml.etree._BaseParser._parseDocFromFile
"
2022-02-20 03:11:02,stdout," File "src/lxml/parser.pxi", line 1805, in lxml.etree._parseDocFromFile
"
2022-02-20 03:11:02,stdout," File "src/lxml/parser.pxi", line 1901, in lxml.etree._parseDocumentFromURL
"
2022-02-20 03:11:02,stdout," File "src/lxml/parser.pxi", line 1875, in lxml.etree._parseDocument
"
2022-02-20 03:11:02,stdout," File "src/lxml/etree.pyx", line 3536, in lxml.etree.parse
"
2022-02-20 03:11:02,stdout," File "WebCrawler/init.py", line 44, in get_data_from_json
"
2022-02-20 03:11:02,stdout," File "core.py", line 609, in core_main
"
2022-02-20 03:11:02,stdout," File "Movie_Data_Capture.py", line 394, in create_data_and_move
"
2022-02-20 03:11:02,stdout," File "Movie_Data_Capture.py", line 557, in main
"
2022-02-20 03:11:02,stdout," File "Movie_Data_Capture.py", line 585, in
"
2022-02-20 03:11:02,stdout,Traceback (most recent call last):
2022-02-20 03:11:02,stdout,[!] [VVV-068] As Number making data for '/data/VVV-068-02.mp4'
2022-02-20 03:11:02,stdout,[!] - 5.55% [1/18] - 03:11:02
2022-02-20 03:11:02,stdout,[*]======================================================
2022-02-20 03:11:02,stdout,[+]Find 18 movies.
2022-02-20 03:11:02,stdout,"[+]Main Working mode ## 1: Scraping ## , multi_threading on, nfo_skip_days=30
"
2022-02-20 03:11:02,stdout,[+]Enable debug
2022-02-20 03:11:02,stdout,[+]Load Config file '/root/mdc.ini'.
2022-02-20 03:11:02,stdout,[+]Start at 2022-02-20 03:11:02
2022-02-20 03:11:02,stdout,[*]======================================================
2022-02-20 03:11:02,stdout,[*] - 严禁在墙内宣传本项目 -
2022-02-20 03:11:02,stdout,[*]======================================================
2022-02-20 03:11:02,stdout,[*] - x86_64 - Python-3.8.12
2022-02-20 03:11:02,stdout,[*] - Linux-4.4.180+-x86_64-with
2022-02-20 03:11:02,stdout,[*]======================================================
2022-02-20 03:11:02,stdout,[*] 6.0.1
2022-02-20 03:11:02,stdout,[*]================= Movie Data Capture =================
在群暉裡一開就掛掉
3.9.2 什麼也沒設定, 只映射了/jav/data
開著container, log 出現
found 0 movies
All finished
container 就掛掉了
但 /jav/data 是有文檔的
EDIT
原來已改做 /app/data
另外, 看來這個 docker 的設計就是完結時自動掛掉. 那就好像沒有用 docker 的必要, 還不如開個shell 來處理.
已经测试，可以了，谢谢大佬。
简单补充一下安装教程，给使用群晖docker的小白们：
1.根据大佬的教程，测试通过以后，打开docker在映像里面会多出一个下载好的新映像：vergilgao/avdc
2.双击这个新映像，进入安装界面，进入高级设置--卷--添加文件夹，选择“你放大姐姐影片的文件夹”，装载路径填上：/jav/data
3.其他都不用管，一直下一步，完成创建容器。
4.运行这个容器，如果你的文件夹里面有下载好的影片，就会归档了。具体可以在容器的日志里面查看。
最后，感谢大佬的辛苦付出，再次拜谢！！！
发现一个问题，会覆盖资源
如果一个片有多个文件，有一种命名方式是XXX-XXX.cd1.mp4 XXX-XXX.cd2.mp4
如果是这样的话，刮削后会重命名文件为XXX-XXX.mp4，然后cd2会覆盖掉cd1，文件夹中最后只剩一个视频文件
如果是XXX-XXX-cd1.mp4则不会有这个问题
一直报网络错误
代理填的是0，本地网络在路由器里设置过，可以正常访问github。
请问这是哪里设置有问题吗？
`[]================= Movie Data Capture =================
[] 6.0.2
[]======================================================
[] - Linux-4.4.180+-x86_64-with
[] - x86_64 - Python-3.8.12
[]======================================================
[] - 严禁在墙内宣传本项目 -
[]======================================================
[+]Start at 2022-04-02 14:29:10
[+]Load Config file '/config/mdc.ini'.
[+]Main Working mode ## 1: Scraping ## , multi_threading on, nfo_skip_days=30
[-]Connect retry 1/3
[-]Connect retry 1/3[-]Connect retry 2/3
[-]Connect retry 2/3[-]Connect retry 1/3
[-]Connect retry 3/3
[-]HTTPSConnectionPool(host='raw.githubusercontent.com', port=443): Max retries exceeded with url: /yoshiko2/Movie_Data_Capture/master/MappingTable/mapping_actor.xml (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f638e413790>: Failed to establish a new connection: [Errno 111] Connection refused'))
[-]Connect Failed! Please check your Proxy or Network!
[-]Connect retry 3/3
[-]HTTPSConnectionPool(host='raw.githubusercontent.com', port=443): Max retries exceeded with url: /yoshiko2/Movie_Data_Capture/master/MappingTable/mapping_info.xml (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f638e40b3a0>: Failed to establish a new connection: [Errno 111] Connection refused'))
[-]Connect Failed! Please check your Proxy or Network!
[-]Connect retry 2/3
[-]Connect retry 3/3
[-]HTTPSConnectionPool(host='raw.githubusercontent.com', port=443): Max retries exceeded with url: /yoshiko2/Movie_Data_Capture/master/MappingTable/c_number.json (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f638e401160>: Failed to establish a new connection: [Errno 111] Connection refused'))
[-]Connect Failed! Please check your Proxy or Network!`
UnRaid系统Docker模板
1.把my-AV_Data_Capture.xml.txt的后缀.txt去掉，改成.xml文件
2.把这个文件上传到 /boot/config/plugins/dockerMan/templates-user 目录下，也就是启动U盘的/config/plugins/dockerMan/templates-user 目录下
3.docker添加容器，选择AV_Data_Capture模板
my-AV_Data_Capture.xml.txt
注：刮预告片的开关没有用，这个得等作者适配。
遇到特定视频程序崩溃
问题背景
刮削到特定影片时，会出现Illegal instruction (core dumped)错误
- 已检查代理
- docker版本为最新版
- 已检查番号
多集影片处理提醒
大佬，你好，刮削成功。特来感谢。就是日志发现部分VR影片被删，提示信息
[+]Deleting empty folder /app/data/VR/****.mp4，视频文件，并非空的
查询原WIKI后得知
多集影片处理
建议使用视频合并合并为一个视频文件 可以把多集电影按照集数后缀命名为类似
ssni-xxx-cd1.mp4
ssni-xxx-cd2.mp4
abp-xxx-CD1.mp4
上述规则，只要含有-CDn./-cdn.类似命名规则，即可使用分集功能
特来提醒其他用户，不过我VR设备都卖掉了，删就删了吧。损失不大（强颜欢笑）
好兄弟，群晖的文件夹现在叫啥啊？
/app/data一下子就结束了扫不出文件
无法刮削硬链接
问题描述
使用源代码6.2.2-rc2版，发现ini文件中，有可以设置的开关
; 0: 不刮削硬链接文件 1: 刮削硬链接文件
scan_hardlink=1而docker版的ini中则没有，在实际运行时，出现了不识别硬链接的问题
请问一下 docker怎么把配置文件映射出来了
我用的群晖docker
config.ini的装载地址是什么啊
我在docker -编辑-环境 里配置 好像有问题
不知道什么情况
关于刮预告片的环境变量为什么没有？
我需要一个刮预告片的开关
值：TRAILER
ini 文件字段
; 预告片
[trailer]
switch=0
【发帖前必看】本仓库是 Movie Data Capture 的docker版本，程序问题及建议请去上游反馈
上游issue : https://github.com/yoshiko2/Movie_Data_Capture/issues
上游讨论区 : https://github.com/yoshiko2/Movie_Data_Capture/discussions
如果对于docker使用有任何疑问、建议，可以去上游讨论区发帖。
代理设置问题
背景
本地服务器已部署clash，已经测试可以使用http_proxy与https_proxy进行google的下载
root@openmediavault:~# wget www.google.com
--2022-03-24 22:15:44-- http://www.google.com/
正在连接 127.0.0.1:7890... 已连接。
已发出 Proxy 请求，正在等待回应... 302 Found
位置：http://www.google.com.hk/url?sa=p&hl=zh-CN&pref=hkredirect&pval=yes&q=http://www.google.com.hk/&ust=1648131374613142&usg=AOvVaw2kJUmLBg5Uf9W9wxigWGzf [跟随至新的 URL]
--2022-03-24 22:15:44-- http://www.google.com.hk/url?sa=p&hl=zh-CN&pref=hkredirect&pval=yes&q=http://www.google.com.hk/&ust=1648131374613142&usg=AOvVaw2kJUmLBg5Uf9W9wxigWGzf
再次使用存在的到 127.0.0.1:7890 的连接。
已发出 Proxy 请求，正在等待回应... 302 Found
位置：http://www.google.com.hk/ [跟随至新的 URL]
--2022-03-24 22:15:44-- http://www.google.com.hk/
再次使用存在的到 127.0.0.1:7890 的连接。
已发出 Proxy 请求，正在等待回应... 200 OK
长度：未指定 [text/html]
正在保存至: “index.html.2”
index.html.2 [ <=> ] 13.61K --.-KB/s 用时 0.001s
2022-03-24 22:15:45 (25.3 MB/s) - “index.html.2” 已保存 [13932]
docker错误日志
使用命令为：docker run --rm -it --name mdc_test -v ${PWD}/test:/data -e PUID=1000 -e PGID=1000 -e USE_PROXY=1 -e PROXY_TYPE="http" -e PROXY_URI="127.0.0.1:7890" vergilgao/mdc:latest
日志如下：
root@openmediavault:/srv/dev-disk-by-uuid-2ee14b13-898d-4375-9a5f-6309fcd3ca27/resources# docker run --rm -it --name mdc_test -v ${PWD}/test:/data -e PUID=1000 -e PGID=1000 -e USE_PROXY=1 -e PROXY_TYPE="http" -e PROXY_URI="127.0.0.1:7890" vergilgao/mdc:latest
Setup Timezone to Asia/Shanghai
Checking if UID: 1000 matches user
usermod: no changes
Checking if GID: 1000 matches user
usermod: no changes
Setting umask to 000
Checking if config file exist
Starting...
[*]================= Movie Data Capture =================
[*] 6.0.2
[*]======================================================
[*] - Linux-5.10.0-0.bpo.8-amd64-x86_64-with
[*] - x86_64 - Python-3.8.12
[*]======================================================
[*] - 严禁在墙内宣传本项目 -
[*]======================================================
[+]Start at 2022-03-24 22:13:18
[+]Load Config file '/config/mdc.ini'.
[+]Main Working mode ## 1: Scraping ## , multi_threading on, nfo_skip_days=30
[-]Connect retry 1/3
[-]Connect retry 1/3
[-]Connect retry 2/3
[-]Connect retry 1/3
[-]Connect retry 2/3
[-]Connect retry 3/3
[-]HTTPSConnectionPool(host='raw.githubusercontent.com', port=443): Max retries exceeded with url: /yoshiko2/Movie_Data_Capture/master/MappingTable/mapping_info.xml (Caused by ProxyError('Cannot connect to proxy.', NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f7b44664370>: Failed to establish a new connection: [Errno 111] Connection refused')))
[-]Connect Failed! Please check your Proxy or Network!
[-]Connect retry 3/3
[-]HTTPSConnectionPool(host='raw.githubusercontent.com', port=443): Max retries exceeded with url: /yoshiko2/Movie_Data_Capture/master/MappingTable/c_number.json (Caused by ProxyError('Cannot connect to proxy.', NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f7b446e6b20>: Failed to establish a new connection: [Errno 111] Connection refused')))
[-]Connect Failed! Please check your Proxy or Network!
[-]Connect retry 2/3
[-]Connect retry 3/3
[-]HTTPSConnectionPool(host='raw.githubusercontent.com', port=443): Max retries exceeded with url: /yoshiko2/Movie_Data_Capture/master/MappingTable/mapping_actor.xml (Caused by ProxyError('Cannot connect to proxy.', NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f7b4468e5b0>: Failed to establish a new connection: [Errno 111] Connection refused')))
[-]Connect Failed! Please check your Proxy or Network!
Traceback (most recent call last):
File "Movie_Data_Capture.py", line 618, in <module>
File "Movie_Data_Capture.py", line 542, in main
File "ADC_function.py", line 556, in parallel_download_files
File "concurrent/futures/_base.py", line 619, in result_iterator
File "concurrent/futures/_base.py", line 444, in result
File "concurrent/futures/_base.py", line 389, in __get_result
File "concurrent/futures/thread.py", line 57, in run
File "ADC_function.py", line 528, in download_one_file
File "ADC_function.py", line 523, in _inner
File "ADC_function.py", line 70, in get_html
Exception: Connect Failed
[16] Failed to execute script 'Movie_Data_Capture' due to unhandled exception!
怀疑是proxy没有正确在urllib3中配置
DockerFile里的wget github很慢如何解决》？
我看了下，在dockerfile里是直接去原项目拿项目，但是因为墙原因访问很慢，下载只有40kB左右。我试了在运行命令时设置export代理，但是还是没用。请问有什么好的方法吗？
rclone挂载google drive，刮削失败后无法移动到failed目录 & 以及超过200部影片容易触发内存溢出问题
群晖新版需要设置puid pgid
用ssh连接群晖 输入id即可查询
我的puid 1026 pgid 101 别用100
可以刮削了,但感觉还是有些bug 例如排除目录不咋管用
视频识别，并整理好但是没有下载封面和nfo文件
视频识别，并整理好但是没有下载封面和nfo文件
[]================= Movie Data Capture =================
[] 6.2.2
[]======================================================
[] - Linux-3.10.108-x86_64-with
[] - x86_64 - Python-3.9.13
[]======================================================
[] - 严禁在墙内宣传本项目 -
[]======================================================
[+]Start at 2022-05-28 17:08:09
[+]Load Config file '/config/mdc.ini'.
[+]Main Working mode ## 2: Organizing ## , nfo_skip_days=30
[+]Find 27 movies.
[]======================================================
[!] - 3.70% [1/27] - 17:08:12
[!] [BUR-435A] As Number Processing for '/data/JAV/BUR-435A.mkv'
[-]get_html_by_scraper() failed. SOCKSHTTPSConnectionPool(host='javdb38.com', port=443): Max retries exceeded with url: /search?q=BUR-435A&f=all (Caused by ResponseError('too many 503 error responses'))
[-]Movie Number or Title not found!
[]======================================================
[!] - 7.40% [2/27] - 17:09:28
[!] [BUR-435B] As Number Processing for '/data/JAV/BUR-435B.mkv'
[-]get_html_by_scraper() failed. SOCKSHTTPSConnectionPool(host='javdb38.com', port=443): Max retries exceeded with url: /search?q=BUR-435B&f=all (Caused by ResponseError('too many 503 error responses'))
[-]Movie Number or Title not found!
[]======================================================
[!] - 11.1% [3/27] - 17:10:43
[!] [BUR-435C] As Number Processing for '/data/JAV/BUR-435C.mkv'
[-]get_html_by_scraper() failed. SOCKSHTTPSConnectionPool(host='javdb.com', port=443): Max retries exceeded with url: /search?q=BUR-435C&f=all (Caused by ResponseError('too many 503 error responses'))
[-]Movie Number or Title not found!
[]======================================================
[!] - 14.8% [4/27] - 17:11:57
[!] [FC2-2497913] As Number Processing for '/data/JAV/FC2-PPV-2497913.mp4'
[-]get_html_by_scraper() failed. SOCKSHTTPSConnectionPool(host='javdb38.com', port=443): Max retries exceeded with url: /search?q=FC2-2497913&f=all (Caused by ResponseError('too many 503 error responses'))
[-]Movie Number or Title not found!
[]======================================================
[!] - 18.5% [5/27] - 17:13:37
[!] [FC2-2497913] As Number Processing for '/data/JAV/FC2-PPV-2497913_2.mp4'
[-]get_html_by_scraper() failed. SOCKSHTTPSConnectionPool(host='javdb40.com', port=443): Max retries exceeded with url: /search?q=FC2-2497913&f=all (Caused by ResponseError('too many 503 error responses'))
[-]Movie Number or Title not found!
[]======================================================
[!] - 22.2% [6/27] - 17:15:10
[!] [FLNS-113] As Number Processing for '/data/JAV/FLNS-113.mp4'
[-]get_html_by_scraper() failed. SOCKSHTTPSConnectionPool(host='javdb.com', port=443): Max retries exceeded with url: /search?q=FLNS-113&f=all (Caused by ResponseError('too many 503 error responses'))
[-]Movie Number or Title not found!
[]======================================================
[!] - 25.9% [7/27] - 17:16:28
[!] [FLNS-114] As Number Processing for '/data/JAV/FLNS-114.mp4'
[-]get_html_by_scraper() failed. SOCKSHTTPSConnectionPool(host='javdb.com', port=443): Max retries exceeded with url: /search?q=FLNS-114&f=all (Caused by ResponseError('too many 503 error responses'))
[-]Movie Number or Title not found!
[]======================================================
[!] - 29.6% [8/27] - 17:17:43
[!] [STARS-086] As Number Processing for '/data/JAV/STARS-086.mp4'
[+]Find movie [STARS-086] metadata on website 'javbus'
[-] [/data/JAV/STARS-086.mp4] ERROR:
[-] File Exists on destination path, we will never overwriting.
[!] - 33.3% [9/27] - 17:18:02
[!] [GETCHU-4042103] As Number Processing for '/data/JAV/GETCHU-4042103/GETCHU-4042103.mp4'
[+]Find movie [GETCHU-4042103] metadata on website 'getchu'
[]======================================================
[!] - 37.0% [10/27] - 17:18:27
[!] [GETCHU-911772] As Number Processing for '/data/JAV/KADOKAWA/GETCHU-911772/GETCHU-911772.mp4'
[-]get_html_by_scraper() failed. SOCKSHTTPSConnectionPool(host='javdb38.com', port=443): Max retries exceeded with url: /search?q=GETCHU-911772&f=all (Caused by ResponseError('too many 503 error responses'))
[-]Movie Number or Title not found!
[]======================================================
[!] - 40.7% [11/27] - 17:19:36
[!] [SIRO-4823] As Number Processing for '/data/JAV/SIRO-4823/[email protected]'
[+]Find movie [SIRO-4823] metadata on website 'mgstage'
[]======================================================
[!] - 44.4% [12/27] - 17:19:50
[!] [FC2-2552104] As Number Processing for '/data/JAV/deruデるking/FC2-2552104/FC2-2552104.mp4'
[+]Find movie [FC2-2552104] metadata on website 'fc2'
[]======================================================
[!] - 48.1% [13/27] - 17:20:27
[!] [zzpp01', 'com@mkck306b] As Number Processing for '/data/JAV/zzpp01.com@mkck306b/[email protected]'
[-]get_html_by_scraper() failed. SOCKSHTTPSConnectionPool(host='javdb.com', port=443): Max retries exceeded with url: /search?q=ZZPP01',%20'COM@MKCK306B&f=all (Caused by ResponseError('too many 503 error responses'))
[-]Movie Number or Title not found!
[]======================================================
[!] - 51.8% [14/27] - 17:21:44
[!] [APAA-382] As Number Processing for '/data/JAV/ひなた澪/APAA-382/APAA-382.mp4'
[+]Find movie [APAA-382] metadata on website 'javbus'
[]======================================================
[!] - 55.5% [15/27] - 17:22:08
[!] [GETCHU-984478] As Number Processing for '/data/JAV/キングレコード/GETCHU-984478/GETCHU-984478.mp4'
[-]get_html_by_scraper() failed. SOCKSHTTPSConnectionPool(host='javdb39.com', port=443): Max retries exceeded with url: /search?q=GETCHU-984478&f=all (Caused by ResponseError('too many 503 error responses'))
[-]Movie Number or Title not found!
[]======================================================
[!] - 59.2% [16/27] - 17:23:16
[!] [GETCHU-677570] As Number Processing for '/data/JAV/バンダイビジュアル/GETCHU-677570/GETCHU-677570.mp4'
[-]get_html_by_scraper() failed. SOCKSHTTPSConnectionPool(host='javdb.com', port=443): Max retries exceeded with url: /search?q=GETCHU-677570&f=all (Caused by ResponseError('too many 503 error responses'))
[-]Movie Number or Title not found!
[]======================================================
[!] - 62.9% [17/27] - 17:24:28
[!] [FSDSS-407] As Number Processing for '/data/JAV/夏木りん/FSDSS-407/FSDSS-407.mp4'
[+]Find movie [FSDSS-407] metadata on website 'javbus'
[]======================================================
[!] - 66.6% [18/27] - 17:24:51
[!] [STARS-576] As Number Processing for '/data/JAV/工藤ゆら/STARS-576/STARS-576.mp4'
[+]Find movie [STARS-576] metadata on website 'javbus'
[]======================================================
[!] - 70.3% [19/27] - 17:25:23
[!] [FSDSS-416] As Number Processing for '/data/JAV/時田亜美/FSDSS-416/FSDSS-416.mp4'
[+]Find movie [FSDSS-416] metadata on website 'javbus'
[]======================================================
[!] - 74.0% [20/27] - 17:25:46
[!] [FC2-2714057] As Number Processing for '/data/JAV/暗黒王子/FC2-2714057/FC2-2714057.mp4'
[+]Find movie [FC2-2714057] metadata on website 'fc2'
[]======================================================
[!] - 77.7% [21/27] - 17:26:21
[!] [STARS-562] As Number Processing for '/data/JAV/月乃ひな/STARS-562/STARS-562.mp4'
[+]Find movie [STARS-562] metadata on website 'javbus'
[]======================================================
[!] - 81.4% [22/27] - 17:26:44
[!] [PKPD-188] As Number Processing for '/data/JAV/根本佳澄/PKPD-188/PKPD-188.mp4'
[+]Find movie [PKPD-188] metadata on website 'javbus'
[]======================================================
[!] - 85.1% [23/27] - 17:27:08
[!] [KBI-073] As Number Processing for '/data/JAV/桂木凛/KBI-073/KBI-073-C.mp4'
[+]Find movie [KBI-073] metadata on website 'javbus'
[-] [/data/JAV/桂木凛/KBI-073/KBI-073-C.mp4] ERROR:
[-] [Errno 2] No such file or directory: 'JAV_output/桂木凛/KBI-073/KBI-073-C-thumb.jpg'
[!] - 88.8% [24/27] - 17:27:30
[!] [KBI-076] As Number Processing for '/data/JAV/桂木凛/KBI-076/KBI-076.mp4'
[+]Find movie [KBI-076] metadata on website 'javbus'
[]======================================================
[!] - 92.5% [25/27] - 17:27:48
[!] [MEYD-033] As Number Processing for '/data/JAV/森沢かな（飯岡かなこ）/MEYD-033/MEYD-033-流出.mp4'
[+]Find movie [MEYD-033] metadata on website 'javbus'
[-] [/data/JAV/森沢かな（飯岡かなこ）/MEYD-033/MEYD-033-流出.mp4] ERROR:
[-] [Errno 2] No such file or directory: 'JAV_output/森沢かな（飯岡かなこ）/MEYD-033/MEYD-033-流出-thumb.jpg'
[!] - 96.2% [26/27] - 17:28:15
[!] [DTT-093] As Number Processing for '/data/JAV/真木今日子/DTT-093/DTT-093.mp4'
[+]Find movie [DTT-093] metadata on website 'javbus'
[]======================================================
[!] - 100.% [27/27] - 17:28:35
[!] [FSDSS-448] As Number Processing for '/data/JAV/逢月ひまり/FSDSS-448/FSDSS-448.mp4'
[+]Find movie [FSDSS-448] metadata on website 'javbus'
[*]======================================================
[+]Deleting empty folder /data/JAV/GETCHU-4042103
[+]Deleting empty folder /data/JAV/SIRO-4823
[+]Deleting empty folder /data/JAV/deruデるking/FC2-2552104
[+]Deleting empty folder /data/JAV/deruデるking
[+]Deleting empty folder /data/JAV/ひなた澪/APAA-382
[+]Deleting empty folder /data/JAV/ひなた澪
[+]Deleting empty folder /data/JAV/夏木りん/FSDSS-407
[+]Deleting empty folder /data/JAV/夏木りん
[+]Deleting empty folder /data/JAV/工藤ゆら/STARS-576
[+]Deleting empty folder /data/JAV/工藤ゆら
[+]Deleting empty folder /data/JAV/時田亜美/FSDSS-416
[+]Deleting empty folder /data/JAV/時田亜美
[+]Deleting empty folder /data/JAV/暗黒王子/FC2-2714057
[+]Deleting empty folder /data/JAV/暗黒王子
[+]Deleting empty folder /data/JAV/月乃ひな/STARS-562
[+]Deleting empty folder /data/JAV/月乃ひな
[+]Deleting empty folder /data/JAV/根本佳澄/PKPD-188
[+]Deleting empty folder /data/JAV/根本佳澄
[+]Deleting empty folder /data/JAV/桂木凛/KBI-073
[+]Deleting empty folder /data/JAV/桂木凛/KBI-076
[+]Deleting empty folder /data/JAV/桂木凛
[+]Deleting empty folder /data/JAV/森沢かな（飯岡かなこ）/MEYD-033
[+]Deleting empty folder /data/JAV/森沢かな（飯岡かなこ）
[+]Deleting empty folder /data/JAV/真木今日子/DTT-093
[+]Deleting empty folder /data/JAV/真木今日子
[+]Deleting empty folder /data/JAV/逢月ひまり/FSDSS-448
[+]Deleting empty folder /data/JAV/逢月ひまり
[+]Deleting empty folder /data/failed
[+]Running time 0:21:14.506 End at 2022-05-28 17:29:24
[+]All finished!!!
影片识别错误后被删除
Making Data for [/app/data/IPX-613C.mp4], the number is [IPX-613C]
Wrote! data/output/東梨央奈/ADZ333/ADZ333.nfo
Deleting empty folder /app/data/@eaDir/IPX-613C.mp4
1.刮削识别失败，613-333，然后这个文件播放也不是613C的视频，而是之前被程序删掉的一个VR视频
2.原文件被删，无法找回。
群晖运行完毕后 docker自动关闭了？
群晖运行完毕后 docker自动关闭了？
兄弟，能加上封面中字的水印吗
这个功能很精神，希望能加上，感谢你的无私奉献
代理问题
配置代理后：
- USE_PROXY=1 - PROXY_TYPE="http" - PROXY_URI="192.168.2.2:7890"
提示：
Failed to parse: https://"192.168.2.2:7890"
SSL 错误？
| [-]HTTPSConnectionPool(host='raw.githubusercontent.com', port=443): Max retries exceeded with url: /yoshiko2/Movie_Data_Capture/master/MappingTable/c_number.json (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1131)'))) | stdout |
|---|
大佬能抽空更新下4.7.2版本吗，急需一个新feature
本体4.7.2新增加的“配置文件删除空文件夹参数”，辛苦大佬抽空更新下
docker test报错
错误简介
已按照readme完成docker部署，进行测试
日志
root@openmediavault:/srv/dev-disk-by-uuid-2ee14b13-898d-4375-9a5f-6309fcd3ca27/resources# docker run --rm --name mdc_test -it -v ${PWD}/test:/data -e PUID=$(stat -c %u test) -e PGID=$(stat -c %g test) vergilgao/mdc
Setup Timezone to Asia/Shanghai
Checking if UID: 0 matches user
usermod: UID '0' already exists
Checking if GID: 0 matches user
Setting umask to 000
Checking if config file exist
Starting...
[*]================= Movie Data Capture =================
[*] 6.0.2
[*]======================================================
[*] - Linux-5.10.0-0.bpo.8-amd64-x86_64-with
[*] - x86_64 - Python-3.8.12
[*]======================================================
[*] - 严禁在墙内宣传本项目 -
[*]======================================================
[+]Start at 2022-03-23 20:23:00
[+]Load Config file '/config/mdc.ini'.
[+]Main Working mode ## 1: Scraping ## , multi_threading on, nfo_skip_days=30
Traceback (most recent call last):
File "pathlib.py", line 1288, in mkdir
FileNotFoundError: [Errno 2] No such file or directory: '/config/.local/share/mdc'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "pathlib.py", line 1288, in mkdir
FileNotFoundError: [Errno 2] No such file or directory: '/config/.local/share'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "Movie_Data_Capture.py", line 618, in <module>
File "Movie_Data_Capture.py", line 542, in main
File "ADC_function.py", line 549, in parallel_download_files
File "pathlib.py", line 1292, in mkdir
File "pathlib.py", line 1292, in mkdir
File "pathlib.py", line 1288, in mkdir
PermissionError: [Errno 13] Permission denied: '/config/.local'
[18] Failed to execute script 'Movie_Data_Capture' due to unhandled exception!```好像无法自定义"NAMING_RULE"?
尝试了自定义“NAMING_RULE”但好像无效：
user@test:~$ sudo docker run -it --rm -v ${PWD}/test:/app/data -e NAMING_RULE="title" --name=avdc_test vergilgao/avdc:3.9.2
[*]================== AV Data Capture ===================
[*] Version 3.9.2
[*]======================================================
[+]Find 1 movies
[!] - 100.% [1/1] -
[!]Making Data for [./data/MIFD-046.mp4], the number is [MIFD-046]
[+]Image Downloaded! data/output/御坂りあ/MIFD-046/MIFD-046-fanart.jpg
[+]Image Cutted! data/output/御坂りあ/MIFD-046/MIFD-046-poster.jpg
[+]Wrote! data/output/御坂りあ/MIFD-046/MIFD-046.nfo
[*]======================================================
[+]All finished!!!
user@test:~$ ls test/output/御坂りあ/MIFD-046/
MIFD-046-fanart.jpg MIFD-046.mp4 MIFD-046.nfo MIFD-046-poster.jpg MIFD-046-thumb.jpg
尝试了Wiki的其他命名参数好像也是无效，但是自定义“LOCATION_RULE”好像是可以的，另外尝试了Windows的GUI版本也可以自定义“NAMING_RULE”，还是我哪里搞错了吗？
最近搜刮的封面有问题
最近搜刮的封面怎么都是乱七八糟的画面，没有居中的人像。看了搜刮的几个文件，大小都一样，以前好像是封面的文件要小一些。
请问
0和1哪个是开哪个是关啊？谢谢
折腾5小时左右，代理设置始终不成功
环境：CentOS-8.3.211（64），Docker version 20.10.6, build 370c289
宿主机已经设置了sock5代理（端口是1280），宿主机平时通过privoxy将HTTP协议流量转发到本地sock5。
但是使用docker-avdc容器，将代理指向宿主机的1280端口，提示代理错误。
而宿主机访问google，javbus都是正常的.
下面是我的run参数
docker run --rm -it \
--name avdc_test \
-v /test:/app/data \
-e USE_PROXY=1 \
-e PROXY_TYPE="socks5" \
-e PROXY_URI="127.0.0.1:1280" \
vergilgao/avdc:latest首先感谢大佬写的工具，我这边好像有个问题就是不能整理字幕，不知道是源代码的问题还是配置的问题
威联通NAS DOCKER无法正常更新。4.6.3版本，如何手动更新到4.6.5版本
[*]================== AV Data Capture ===================
[*] 4.6.3
[*]======================================================
[+]Find 1 movies
[!] - 100.% [1/1] -
[!]Making Data for [/app/data/stars-371.mp4], the number is [stars-371]
[-]Connect retry 1/3
[-]Connect retry 1/3
[-]Connect retry 1/3
[-]Connect retry 1/3
[-]Connect retry 1/3
[-]Connect retry 1/3
[-]Connect retry 1/3
[-]Connect retry 1/3
[-]Connect retry 1/3
[-]Connect retry 1/3
[-]Connect retry 1/3
[-]Connect retry 2/3
[-]Connect retry 2/3
[-]Connect retry 2/3
[-]Connect retry 2/3
[-]Connect retry 2/3
[-]Connect retry 2/3
[-]Connect retry 2/3
[-]Connect retry 2/3
[-]Connect retry 2/3
[-]Connect retry 2/3
[-]Connect retry 2/3
[-]Connect retry 3/3
[-]Connect Failed! Please check your Proxy or Network!
[-]HTTPSConnectionPool(host='www.jav321.com', port=443): Max retries exceeded with url: /search (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fabc04ad250>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution'))
[-]Connect retry 3/3
[-]Connect Failed! Please check your Proxy or Network!
[-]HTTPSConnectionPool(host='javdb8.com', port=443): Max retries exceeded with url: /search?q=STARS-371&f=all (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fabc04f27f0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution'))
can only parse strings
[-]Connect retry 3/3
[-]Connect Failed! Please check your Proxy or Network!
[-]HTTPSConnectionPool(host='cn.airav.wiki', port=443): Max retries exceeded with url: /video/stars-371 (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fabc042a130>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution'))
[-]Connect retry 3/3
[-]Connect Failed! Please check your Proxy or Network!
[-]HTTPSConnectionPool(host='www.mgstage.com', port=443): Max retries exceeded with url: /product/product_detail/STARS-371/ (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fabc0495340>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution'))
[-]Connect retry 3/3
[-]Connect Failed! Please check your Proxy or Network!
[-]HTTPSConnectionPool(host='tellme.pw', port=443): Max retries exceeded with url: /avsox (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fabc04c4c40>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution'))
[-]Connect retry 3/3
[-]Connect Failed! Please check your Proxy or Network!
[-]HTTPSConnectionPool(host='www.caribbeancom.com', port=443): Max retries exceeded with url: /moviepages/stars-371/index.html (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fabc04c40a0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution'))
[-]Connect retry 3/3
[-]Connect Failed! Please check your Proxy or Network!
[-]HTTPSConnectionPool(host='adult.contents.fc2.com', port=443): Max retries exceeded with url: /article/stars-371/ (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fabc04e3430>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution'))
Error Response
，在NAS上已经安装好Docker，连接SSH后，sudo -i，输入了密码，然后按照说明文档进行测试，输入docker pull vergilgao/avdc:3.9.2之后，反馈了Error response from daemon: Get https://registry-1.docker.io/v2/: EOF，请问如何解决？
刚刚试了一下成功了，请问下一次需要整理的时候要输入什么命令让这个程序运行？
能不能增加代理功能
因为很多网站被墙了，不加代理没法用啊
关于本仓库下一步的发展规划
因为平时工作比较忙，所以对于本仓库的更新也一直很不上心，目前本仓库提供的avdc版本仍停留在3.9.2，最近可能会同步更新到上游4.2.2
因为我个人使用avdc时，主要还是手动刮削整理，所以当前avdc源程序提供的功能已经满足了我的使用需求，所以对于很多人想要的自动刮削我并没有开发的动力（其实仿照iyuu的docker那样做一个cron也可以，但是我认为这不应该是docker要做的，而是需要用户手动在宿主系统里写cron来做），docker版本最重要的功能应该是解决程序运行环境的问题，毕竟glibc版本更新对于小白用户来说是一个非常危险的操作。
也许明年我会照着上游写一个自动编译二进制来发布的功能，降低镜像的体积。但是这个优先度还是很低，因为本镜像的体积相对于大姐姐的体积而言，并不算大。
对于用户来说，我建议使用本仓库程序的一个思路是：
pt或者bt下载完成->自动运行脚本硬链接到avdc文件夹，cron定时刮削并将output文件夹内的文件硬链接到jellyfin、plex等媒体库。
更新到4.6 后封面变成双页面了，没有之前单页面好，有什么办法调整吗
更新到4.6 后封面变成双页面了，没有之前单页面好，缩略图看不清有什么办法调整吗？
监控文件变化功能
大佬之前的TODO List中不是有监控文件变化这个项目的嘛，怎么现在又取消了，没有这个功能nas上还是很不好用啊，目前群晖我是用的定时启动
能否支持PUID和PGID环境变量，用某个用户去运行docker
Unraid上的samba用户不是root，但是docker默认是用root账号运行，导致刮削后的文件是root权限，不能使用samba用户去管理，只能使用SSH管理。
能否指定PUID和PGID，让docker使用samba那个账号去运行，方便使用samba用户管理？
提个教程建议
映射的data和config最好再同一个文件夹，至少群辉是这样才能运行，而且原版软件就是配置文件和运行文件在媒体库才行。我看前面也有兄弟用的是别的什么设备也是这个问题，所以介绍里最好加上这条吧
location_rule参数无法建立多级目录
日志：
[!]Making Data for [./data/VEMA-155.mp4], the number is [VEMA-155]
[-] [./data/VEMA-155.mp4] ERROR:
[-] invalid syntax (, line 1)
[-]Move [./data/VEMA-155.mp4] to failed folder
[+]All finished!!!
我是这么配置的：
docker run --rm -it
--name avdc_test
-v ${PWD}:/app/data
-e USE_PROXY=0
-e RETRY=2
-e TIMEOUT=5
-e PRIORITY_WEBSITE=javbus
-e LOCATION_RULE=actor+'/'+title
-e NAMING_RULE=number
vergilgao/avdc:latest
新构建的6.0.2版本刮削图片不会保存cdx.jpg了
以前有分卷的片子，每个分卷都会保存
xxxx-xxx-cdx.fanart.jpg
xxxx-xxx-cdx.thumb.jpg
xxxx-xxx-cdx.poster.jpg三个图片，
现在不管有多少分卷，都只保存
xxxx-xxx.fanart.jpg
xxxx-xxx.thumb.jpg
xxxx-xxx.poster.jpg
请问这是bug还是规则改了？附上新旧版本两张图。
搜刮影片大部分都指向ADZ355，仓库那边已经改了，docker能不能改呢？
损失了好多大姐姐
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.