Giter VIP home page Giter VIP logo

dmm-scraper's Introduction

dmm-scraper

Go Report Card Downloads Release

特性

  • 批量抓取资料和封面的影片刮削器
  • 以日站原始内容为主(DMM,MGStage,FC2等)
  • 优化了生成的 nfo 部分标签以更好适配 emby
  • 可查询部分已下架影片(仅限FC2,Gyutto)

基本用法

  • 移动程序到影片目录执行,程序会扫描查询同目录影片并生成影片的nfo文件以及封面
  • (新)封面可以配置是否剪裁
  • 避免查询失败,建议配置config.toml中的代理地址
## 范例
[output]
# 支持输出项目 {year} {maker} {num} {actor}
# actor按第一位输出
path = 'output/{year}/{num}'
# 是否要切封面
needCut = true

[proxy]
## proxy [socks5://][127.0.0.1:]<1-65535>; 代理
## 协议:socks4, socks5, http, https
socket = "socks5://127.0.0.1:7891"
## 设置是否启用代理
enable = true

[DMMApi]
# 有 DMM affiliate 可以填,加快查询速度
apiId = ""
affiliateId = ""

支持来源

  • 通用番号(xxx-000)依次查询 Fanza、DMM
  • 支持 DMM 自有影片特征番号(xxx00000)
  • 支持 MGStage 部分特征番号(000xxx-000)
  • 支持 FC2 特征番号(fc2-000000/fc2-ppv-000000)
  • 支持 Heyzo 特征番号
  • 支持 VR 特征番号查询、大部分动画番号(GLOD,ACRN,JDXA)
  • 在 Gyutto 上架的自制影片(item000000)

影片文件

  • 会一并移动并重命名
  • 有需要请注意备份

NFO files 生成

Changelog

  • 15 Dec 2021 (v1.4.0) : 增加直接从 dmmapi 刮削的配置(需要开通 dmm affiliate)
  • 20 Oct 2021 (v1.3.5) : 支持 FanzaVR 刮削器
  • 21 Sep 2021 (v1.3.4) : 修复多个分片重命名覆盖问题
  • 5 Aug 2021 (v1.3.3) : 修复标题番号缺失问题;重构 Scraper 包;改良输出日志
  • 2 Aug 2021 (v1.3.1) : 修复 MGStage 查询失败问题;替换(logrus=>golog)
  • 30 Jul 2021 (v1.3.0) : 修复切封面方向;由于识别日文不稳定不再支持 Sx Syndrome 刮削
  • 5 Mar 2021 (v1.2.1) : 重构包;替换多个基础库(grab=>req, cutter=>imaging)
  • 7 Aug 2020 (v1.1.0) : 标题格式正规化为大写番号,便于 emby 搜索;提高 DMM 多个搜索结果时正确率
  • 14 Jul 2020 (v1.0.1) : 修复 DMM 查询失败的问题(需要年龄确认)
  • 28 May 2020 (v1.0.0) : 增加 Sx Syndrome\Sx Friend 的刮削器;可以自定义生成路径;第一个稳定版本
  • 3 Apr 2020 (v0.9.3) : 开始使用配置文件替换传参
  • 18 Mar 2020 (v0.9.2) : 支持 xxx00000 特征
  • 16 Mar 2020 (v0.9.1) : 修复获取多个演员的bug
  • 10 Mar 2020 (v0.9.0) : 增加 DMM 的搜索类型 digital/videoa
  • 14 Feb 2020 (v0.8.1) : 修复解析发片日期的bug
  • 17 Jan 2020 (v0.8.0) : 增加 Heyzo 刮削器

dmm-scraper's People

Contributors

cheerchen avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

dmm-scraper's Issues

打不开

win系统是下载那个名字里有win的那一个吗?怎么下载了,点exe没反应

How do I apply for DMM affiliate?

In the documentation, you mentioned that having a DMM affiliate can speed up the query process. How do I apply for this API? Is there a fee?

panic: runtime error: slice bounds out of range

win10 1909下运行之后报切片错误,去掉proxy参数也是一样,不知是什么原因?谢谢!

PS C:\Users\XXX\Downloads> .\better-av-tool-v0.8.1-win64.exe -output "I:\Ero\bat" -path "I:\Ero\FC2" -proxy "socks5://127.0.0.1:10808"
2020-02-21 09:56:51.300 INFO better-av-tool/main.go:123 num PPV-1042868 match!
panic: runtime error: slice bounds out of range

goroutine 1 [running]:
main.main.func2(0xc00005a4c0, 0x1e, 0x83a580, 0xc0001084d0, 0x0, 0x0, 0x1e, 0x2)
E:/Work/better-av-tool/main.go:135 +0x14c4
path/filepath.walk(0xc00005a4c0, 0x1e, 0x83a580, 0xc0001084d0, 0x7d3220, 0x0, 0x0)
c:/go/src/path/filepath/path.go:358 +0x42d
path/filepath.walk(0xc00005c0d0, 0xa, 0x83a580, 0xc000108070, 0x7d3220, 0x0, 0x832a60)
c:/go/src/path/filepath/path.go:382 +0x307
path/filepath.Walk(0xc00005c0d0, 0xa, 0x7d3220, 0x0, 0xc0000a2140)
c:/go/src/path/filepath/path.go:404 +0x106
main.main()
E:/Work/better-av-tool/main.go:171 +0x10f

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.