tzwsoho / nec_crawler Goto Github PK
View Code? Open in Web Editor NEWNetEase Cartoon Crawler，manhua.163.com 爬虫
nec_crawler's People
Contributors
Stargazers
Watchers
nec_crawler's Issues
试了下非常好用
但还是希望加入需要登录付费的漫画的下载功能...
同名章节下载&图片格式问题
通过使用博主写的这个爬虫配合从某宝买的数个带砖石券账号，我已经如愿爬完了想要的那部付费漫画的全部主要章节，但是我发现似乎是因为有几个章节是同名的原因，并未能正常下载（有三个“特别收录 初期短篇”，使用爬虫只下载了第一个，有四个“特别短篇”，但也只能下载第一个...）
本来我想着只有六章节了，这种同名章节的情况应该也比较少见，就不忍心再来麻烦你了，想从网页手动扒，结果保存下来的文件居然不能查看...查了下才知道原来网易漫画提供webp与jpg两种格式，通过比较我发现同一页webp格式的图片清晰度高于之前爬虫爬取的jpg格式的...于是这里又产生了另一个想法：能不能在config.json中提供格式选择的选项？jpg格式的图片方便制作成kindle电子书，webp格式的图片虽然不能直接制作电子书，但画质上更适合收藏用...
之前通过邮件发给你的测试用的账号正好【不好意思换号换来换去我搞昏了...解锁了相关章节的是另一个账号...已通过邮件发送...】解锁了涉及问题的其中几个章节...博主有时间的话可以再登录账号看看...谢谢了...
爬取的漫画图片无法查看，提示文件格式错误
config.js:
{
"download_threads" : 8,
"retry_times_max" : 3,
"output_dir" : "D:\\hentai",
"book_ids" : [
"4317076104890059052"
],
"book_ids0" : [
"4316808069910044571",
"4316808069910049563",
"4316808069910049643",
"4316808069910049882",
"4316808069920050221",
"4316808069920050251",
"4316808069920051203",
"4316808069920053167",
"4316808069920054370",
"4316808070150070932",
"4316808070150071591",
"4316808070150074575",
"4316808070150076188",
"4316808070150076720",
"4316808070150079404",
"4316808070150079416",
"4316808070150079442",
"4316808070160064785",
"4316808070160065188",
"4316965340990055253",
"4316965916260064995",
"4316965916260067385",
"4316982053030045065",
"4316982053030048225",
"4316982053030049690",
"4316983292840070714",
"4316983292840074652",
"4316983292840076680",
"4316985369910053825",
"4316991136130060230",
"4316991136130064396",
"4316991136130065297",
"4317016704090046440",
"4317033422190053761",
"4317039006300068050",
"4317039006300069953",
"4317041374930046603",
"4317047100100071433",
"4317047100100077914",
"4317050909700054373",
"4317058980150064883",
"4317058980150066761",
"4317058980150068992",
"4317062580700044169",
"4317062580700046873",
"4317062580700047724",
"4317064958460057781",
"4317064958460058888",
"4317064958460059189",
"4317076104890050896",
"4317076104890057243",
"4317076104890057864",
"4317076104890059052",
"4317089497360055496",
"4319487031780064264",
"4340892233000110888",
"4340892233000112529",
"4346777413000105271",
"4346777413000105411",
"4350534790310120205",
"4350534790310120228",
"4350534790310122250",
"4358549872890121552",
"4359686556170093897",
"4361635152540091020",
"4366922586100115157",
"4375742738710109386",
"4376930639940112883",
"4387931006570126789",
"4387931006570127626",
"4387931006570129059",
"4394282662640112959",
"4394282662640113371",
"4394282662640119988",
"4400834664100098476",
"4400834664100098516",
"4402407847970112603",
"4406702692730128470",
"4415012932660122246",
"4432191056040099387",
"4439462677380120254",
"4446410884720093254",
"4458002705630123021",
"4458002705630123099",
"4458002705630123103",
"4458002705630123975",
"4459802689650093864",
"4460198728620123378",
"4460558659600119657",
"4463042697510099087",
"4464338922550115750",
"4465778668740106500",
"4473122766120123349",
"4473122766120123428",
"4475930658180096982",
"4475930658180096990",
"4477190601790120299",
"4479864671570120536",
"4479868083660100382",
"4479868083660100531",
"4482626822690090390",
"4484066944410100237",
"4488422628680092185",
"4491909884070114466",
"4498178964520090031",
"4502786774720120351",
"4503074821610096175",
"4506531110430092975",
"4511018596800106111",
"4512021501880121949",
"4513541873590107822",
"4519595986040095989",
"4527411211400125551",
"4529213049280123772",
"4529391020670118299",
"4529535265780105579",
"4531751187130123124",
"4533476682530103741",
"4533476682530108142",
"4536879893110113350",
"4542452908940118482",
"4543106930510100795",
"4544475452740113917",
"4554950842220111990",
"4556644403900104959",
"4559486971000115977",
"4560963294790090531",
"4561899161230115302",
"4564563211480124333",
"4566399073990126076",
"4566471242340112905",
"4567043002180091935",
"4569495166470124528",
"4569495166470124559",
"4569495166470124596",
"4572736027770116778",
"4573238801760108343",
"4576012710570106689",
"4576012710570106952",
"4579859000890112384",
"4579859000890112926",
"4580007153340104707",
"4581102676690119577",
"4584976774550093881",
"4587041872650109342",
"4587352404580117364",
"4592753657710109231",
"4592753657710109235",
"4593791002590090254",
"4594759609780129859",
"4597792049620093697",
"4602976107320126534",
"4604519002090128474",
"4605820288180112940",
"4606756611420098505",
"4607296605730116592",
"4608160481960122234",
"4608556479150101301",
"4610390818390105508",
"4610644654650092027",
"4611680413500096139",
"4611680413500096141",
"4611680413500096143",
"4611680413500096145",
"4611940283810115693",
"4613023525370116893",
"4614683956320127821",
"4615324882390118047",
"4615324882390118138",
"4616867001190093765",
"4617223306170106339",
"4617223306170106341",
"4618239389800097226",
"4621546381030091581",
"4622776324450127075",
"4623171405340106507",
"4623171405340106602",
"4623259618240099500",
"4624272057690119728",
"4626750368970093722",
"4627616593540122376",
"4629352898130102129",
"4634090581880100804",
"4634090581880100824",
"4634090581880101006",
"4635425752740091790",
"4635425752740094196",
"4639712296520113040",
"4639712296520113752",
"4639712296520118385",
"4639712296520118408",
"4639788950150120754",
"4639788950150126071",
"4639788950150126103",
"4641837680480107795",
"4641837680480108042",
"4643138479170097131",
"4645740535490114037",
"4645740535490114817",
"4645740535490115552",
"4645761689240126628",
"4649389707730093947",
"4650085198900117356",
"4650085198900119118",
"4661304352040099153",
"4663046521820116051",
"4667497681350112365",
"4671693694010121328",
"4672921430090116732",
"4680333330450097759",
"4682004433180129873",
"4684881833990106557",
"4689000183600100320",
"4689000183600100991",
"4691101525810122604",
"4693162155280096613",
"4695045397200104837",
"4696082683500121178",
"4697614146430091400",
"4698660045160124534",
"4704392177570101272",
"4704551217900113207",
"4706627122660090011",
"4713551352180093183",
"4718287345560092797",
"4719230895910116470",
"4721027662820129668",
"4724324026990114802",
"4724499322570094056",
"4724499322570094080",
"4724499322570094097",
"4724499322570094285",
"4724499322570094578",
"4724499322570095355",
"4726157795020126824",
"4727083695180116131",
"4727086212590129612",
"4731282536150123370",
"4731282536150127781",
"4733100907630110049",
"4733116918660133593",
"4737592769880130093",
"4737592769880135273",
"4737592769880136384",
"4742639494440158441",
"4742639494440158618",
"4744277806220113316",
"4745156711960156572",
"4745156711960157053",
"4746833701570131267",
"4746882995020128997",
"4749477479830158896",
"4749477479830159570",
"4751208034420154873",
"4751245936130130207",
"4751580465580121211",
"4751580465580127976",
"4752070016550113012",
"4752070016550116605",
"4759877403970116304",
"4761767994890139702",
"4770215190250137847",
"4771945676810120861",
"4771945676810125930",
"4772177273450133100",
"4774631724890155765",
"4774631724890158847",
"4778235902790116718",
"4778354074630120230",
"4778354074630120356",
"4779725515350151710",
"4781357668610112847",
"4781856279850152567",
"4787470554660124199",
"4787470554660124299",
"4787470554660124393",
"4787600231860156333",
"4789159124040155704",
"4790572515570120129",
"4792875259570152080",
"4794542716600124363",
"4796521854030127071",
"4796521854030129385",
"4798881222390127382",
"4800540017620117712",
"4801704361530117872",
"4806799487140116827",
"4807554185610154910",
"4808133871500117914",
"4816503968880123207",
"4816504049570150102",
"4822496041090155507",
"4827201173070353987",
"4828421593230128690",
"4828958330550150442",
"4831131106200356728",
"4834210784850112085",
"4837562282720513474",
"4840200580600347803",
"4841800840240518779",
"4844371285780343897",
"4844691185000116559",
"4847754234270513769",
"4847754234270516992",
"4851392628620353243",
"4851894193090122419",
"4857741349350159871",
"4860241824180357708",
"4862602811360156200",
"4866340564010358627",
"4866374793400502547",
"4869900922380358192",
"4871348416950347490",
"4871664448610159924",
"4872260979260513868",
"4874833785900151162",
"4875066069050114242",
"4875066069050116947",
"4875952064690512729",
"4876064013610503313",
"4876064013610503815",
"4877443261860353234",
"4877443261860353246",
"4877443261860353850",
"4882594752580341765",
"4886219721830110447",
"4888849219480150139",
"4888849219480157489",
"4889397974090507678",
"4891040955760352729",
"4891226865760513870",
"4891226865760514992",
"4897997532460512684",
"4898063305390358868",
"4898949979290509597",
"4900220070180151022",
"4900220070180157900",
"4903267625100115208",
"4903270538350506808",
"4906726259150510216",
"4907612474640154531",
"4907612474640157510",
"4908027720240355282",
"4913628595420111023",
"4915573161170340375",
"4916608711940357454",
"4918225525830345953",
"4920179441830512120",
"4920179441830512530",
"4925251259260156292",
"4925251259260156671",
"4926046160470129413",
"4932087519590506141",
"4936203086890150570",
"4936203086890153748",
"4942174423450126134",
"4943160650840153393",
"4943378577070513820",
"4946299967840354886",
"4946299967840354965",
"4946667431840118001",
"4947662278590156104",
"4947662278590158493",
"4947662278590158874",
"4947662278590158889",
"4947662278590159014",
"4951522795260351081",
"4954346181950515457",
"4955951226610358480",
"4956311181150517712",
"4956311181150517875",
"4956403641570127380",
"4961131420850500467",
"4961322651750342291",
"4964626255310153200",
"4968108589180116008",
"4968451559750359310",
"4971849493750129631",
"4974048558970357406",
"4977603652780123563",
"4978460341400340592",
"4979611558430157581",
"4980407033230126404",
"4980631253170503609",
"4981350072900519512",
"4981833020910117908",
"4984446477210507173",
"4986015905820120080",
"4986015905820129437",
"4986431600690511913",
"4989614438490114258",
"4990727237820514793",
"4992210638340344592",
"4992516181490514266",
"4996723140190119392",
"4997593399870156715",
"4999667795850112739",
"4999667795850113379",
"5001483551430348644",
"5002207048620115687",
"5005964151000359095",
"5008295983660346263",
"5008653881310354701",
"5009786018530127950",
"5012236635780509848",
"5014768596550359076",
"5015115116720343959",
"5015115116720343963",
"5015165829890111936",
"5015375858980120764",
"5015375858980128367",
"5016340471700354950",
"5016770227290516501",
"5018449309500504034",
"5020985690230516698",
"5021603076670111967",
"5021603076670119699",
"5021756284340159990",
"5027201709200340373",
"5027260890510355298",
"5027535942740125136",
"5027734528170346370",
"5028588323920117775",
"5029216141620345208",
"5029535389450157748",
"5032604302090343843",
"5032604302090344976",
"5036477080000120011",
"5041862516990111243",
"5043514892150354047",
"5051814106630124302",
"5056552310370355865",
"5059198314650511040",
"5062432419270128758",
"5063790584350353051",
"5072207254830359111",
"5077976531460356751",
"5077976531460358127",
"5081697101100122480",
"5081760449790359581",
"5086593829130122447",
"5094694745000343915",
"5096431401470504742",
"5102969892260501492",
"5106828146170156042",
"5107450753890352334",
"5107902594930514073",
"5108295818580343008",
"5112869712600348684",
"5116880516220111823",
"5118017104650508385",
"5119647669120515326",
"5119732667930155707",
"5120932159120128638",
"5120952583170158057",
"5121178261310346551",
"5124287895540357508",
"5125647040070356095",
"5129065891960116232",
"5129563148930341453",
"5130890248870158226",
"5130956633340504574",
"5131356844520114987",
"5131356844520115708",
"5131542078180517521",
"5132233943920509982",
"5132309456090119149",
"5132529703580159762",
"5132623591520342764",
"5135139411940506328",
"5136422904690117042",
"5138225887530509385",
"5138737128540348840",
"5140276124140516564",
"5141648751530114212",
"5142015596300156049",
"5142022635230121714",
"5142513899980517025",
"5143579812050340873",
"5143595335820352484",
"5144716848100355606",
"5149063881130114550",
"5150738286700150634",
"5151343932440115775",
"5154417505180513720",
"5159174565860151164",
"5160614953980518452",
"5162649858430127029",
"5163645153930114401",
"5166403580880129605",
"5167763607500501576",
"5168053922240159649",
"5168579535570110724",
"5178146213900114845",
"5179627218700125502",
"5195627709490350884",
"5208587779330515824",
"5209499881480501556"
]
}
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.