Comments (6)
Tried to downgrade to python 3.11 and error still occurs
[#] Lightnovel Crawler v3.5.1
https://github.com/dipu-bd/lightnovel-crawler
-> Press Ctrl + C to exit
? Enter novel page url or query novel: super god gene
Searching: 34%|██████████████████████▋ | 93/270 [00:11<00:31, 5.60source/s]Failed to get any results, likely auth failure
Searching: 73%|███████████████████████████████████████████████▍ | 197/270 [01:10<00:28, 2.58source/s]
! Error: decoding to str: need a bytes-like object, NoneType found
<class 'TypeError'>
File "C:\Users\daved\OneDrive\Desktop\lightnovel-crawl\lncrawl\core\app.py", line 103, in search_novel
search_novels(self)
File "C:\Users\daved\OneDrive\Desktop\lightnovel-crawl\lncrawl\core\novel_search.py", line 125, in search_novels
app.search_results = _combine_results(results)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\daved\OneDrive\Desktop\lightnovel-crawl\lncrawl\core\novel_search.py", line 46, in _combine_results
key = slugify(item.title)
^^^^^^^^^^^^^^^^^^^
File "C:\Users\daved\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.11_qbz5n2kfra8p0\LocalCache\local-packages\Python311\site-packages\slugify\slugify.py", line 115, in slugify
text = str(text, 'utf-8', 'ignore')
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
- https://github.com/dipu-bd/lightnovel-crawler/issues
================================================================================
Searching: 100%|█████████████████████████████████████████████████████████████████| 270/270 [01:10<00:00, 3.85source/s]
from lightnovel-crawler.
lightnovel-crawl> python lncrawl -s https://boxnovel.com/novel/reincarnation-of-the-strongest-sword-god/
[#] Lightnovel Crawler v3.5.1
https://github.com/dipu-bd/lightnovel-crawler
-> Press Ctrl + C to exit
Retrieving novel info...
Exception in thread Thread-1 (read_novel_info):
Traceback (most recent call last):
File "C:\Users\daved\OneDrive\Desktop\lightnovel-crawl\lncrawl\templates\madara.py", line 66, in select_chapter_tags
raise Exception("No chapters on first URL")
Exception: No chapters on first URL
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.2544.0_x64__qbz5n2kfra8p0\Lib\threading.py", line 1045, in _bootstrap_inner
self.run()
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.2544.0_x64__qbz5n2kfra8p0\Lib\threading.py", line 982, in run
self._target(*self._args, **self._kwargs)
File "C:\Users\daved\OneDrive\Desktop\lightnovel-crawl\lncrawl\templates\soup\general.py", line 34, in read_novel_info
for item in self.parse_chapter_list(soup):
File "C:\Users\daved\OneDrive\Desktop\lightnovel-crawl\lncrawl\templates\soup\chapter_only.py", line 13, in parse_chapter_list
for tag in self.select_chapter_tags(soup):
File "C:\Users\daved\OneDrive\Desktop\lightnovel-crawl\lncrawl\templates\madara.py", line 70, in select_chapter_tags
response = self.submit_form(
^^^^^^^^^^^^^^^^^
File "C:\Users\daved\OneDrive\Desktop\lightnovel-crawl\lncrawl\core\scraper.py", line 230, in submit_form
return self.post_response(url, data=data, headers=headers, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\daved\OneDrive\Desktop\lightnovel-crawl\lncrawl\core\scraper.py", line 211, in post_response
return self.__process_request(
^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\daved\OneDrive\Desktop\lightnovel-crawl\lncrawl\core\scraper.py", line 130, in __process_request
raise e
File "C:\Users\daved\OneDrive\Desktop\lightnovel-crawl\lncrawl\core\scraper.py", line 123, in __process_request
response.raise_for_status()
File "C:\Users\daved\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.11_qbz5n2kfra8p0\LocalCache\local-packages\Python311\site-packages\requests\models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: https://boxnovel.com/wp-admin/admin-ajax.php
! Error: No chapters found
<class 'Exception'>
File "C:\Users\daved\OneDrive\Desktop\lightnovel-crawl\lncrawl\bots\console\integration.py", line 107, in start
raise e
File "C:\Users\daved\OneDrive\Desktop\lightnovel-crawl\lncrawl\bots\console\integration.py", line 101, in start
_download_novel()
File "C:\Users\daved\OneDrive\Desktop\lightnovel-crawl\lncrawl\bots\console\integration.py", line 85, in _download_novel
self.app.get_novel_info()
File "C:\Users\daved\OneDrive\Desktop\lightnovel-crawl\lncrawl\core\app.py", line 137, in get_novel_info
raise Exception("No chapters found")
from lightnovel-crawler.
Error: decoding to str: need a bytes-like object, NoneType found
This error is fixed. But the error which occurs when you try to download from URL : novel_url. Yeah, I am not sure how to fix this.
from lightnovel-crawler.
Thanks zGadli, Well one down is better then nothing. What is the fix to this or the article with the fix steps.
from lightnovel-crawler.
Just tried to do a serch and still showing the error; decoding to str
-> Press Ctrl + C to exit
? Enter novel page url or query novel: super god gene
Searching: 36%|███████████████████████▍ | 102/283 [00:07<00:17, 10.13source/s]Failed to get any results, likely auth failure
Searching: 73%|███████████████████████████████████████████████▎ | 206/283 [01:09<00:29, 2.60source/s]
! Error: decoding to str: need a bytes-like object, NoneType found
<class 'TypeError'>
File "C:\Users\daved\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.11_qbz5n2kfra8p0\LocalCache\local-packages\Python311\site-packages\lncrawl\core\app.py", line 103, in search_novel
search_novels(self)
File "C:\Users\daved\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.11_qbz5n2kfra8p0\LocalCache\local-packages\Python311\site-packages\lncrawl\core\novel_search.py", line 125, in search_novels
app.search_results = _combine_results(results)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\daved\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.11_qbz5n2kfra8p0\LocalCache\local-packages\Python311\site-packages\lncrawl\core\novel_search.py", line 46, in _combine_results
key = slugify(item.title)
^^^^^^^^^^^^^^^^^^^
File "C:\Users\daved\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.11_qbz5n2kfra8p0\LocalCache\local-packages\Python311\site-packages\slugify\slugify.py", line 115, in slugify
text = str(text, 'utf-8', 'ignore')
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Searching: 100%|█████████████████████████████████████████████████████████████████| 283/283 [01:20<00:00, 2.60source/s]
from lightnovel-crawler.
@Nephalemzz If you want the fix you will have to clone the dev branch of this repo to your local machine and run it.
from lightnovel-crawler.
Related Issues (20)
- A bug i think not sure? HOT 3
- COPY AND PASTE (ISSUE) HOT 1
- luminarynovels.com] Incorrect counting of chapters
- i am getting the following when trying to search HOT 2
- https://isekailunatic.com/
- Fix this source https://freewebnovel.com/ & https://libread.org/ HOT 9
- distutils is deprecated and removed in Python 3.12 HOT 1
- please add this https://m.shuhaige.net
- innovel.com
- i am trying to fetch novel from lightnovelpub and lightnovelworld
- https://visorikigai.net/
- https://mtlarchive.com
- Add https://mtlarchive.com plisss HOT 1
- Fix this source : reaperscans.com HOT 1
- https://kinkytranslations.com
- https://www.crimsontranslations.com/
- https://mtlnation.com HOT 1
- if possible to add galaxy translation
- https://www.dreame.com/
- https://moonlightnovel.com
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lightnovel-crawler.