Comments (7)
Hi @arifin-chemist89, thanks for reporting the issue. I believe the reason is an empty .jsonl file that is stored under paperscraper/server_dumps.
The file might be empty because the chemrxiv api is down (see #13).
The quick fix should be to delete the empty file.
from paperscraper.
Thanks for your quick response.
actually I could not find paperscraper/server_dumps directory. Furthermore, as I mentioned in edit1, I also got the same error even I am importing get_and_dump_arxiv_papers
. Is the following line need to be done while dumping 'biorxiv', 'chemrxiv', 'medrxiv' db?
path = sorted(dump_paths, reverse=True)[0]
querier = XRXivQuery(path)
QUERY_FN_DICT.update({db: querier.search_keywords})
from paperscraper.
Did you follow this instruction to download the dumps for chemrxiv, biorxiv and medrxiv before the error occurred for the first time? https://github.com/PhosphorylatedRabbits/paperscraper#download-x-rxiv-dumps
I can see from your error trace that your paperscraper is located in /.local/lib/python3.7/site-packages/paperscraper/
.
Navigate there and go to paperscraper/server_dumps
and I believe you will find an empty file from chemrxiv. Delete this file and restart your python shell this should do the quick fix
from paperscraper.
While I cant do much against the chemrxiv api being down, what definitely has to be improved is the error handling in the package. I will soon release a proper fix for this.
from paperscraper.
Issue should be fixed @arifin-chemist89
If you reinstall paperscraper
, you should have version 0.1.1 which should run without this problem. Unfortunately, the chemrXiv API was shut down. See #16 and the Release notes
from paperscraper.
I am sorry for the unclear question. I think I can understand now. Anyway, thank you very much for your notice and quick bug fix. I will try to reinstall it and looking forward for chemrXiv API to go back in action again.
from paperscraper.
no worries, but there is simply no chemrxiv API anymore. Chemrxiv changed its host and the new host does not provide API access. See the README for details
from paperscraper.
Related Issues (18)
- get_dumps.chemrxiv does nothing HOT 6
- ChemRxiv Engage API integration HOT 1
- ImportError: attempted relative import beyond top-level package HOT 1
- No DOI given in saved dumps of recent arxiv papers HOT 4
- HTTPError for paperscraper.get_dumps.chemrxiv() HOT 6
- UnexpectedEmptyPageError and associated errorscre HOT 5
- How to turn off the DEBUG log information? HOT 3
- Scrape X-rxiv via API HOT 3
- Remote diconnected and didnt download files HOT 5
- Searching impact factor of journal
- scrapper Killed HOT 2
- import error HOT 4
- Error when downloading papers from Pubmed. HOT 4
- move server_dumps directory? HOT 1
- Autogenerate docs HOT 1
- error in !pip install paperscraper HOT 4
- Randomness in arxiv API requests
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from paperscraper.