Comments (1)
Yes, that's a feature of the OAI-PMH protocol: you can download a specific set. To see what sets are available from an endpoint, you can run the following command (formatting requires jq):
$ metha-id http://export.arxiv.org/oai2 | \
jq -r '.sets[]| [.setSpec, .setName] | @tsv' |
column -t -s ' ' # CTRL-v TAB
cs Computer Science
econ Economics
eess Electrical Engineering and Systems Science
math Mathematics
physics Physics
physics:astro-ph Astrophysics
physics:cond-mat Condensed Matter
physics:gr-qc General Relativity and Quantum Cosmology
physics:hep-ex High Energy Physics - Experiment
physics:hep-lat High Energy Physics - Lattice
physics:hep-ph High Energy Physics - Phenomenology
physics:hep-th High Energy Physics - Theory
physics:math-ph Mathematical Physics
physics:nlin Nonlinear Sciences
physics:nucl-ex Nuclear Experiment
physics:nucl-th Nuclear Theory
physics:physics Physics (Other)
physics:quant-ph Quantum Physics
q-bio Quantitative Biology
q-fin Quantitative Finance
stat Statistics
Then only sync what you want with:
$ metha-sync -set physics http://export.arxiv.org/oai2
To inspect the data, pass the -set
as well.
$ metha-cat -set physics http://export.arxiv.org/oai2
There is no support for requesting multiple sets at once in metha, currently.
from metha.
Related Issues (20)
- Bad page state in metha-sync (arm)
- authorization // character limit HOT 5
- Support for basic auth HOT 2
- two different resumptionTokens? HOT 1
- metha-cat - can not open the "dir" extablished in .cache/metha HOT 3
- Urlencode resuptionToken HOT 2
- Migration from Goodtables to Frictionless Repository
- Question: Can metha auto harvest all formats/metadataPrefixes? HOT 2
- Metha-Cat: Support for Paging? HOT 3
- Client Timeout HOT 4
- Dependency Issue with Version 0.2.37 HOT 2
- metha-sync should catch SIGINT HOT 3
- Extend metha-cat to extract metadata records HOT 3
- Selective Harvesting and metha-cat HOT 2
- decode failed due to XML header HOT 1
- conflicting namespace prefixes during ListRecords HOT 2
- `-format` not respected? HOT 2
- Date Parsing Issue HOT 2
- Failed With Unprocessable Entity HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from metha.