Comments (2)
bluenex
commented on September 13, 2024
I tried wget and sed:
wget -O toscrape.html http://exporter.nih.gov/ExPORTER_Catalog.aspx\?sid\=0\&index\=1
sed -n 's/.*href="\([^"]*\).*/\1/p' toscrape.html
Here's what I've got:
css/style.css
http://www.hhs.gov
javascript:ts('current_text',-1)
javascript:ts('current_text',normal)
javascript:ts('current_text',1)
http://www.nih.gov/
http://report.nih.gov/index.aspx
http://www.addthis.com/bookmark.php
default.aspx
./ExPORTER_Catalog.aspx
./CRISP_Catalog.aspx
./about.aspx
./faq.aspx
http://projectreporter.nih.gov
http://report.nih.gov/contactus/index.aspx?preselecttopic=28
http://grants.nih.gov/grants/guide/notice-files/not-od-13-126.html
http://www.usa.gov
#
#
http://projectreporter.nih.gov/
./ExPORTERNotes.aspx
#ContentPlaceHolder1_mnuSec_SkipLink
ExPORTER_Catalog.aspx?sid=1&index=5
XMLData/final/RePORTER_PRJABS_X_FY2016_026.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_026.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_025.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_025.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_024.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_024.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_023.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_023.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_022.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_022.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_021.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_021.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_020.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_020.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_019.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_019.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_018.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_018.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_017.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_017.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_016.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_016.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_015.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_015.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_014.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_014.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_013.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_013.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_012.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_012.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_011.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_011.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_010.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_010.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_009.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_009.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_008.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_008.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_007.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_007.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_006.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_006.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_005.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_005.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_004.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_004.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_003.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_003.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_002.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_002.zip
XMLData/final/RePORTER_PRJABS_X_FY2016_001.zip
CSVs/final/RePORTER_PRJABS_C_FY2016_001.zip
XMLData/final/RePORTER_PRJABS_X_FY2015.zip
CSVs/final/RePORTER_PRJABS_C_FY2015.zip
XMLData/final/RePORTER_PRJABS_X_FY2014.zip
CSVs/final/RePORTER_PRJABS_C_FY2014.zip
XMLData/final/RePORTER_PRJABS_X_FY2013.zip
CSVs/final/RePORTER_PRJABS_C_FY2013.zip
XMLData/final/RePORTER_PRJABS_X_FY2012.zip
CSVs/final/RePORTER_PRJABS_C_FY2012.zip
XMLData/final/RePORTER_PRJABS_X_FY2011.zip
CSVs/final/RePORTER_PRJABS_C_FY2011.zip
XMLData/final/RePORTER_PRJABS_X_FY2010.zip
CSVs/final/RePORTER_PRJABS_C_FY2010.zip
XMLData/final/RePORTER_PRJABS_X_FY2009.zip
CSVs/final/RePORTER_PRJABS_C_FY2009.zip
XMLData/final/RePORTER_PRJABS_X_FY2008.zip
CSVs/final/RePORTER_PRJABS_C_FY2008.zip
XMLData/final/RePORTER_PRJABS_X_FY2007.zip
CSVs/final/RePORTER_PRJABS_C_FY2007.zip
XMLData/final/RePORTER_PRJABS_X_FY2006.zip
CSVs/final/RePORTER_PRJABS_C_FY2006.zip
XMLData/final/RePORTER_PRJABS_X_FY2005.zip
CSVs/final/RePORTER_PRJABS_C_FY2005.zip
XMLData/final/RePORTER_PRJABS_X_FY2004.zip
CSVs/final/RePORTER_PRJABS_C_FY2004.zip
XMLData/final/RePORTER_PRJABS_X_FY2003.zip
CSVs/final/RePORTER_PRJABS_C_FY2003.zip
XMLData/final/RePORTER_PRJABS_X_FY2002.zip
CSVs/final/RePORTER_PRJABS_C_FY2002.zip
XMLData/final/RePORTER_PRJABS_X_FY2001.zip
CSVs/final/RePORTER_PRJABS_C_FY2001.zip
XMLData/final/RePORTER_PRJABS_X_FY2000.zip
CSVs/final/RePORTER_PRJABS_C_FY2000.zip
XMLData/final/RePORTER_PRJABS_X_FY1999.zip
CSVs/final/RePORTER_PRJABS_C_FY1999.zip
XMLData/final/RePORTER_PRJABS_X_FY1998.zip
CSVs/final/RePORTER_PRJABS_C_FY1998.zip
XMLData/final/RePORTER_PRJABS_X_FY1997.zip
CSVs/final/RePORTER_PRJABS_C_FY1997.zip
XMLData/final/RePORTER_PRJABS_X_FY1996.zip
CSVs/final/RePORTER_PRJABS_C_FY1996.zip
XMLData/final/RePORTER_PRJABS_X_FY1995.zip
CSVs/final/RePORTER_PRJABS_C_FY1995.zip
XMLData/final/RePORTER_PRJABS_X_FY1994.zip
CSVs/final/RePORTER_PRJABS_C_FY1994.zip
XMLData/final/RePORTER_PRJABS_X_FY1993.zip
CSVs/final/RePORTER_PRJABS_C_FY1993.zip
XMLData/final/RePORTER_PRJABS_X_FY1992.zip
CSVs/final/RePORTER_PRJABS_C_FY1992.zip
XMLData/final/RePORTER_PRJABS_X_FY1991.zip
CSVs/final/RePORTER_PRJABS_C_FY1991.zip
XMLData/final/RePORTER_PRJABS_X_FY1990.zip
CSVs/final/RePORTER_PRJABS_C_FY1990.zip
XMLData/final/RePORTER_PRJABS_X_FY1989.zip
CSVs/final/RePORTER_PRJABS_C_FY1989.zip
XMLData/final/RePORTER_PRJABS_X_FY1988.zip
CSVs/final/RePORTER_PRJABS_C_FY1988.zip
XMLData/final/RePORTER_PRJABS_X_FY1987.zip
CSVs/final/RePORTER_PRJABS_C_FY1987.zip
XMLData/final/RePORTER_PRJABS_X_FY1986.zip
CSVs/final/RePORTER_PRJABS_C_FY1986.zip
XMLData/final/RePORTER_PRJABS_X_FY1985.zip
CSVs/final/RePORTER_PRJABS_C_FY1985.zip
./Default.aspx
./ExPORTER_Catalog.aspx
./CRISP_Catalog.aspx
./faq.aspx
./about.aspx
http://projectreporter.nih.gov
http://report.nih.gov
http://report.nih.gov/contactus/index.aspx?preselecttopic=28
http://report.nih.gov/pdf/DataAccessPolicy.pdf
http://report.nih.gov/accessibility.aspx
http://grants.nih.gov/grants/privacy.htm
http://grants.nih.gov/grants/disclaimer.htm
http://www.nih.gov/icd/od/foia/index.htm
http://grants.nih.gov/grants/edocs.htm
http://www.grants.nih.gov/
http://www.nih.gov/
http://www.hhs.gov
http://www.usa.gov/
http://www.grants.gov/
http://www.nih.gov
http://www.report.nih.gov
http://www.nih.gov
http://www.report.nih.gov
from grant_database.
titipata
commented on September 13, 2024
Thanks again @bluenex, 069f362 solves the issue.
from grant_database.
Related Issues (19)
- Create bash script to download and process all NSF grant HOT 2
- Record linkage between deduplicated affiliations and GRID
- Dedupe affliation script doesn't work for me HOT 1
- Convert full state names to two letters HOT 1
- Put country in grant deduplication and grid record linkage
- Put country in NIH and NSF grant info CSVs
- Rage because of bugs
- Link dudupe result with GRID back to original NIH and NSF grant HOT 3
- Problem with NSF year between 2000-2010 HOT 2
- Link unique NIH PIs with MEDLINE data
- Cannot find dedupe_nsf.py
- Fetch new href links HOT 2
- Add NSF grant dataset to Scholarfy's Elasticsearch
- Add NIH grant dataset to Scholarfy's Elasticsearch
- Add NSF and NIH data to Scholarfy NN model
- Create code to merge NIH abstract with NIH grant information table HOT 2
- Add CIHR scraper and data also? HOT 1
- Deduplicate NIH and NSF affiliations HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from grant_database.