Comments (3)
mayeulk
commented on June 12, 2024
I just launched this in one go:
update_icews(dryrun = FALSE)
date()
update_icews(dryrun = FALSE)
date()
update_icews(dryrun = FALSE)
date()
update_icews(dryrun = FALSE)
date()
update_icews(dryrun = FALSE)
date()
update_icews(dryrun = FALSE)
date()
update_icews(dryrun = FALSE)
date()
This worked,... but then Harvard's Dataverse "crashed":
> > update_icews(dryrun = FALSE)
> Downloading '20181215-icews-events.zip'
> Ingesting records from '20181215-icews-events.tab'
> Downloading '20181216-icews-events.zip'
> Ingesting records from '20181216-icews-events.tab'
> Downloading '20181217-icews-events.zip'
> Ingesting records from '20181217-icews-events.tab'
> Downloading '20181218-icews-events.zip'
> Ingesting records from '20181218-icews-events.tab'
> Downloading '20181219-icews-events.zip'
> Ingesting records from '20181219-icews-events.tab'
> Downloading '20181220-icews-events.zip'
> Ingesting records from '20181220-icews-events.tab'
> Downloading '20181221-icews-events.zip'
> Error in get_file(file_ref, get_doi()[[repo]]) :
> Internal Server Error (HTTP 500).
> > date()
> [1] "Wed Jun 19 18:31:17 2019"
> > update_icews(dryrun = FALSE)
> Error in value[[3L]](cond) :
> Something went wrong in 'dataverse' or the Dataverse API, try again. Original error message:
> lexical error: invalid char in json text.
> <!DOCTYPE HTML PUBLIC "-//IETF/
> (right here) ------^
> > date()
> [1] "Wed Jun 19 18:31:17 2019"
> > update_icews(dryrun = FALSE)
> Error in value[[3L]](cond) :
> Something went wrong in 'dataverse' or the Dataverse API, try again. Original error message:
> lexical error: invalid char in json text.
> <!DOCTYPE HTML PUBLIC "-//IETF/
> (right here) ------^
> > date()
> [1] "Wed Jun 19 18:31:17 2019"
> > update_icews(dryrun = FALSE)
> Error in value[[3L]](cond) :
> Something went wrong in 'dataverse' or the Dataverse API, try again. Original error message:
> lexical error: invalid char in json text.
> <!DOCTYPE HTML PUBLIC "-//IETF/
> (right here) ------^
> > date()
> [1] "Wed Jun 19 18:31:17 2019"
> > update_icews(dryrun = FALSE)
> Error in value[[3L]](cond) :
> Something went wrong in 'dataverse' or the Dataverse API, try again. Original error message:
> lexical error: invalid char in json text.
> <!DOCTYPE HTML PUBLIC "-//IETF/
> (right here) ------^
> > date()
> [1] "Wed Jun 19 18:31:17 2019"
> > update_icews(dryrun = FALSE)
> Error in value[[3L]](cond) :
> Something went wrong in 'dataverse' or the Dataverse API, try again. Original error message:
> lexical error: invalid char in json text.
> <!DOCTYPE HTML PUBLIC "-//IETF/
> (right here) ------^
> > date()
> [1] "Wed Jun 19 18:31:17 2019"
> > update_icews(dryrun = FALSE)
> Error in value[[3L]](cond) :
> Something went wrong in 'dataverse' or the Dataverse API, try again. Original error message:
> lexical error: invalid char in json text.
> <!DOCTYPE HTML PUBLIC "-//IETF/
> (right here) ------^
> > date()
> [1] "Wed Jun 19 18:31:18 2019"
> > update_icews(dryrun = FALSE); date()
> Error in value[[3L]](cond) :
> Something went wrong in 'dataverse' or the Dataverse API, try again. Original error message:
> lexical error: invalid char in json text.
> <!DOCTYPE HTML PUBLIC "-//IETF/
> (right here) ------^
> > update_icews(dryrun = FALSE); date()
> Error in value[[3L]](cond) :
> Something went wrong in 'dataverse' or the Dataverse API, try again. Original error message:
> lexical error: invalid char in json text.
> <!DOCTYPE HTML PUBLIC "-//IETF/
> (right here) ------^
Going to https://dataverse.harvard.edu/ gives a 503 - Service Unavailable
"Service Unavailable
The server is temporarily unable to service your request due to maintenance downtime or capacity problems. Please try again later."
2 or 3 minutes later, it was working fine again, and update_icews(dryrun = FALSE) worked
from icews.
mayeulk
commented on June 12, 2024
Note: after the (possible?) server restart (?) of dataverse.harvard.edu/ , things went smoother, with about 107 downloads, until stopping with the following issue again: #45 (comment)
from icews.
andybega
commented on June 12, 2024
Hmm. I'm wondering if this is something that should be done in the actual client (https://github.com/IQSS/dataverse-client-r), but it's at the moment not being actively maintained for lack of a new owner.
Any suggestions for how this should properly be done? Upon encountering one of these errors, iterate through waiting for some small amount of time until either success or some limit is reached?
from icews.
Related Issues (20)
- In Windows tests, unlinking test DB does not work
- Test errors due to dplyr 1.0.0 HOT 1
- Vignette building fails on Ubuntu + R 3.5 HOT 1
- Update saved mock DVN manifest HOT 1
- Finish ICEWS event data vignette
- Re-knit and if needed update database internals vignette
- Re-knit speed comparison vignette
- Some records are missing CAMEO code HOT 1
- Make it easier to manually interact with dataverse
- Release icews 1.0.0
- Check if dataverse on CRAN has been updated beyond 0.2.0 HOT 1
- Issues in Events.2017 file
- Missing CAMEO codes for 2017 events
- Some text fields include quotes, e.g. ""Fight"" instead of "Fight"
- Migrate to testthat 3rd edition HOT 1
- Add error hint for expired dataverse API tokens
- Wrong cameo codes '13y' for some events in the 2017 file
- Faster inserts on update
- Unusual January 2022 data file in weekly repo is causing error HOT 1
- Add option to use DuckDB as backend
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from icews.