datacite / lupo Goto Github PK

View Code? Open in Web Editor NEW

10.0 8.0 8.0 15.57 MB

DataCite REST API

Home Page: https://api.datacite.org

License: MIT License

Ruby 98.99% HTML 0.91% Dockerfile 0.10%

ruby lupo rails-api doi jsonapi graphql

lupo's Introduction

DataCite REST API

Rails API application for managing DataCite providers, clients, prefixes and DOIs. The API usesthe JSONAPI specification.

Installation

Using Docker.

docker run -p 8065:80 datacite/lupo

docker-compose up

If you want to build the docker image locally (instead of pulling it from docker hub) and use docker compose for development you can use

docker-compose -f docker-compose.yml -f docker-compose.local.yml

You can now point your browser to http://localhost:8065 and use the application. Some API endpoints require authentication.

Development

For basic setup one can use the following:

bundle exec rake db:create
bundle exec rake db:schema:load
bundle exec rake db:seed:development:base

All other seed options can be found using rake --tasks

We use Rspec for testing:

bundle exec rspec

Note when using a fresh test database you will need to instantiate the test db with:

bundle exec rake db:create RAILS_ENV=test

Note when accessing the console you will need to disable spring:

env DISABLE_SPRING=true bundle exec rails console

Follow along via Github Issues.

Note on Patches/Pull Requests

Fork the project
Write tests for your new feature or a test that reproduces a bug
Implement your feature or make a bug fix
Do not mess with Rakefile, version or history
Commit, push and make a pull request. Bonus points for topical branches.

License

Lupo is released under the MIT License.

lupo's People

Contributors

Stargazers

Watchers

Forkers

jbjares norrs kjgarza front-matter dmproger lpsinger daherb

lupo's Issues

Correctly show clients by year when clients have been deleted

API endpoint for re3data names and ids

First integration with re3data API. Allow query for re3data and return id and name. This can be integrated into clients API endpoint.

UID for client_prefix and provider_prefix with special characters in checksum leads to 404 error

Properly validate DOI metadata

Error in Client API

NoMethodError in dois#show
undefined method `role_id' for nil:NilClass

View on Bugsnag

Stacktrace

app/controllers/dois_controller.rb:161 - set_doi

View full stacktrace

Created by Martin Fenner via Bugsnag

send sign in link

Given a username, send link to sign in via the contact_email. Should be a JWT

can't modify frozen string for landing page info

Error in Client API

RuntimeError in dois#status
can't modify frozen String

View on Bugsnag

Stacktrace

app/models/concerns/checkable.rb:13 - get_landing_page_info
app/controllers/dois_controller.rb:139 - status

View full stacktrace

Created by Martin Fenner via Bugsnag

Errno::ECONNREFUSED in clients#show

Error in Client API

Errno::ECONNREFUSED in clients#show
Failed to open TCP connection to ecs.datacite.org:42463 (Connection refused - connect(2) for "10.0.20.182" port 42463)

View on Bugsnag

Stacktrace

app/models/ability.rb:38 - initialize
app/controllers/application_controller.rb:53 - new
app/controllers/application_controller.rb:53 - current_ability
app/controllers/clients_controller.rb:72 - show

View full stacktrace

Created by Kristian Garza via Bugsnag

ArgumentError in dois#validate

Error in Client API

ArgumentError in dois#validate
invalid byte sequence in UTF-8

View on Bugsnag

Stacktrace

app/models/concerns/crosscitable.rb:98 - new
app/models/concerns/crosscitable.rb:98 - xml=
app/controllers/dois_controller.rb:62 - validate

View full stacktrace

Created by Martin Fenner via Bugsnag

DataCite XML should not be converted

ActiveRecord::ValueTooLong in UrlJob@default

Error in Client API

ActiveRecord::ValueTooLong in UrlJob@default
Mysql2::Error: Data too long for column 'url' at row 1: UPDATE dataset SET dataset.url = 'http://core.tdar.org/document/365177/new-york-african-burial-ground-skeletal-biology-final-report-volume-1-chapter-5-origins-of-the-new-york-african-burial-ground-population-biological-evidence-of-geographical-and-macroethnic-affiliations-using-craniometrics-dental-morphology-and-preliminary-genetic-analysis' WHERE dataset.id = 857825

View on Bugsnag

Stacktrace

app/models/doi.rb:179 - set_url
app/jobs/url_job.rb:10 - perform

View full stacktrace

Created by Martin Fenner via Bugsnag

Support validation against specific minor schema versions

Error in Client API

Errno::ENOENT in dois#update
No such file or directory @ rb_sysopen - /home/app/webapp/vendor/bundle/ruby/2.4.0/gems/bolognese-0.10.22/resources/kernel-4.0/metadata.xsd

View on Bugsnag

Stacktrace

app/models/concerns/crosscitable.rb:156 - validation_errors
app/models/concerns/crosscitable.rb:179 - validation_errors?
app/controllers/dois_controller.rb:132 - update

View full stacktrace

Created by Martin Fenner via Bugsnag

Error generating description in codemeta

Error in Client API

TypeError in index#show
no implicit conversion of String into Integer

View on Bugsnag

Stacktrace

config/initializers/mime_types.rb:39 - block (2 levels) in <main>
app/controllers/index_controller.rb:24 - block (2 levels) in show
app/controllers/index_controller.rb:12 - show

View full stacktrace

Created by Martin Fenner via Bugsnag

ActiveRecord::RecordNotUnique in client_prefixes#create

Error in Client API

ActiveRecord::RecordNotUnique in client_prefixes#create
Mysql2::Error: Duplicate entry '31716-32025' for key 'index_datacentre_prefixes_on_datacentre_and_prefixes': INSERT INTO datacentre_prefixes (datacentre, prefixes, id, created_at, updated_at, allocator_prefixes) VALUES (31716, 32025, 2899362415986606080, '2018-06-22 00:35:00', '2018-06-22 00:35:00', 970006206896668672)

View on Bugsnag

Stacktrace

app/controllers/client_prefixes_controller.rb:69 - create

View full stacktrace

Created by Martin Fenner via Bugsnag

Nested routes for media and metadata

This makes navigation and authentication simpler.

Investigate current adoption of GraphQL

IF we use GraphQL as opposed to JSONAPI REST.
What do we need to investigate

Send password reset emails as html

We need to inline the css and use the premailer gem for that.

Use Logstash json for logging

makes it easier to parse logs. Will work with Logstash.

Child to datacite/datacite#378.

Response code 403 for failed authorizations

check role-based permissions
send appropriate response with 403 status if authentication fails

Handle registration not triggered

Under some circumstances, a handle registration is not triggered for a new DOI.

Front conversations

DOI registration in handle system fails

Sometimes DOIs are not properly registered in the handle system.

Front conversations

ArgumentError in data_centers#index

Error in Client API

ArgumentError in data_centers#index
wrong number of arguments (given 0, expected 2)

View on Bugsnag

Stacktrace

app/controllers/concerns/facetable.rb:5 - client_year_facet
app/controllers/data_centers_controller.rb:35 - index

View full stacktrace

Created by Martin Fenner via Bugsnag

Basic Elasticsearch setup

Setup Elasticsearch for Provider, Client, Doi and Prefix model. This will make https://github.com/datacite/levriero obsolete.

Enable upserts for DOIs

Create feature/Spec data center api

Support MDS Doi methods

URL lookup using maremma

Replace handler-rest fro mareman

reduce timeout value when talking to handle server

Currently using the timeout default of 60 sec, should be 3 sec to not block upstream services. Currently this API call takes around 100 ms.

Lupo Feedback integration

NoMethodError in prefixes#index

Error in Client API

NoMethodError in prefixes#index
undefined method `where' for #Elasticsearch::Model::Response::Response:0x00007fda96d2a7d0

View on Bugsnag

Stacktrace

app/controllers/prefixes_controller.rb:30 - index

View full stacktrace

Created by Martin Fenner via Bugsnag

Front conversations

Handle lock timeout errors when setting state

ExampleException in home#example

Test error in Example.com

ExampleException in home#example
Something really bad happened

View on Bugsnag

Stacktrace

app/controllers/home_controller.rb:123 - example
app/controllers/other_controller.rb:12 - broken
lib/important/magic.rb:4 - load_something

View full stacktrace

Created by Martin Fenner via Bugsnag

ActionController::UnpermittedParameters in sessions#create: refresh token

Error in Client API

ActionController::UnpermittedParameters in sessions#create
found unpermitted parameter: :refresh_token

View on Bugsnag

Stacktrace

app/controllers/sessions_controller.rb:43 - safe_params
app/controllers/sessions_controller.rb:3 - create

View full stacktrace

Created by Martin Fenner via Bugsnag

make sure DOIs are saved in uppercase

The MDS assumes uppercase DOIs.

correctly delete DOIs with test prefix

Delete DOIs with prefix 10.5072 created more than one month ago.

Front conversations

Review Lupo code

Allow queries of resource-type

Instead of only all and by id.

Develop tests data center API

Elastic search add rake tasks

Halloween

batch reindex
providers
clients

Xmas

dois
media
add prefixes

Enable feature flags

Enable or disable features or parts of your application, ideally without re-deploying or changing anything in your code base.

DEV NOTES

use flipper gem

datacite / lupo Goto Github PK

lupo's Introduction

DataCite REST API

Installation

Development

Note on Patches/Pull Requests

License

lupo's People

Contributors

Stargazers

Watchers

Forkers

lupo's Issues

Error in Client API

Stacktrace

Error in Client API

Stacktrace

Error in Client API

Stacktrace

Error in Client API

Stacktrace

Error in Client API

Stacktrace

Error in Client API

Stacktrace

Error in Client API

Stacktrace

Error in Client API

Stacktrace

Error in Client API

Stacktrace

Error in Client API

Stacktrace

Test error in Example.com

Stacktrace

Error in Client API

Stacktrace

DEV NOTES

Recommend Projects

Recommend Topics

Recommend Org