globus / globus-sample-data-portal Goto Github PK

• Create client credentials
• List of redirect URLs other than https://localhost:5000/login
• Sign-up flow
• Sign-in flow
• User data persistence (name, email, project)

This should be https://YOUR_IP:5100/api instead of https://localhost:5100/api for hosting AWS EC2 instance.

I have run the example MRDP: https://mrdp.globus.org/ before and successfully transferred data, even just a couple of weeks ago. However, yesterday I started to experience a problem in my own MRDP and wanted to confirm things were still working in the Globus example.
So today, I visit: https://mrdp.globus.org/ and attempt a transfer of one of the airport collections. After clicking Transfer, I am redirected to the Globus page to choose my endpoint. I access my endpoint and I see the "Submit" button, which appears active, but is not. I cannot click on it and there is no way now for me to start up the transfer. This is the same behavior I started to experience with my own MRDP starting yesterday afternoon.
I've been in touch with Kyle Chard who mentioned he noticed there may have been an error on the Globus end, but I dont' have any more details beyond that. Are there any known issues? Does the Globus MRDP https://mrdp.globus.org/ example work for others currently?

I accidentally deleted most of the client secrets associated with the Auth registration for the Sample Data Portal App. You are probably going to need to generate a new secret, and update the config for the app with this new secret.

(The current README talks about Vas' Bottle implementation.)

OS: Windows 10
Python version: 3.10.0

Traceback (most recent call last):
  File "C:\Users\elmim\dev\globus-sample-data-portal\run_portal.py", line 3, in <module>
    from portal import app
  File "C:\Users\elmim\dev\globus-sample-data-portal\portal\__init__.py", line 1, in <module>
    from flask import Flask
  File "C:\Users\elmim\dev\globus-sample-data-portal\venv\lib\site-packages\flask\__init__.py", line 14, in <module>
    from jinja2 import escape
ImportError: cannot import name 'escape' from 'jinja2' (C:\Users\elmim\dev\globus-sample-data-portal\venv\

Updating Flask in requirements.txt to version 2.1.x fixes this issue.

• Shared endpoint where datasets will be stored.
• Shared endpoint where datasets and transformed datasets will be copied.
• Need identity credentials for an access manager so the server can set an ACL

Are we going to use one of the tutorial endpoints (go#ep1/2) or some other endpoint?

Hi, hope this is an appropriate place to ask a question. I am struggling to understand the id entries in the dataset.json file. At first I thought that corresponded to the endpoint id. How is that id used in portal/views.py?
ah these are just any unique URI, I think :) Sorry for the noise

In the future, Globus Auth will support treating a registered client application as a first-class identity via a username/password-style grant using the client ID and client secret.

Today, the demo portal uses refresh tokens to make API calls as a privileged Globus ID identity ([email protected]). Once this functionality becomes available in Globus Auth, we should switch the demo application over to it.

• enable/register the client identity in Globus Auth, if needed
• remove Access Manager rights from [email protected] on the Globus Tutorial HTTPS Server Endpoint and add the new client application identity (this will be something like [email protected])
• remove the refresh token-based method of obtained a portal identity access token and replace it with a client_credentials grant-based method
• move and rephrase the sensitive data warning introduced by #54 to wherever we store client secrets in the repository, e.g. portal/auth.json, service/service.conf

Hi, We have based our data portal on the Globus Modern Research data portal, it's actually listed on your website as an example: https://docs.globus.org/guides/recipes/modern-research-data-portal/ It's the LSSTDESC portal, and actually the link is now data.lsstdesc.org, the current link on your webpage is no longer available.

Anyway, since late 2023, perhaps due to the move to Globus Collection v5, our data portal is no longer able to successfully transfer data. Our endpoint was migrated to a v5 Collection and it is working just fine outside of the portal. I went back to this repo hoping to find some direction on what needs to be fixed and reran the Globus Sample Data Portal https://mrdp.globus.org/ I see the same error "Internal error" here too no matter what destination collection I use. The collections work just fine outside of the sample data portal. Below is a screen shot of what I see when I click transfer:

Is this sample data portal working for everyone else or is there an update that needs to be made? I've been assuming a change needs to happen in declaring the scope.

Any suggestions appreciated!

I have deployed a Globus Data Portal (https://github.com/zonca/cmb-s4-data-portal/) to Spin at NERSC based on the LSST data portal.

I configured the endpoint via the Globus web app so that all users have access just to 1 subfolder, while members of a specific Globus group have also access to another subfolder.

If I access the Endpoint directly from app.globus.org, permissions work fine, the general user cannot see the member only folder.

However, the globus data portal allows the user to browse and even transfer data from the folder that should be forbidden.

Can you please help me understand the issue?

http://werkzeug.pocoo.org/docs/0.11/serving/#ssl
http://flask.pocoo.org/snippets/111/

Vas has a setup script for generating the keys in OpenSSL at ec2/mrdp_ec2_user_data.sh (and had environment setup for this in mrdp_run.sh, although maybe that stuff can just go into mrdp.conf).

Hi,
This file may need to be updated: https://github.com/globus/globus-sample-data-portal/blob/main/portal/static/js/jquery.min.js
This file still references jQuery 3.3.1, but these days jQuery >= 3.6.0 is preferred and some security scans will not pass if it is < 3.6.0
Thanks!
Heather

Things we need:

• Client registration
  • Does a resource server need a redirect_uri? If so, https://localhost:5100/. (answer: it does not).
  • A name. GlobusWorld Resource Server?
  • Its own scope: urn:globus:auth:scope:demo-resource-server:all
  • Client/dependent scope on urn:globus:auth:scope:transfer.api.globus.org:all and urn:globus:auth:scope:tutorial-https-endpoint.globus.org:all (any others?)
• A refresh token from either its own identity or the identity we're using on the MRDP app.
• Its scope (urn:globus:auth:scope:demo-resource-server:all) needs to be whitelisted for all clients.

Other things?

/cc @sirosen

Issue faced when trying to run the Service using python run_service.py.

In Python 3.10 Iterable is imported from collections.abc. Use Python 3.9 or other prior versions.