allenneuraldynamics / aind-data-transfer-models Goto Github PK

Is your feature request related to a problem? Please describe.
Currently, a lot of code is being done to translate the configs set in the ui into the request being sent to the backend. We should explicitly manage the configs in a class.

Describe the solution you'd like
Add a SubmitJobRequest class with the following fields:

• user_email
• notificiation_type
• List[BasicUploadJobConfigs]

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Is your feature request related to a problem? Please describe.
We should add a cap to the number of jobs a user can submit in a single request to avoid blocking the queue for other users without confirmation

Describe the solution you'd like
Add a max_items of 1000 to the list in the submit_job_request

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Is your feature request related to a problem? Please describe.
Airflow parses the BasicUploadConfigs for each pipeline run.

Describe the solution you'd like
It will be nice if the user email is set in the BasicUploadConfigs class in addition to the SubmitJobRequest. The email in the SubmitJobRequest can be used to set all the other ones.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Is your feature request related to a problem? Please describe.
When a user needs to run a custom pipeline, they need to define an input data mount in addition to the process_capsule_id field

Describe the solution you'd like
An input_data_mount field

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Describe the bug
A user should be able to add custom slurm configs when running modality compression scripts. However, the slurm settings is using V0036JobSubmission, which is different.