You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Description
As a user I want to schedule uploads of my datasets by selecting a folder. Uploads should happen in parallel (or sequence) for different datasets. The upload should pick the next dataset(s) in the queue to be uploaded. The path within the s3 bucket can be specified.
Solution proposals
Goroutines provide a good way to schedule tasks by using pipelines with Bounded parallelism. https://go.dev/blog/pipelines
Definition of Done
Multiple folders can be selected by a frontend and the contents will be uploaded to a minio bucket.
The text was updated successfully, but these errors were encountered:
Description
As a user I want to schedule uploads of my datasets by selecting a folder. Uploads should happen in parallel (or sequence) for different datasets. The upload should pick the next dataset(s) in the queue to be uploaded. The path within the s3 bucket can be specified.
Solution proposals
Goroutines provide a good way to schedule tasks by using pipelines with Bounded parallelism.
https://go.dev/blog/pipelines
Definition of Done
Multiple folders can be selected by a frontend and the contents will be uploaded to a minio bucket.
The text was updated successfully, but these errors were encountered: