-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
daily processing pipeline #405
Conversation
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## master #405 +/- ##
==========================================
- Coverage 75.81% 71.19% -4.63%
==========================================
Files 68 75 +7
Lines 7262 7800 +538
==========================================
+ Hits 5506 5553 +47
- Misses 1756 2247 +491 ☔ View full report in Codecov by Sentry. 🚨 Try these New Features:
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks ok to me.
I'm concerned about out use of context mangers and multiple threads - I don't think they are natively thread aware. Might not be an issue for this PR but brought to my attention based on our conversation the other day and this PR
Also I see the tests are failing? |
0e7c7cf
to
50d6a00
Compare
Co-authored-by: Shane Maloney <[email protected]>
fff77d1
to
437bf93
Compare
create a second processing pipeline to handle not TM packets triggered processing steps
this pipeline runs on a cron bases (once a day?) and performs product creations (fits files)
first included processing is HK-L+ to ANC-ASPECT files