-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Performance optimization in precomp_annotations.subdivide #819
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #819 +/- ##
=========================================
Coverage 100.00% 100.00%
=========================================
Files 142 142
Lines 5958 6011 +53
=========================================
+ Hits 5958 6011 +53 ☔ View full report in Codecov by Sentry. |
37be3ee
to
ce48c45
Compare
Is this one ready for review? |
Yep! |
1392623
to
619b7e1
Compare
Hey @nkemnitz , I pushed some additional changes, but I now hope to quit mucking with this file for a while (and if I do, it'll be in a new branch). Could you please review? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think you could simplify the code and get a speed boost by using batch requests for fetching size and data using CloudFiles
.
Other than that, the single chunk case doesn't seem to be covered by tests, yet.
(substantially speeds up finalization of large annotation files)
fb681f4
to
a93f53d
Compare
(substantially speeds up finalization of large annotation files)