-
Notifications
You must be signed in to change notification settings - Fork 1k
Enable BSM on unordered compressed chunks #9042
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
|
@melihmutlu, @fabriziomello: please review this pull request.
|
a3f4792 to
5ae99e1
Compare
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #9042 +/- ##
==========================================
+ Coverage 82.45% 82.55% +0.10%
==========================================
Files 243 243
Lines 47938 47912 -26
Branches 12234 12230 -4
==========================================
+ Hits 39525 39554 +29
- Misses 3544 3545 +1
+ Partials 4869 4813 -56 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
5ae99e1 to
9a73f73
Compare
9a73f73 to
7c1de66
Compare
7c1de66 to
8fa2e7d
Compare
8fa2e7d to
0640307
Compare
Unordered compressed chunks can benefit from batch sorted merge optimization just like ordered chunks can because we sort the batches and merge them during execution time giving us the same results regardless if the batches are overlapping.
akuzm
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
So basically we're enabling batch sorted merge on unordered chunks because it doesn't care about this order, only about the per-batch order. Let's explain this a little in the comments.
Unordered compressed chunks can benefit from batch sorted merge optimization just like ordered chunks can because we sort the batches and merge them during execution time giving us the same results regardless if the batches are overlapping.