Skip to content

Conversation

@antekresic
Copy link
Member

Unordered compressed chunks can benefit from batch sorted merge optimization just like ordered chunks can because we sort the batches and merge them during execution time giving us the same results regardless if the batches are overlapping.

@antekresic antekresic added this to the v2.25.0 milestone Dec 12, 2025
@antekresic antekresic self-assigned this Dec 12, 2025
@antekresic antekresic added the enhancement An enhancement to an existing feature for functionality label Dec 12, 2025
@github-actions
Copy link

@melihmutlu, @fabriziomello: please review this pull request.

Powered by pull-review

@antekresic antekresic added the Columnstore Related to the column store / compression label Dec 12, 2025
@codecov
Copy link

codecov bot commented Dec 12, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 82.55%. Comparing base (756efe2) to head (0640307).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #9042      +/-   ##
==========================================
+ Coverage   82.45%   82.55%   +0.10%     
==========================================
  Files         243      243              
  Lines       47938    47912      -26     
  Branches    12234    12230       -4     
==========================================
+ Hits        39525    39554      +29     
- Misses       3544     3545       +1     
+ Partials     4869     4813      -56     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@antekresic antekresic requested a review from akuzm December 23, 2025 10:01
@antekresic antekresic force-pushed the add_bsm_to_unordered branch from 7c1de66 to 8fa2e7d Compare January 14, 2026 12:38
@antekresic antekresic requested a review from a team January 14, 2026 12:38
@antekresic antekresic force-pushed the add_bsm_to_unordered branch from 8fa2e7d to 0640307 Compare January 14, 2026 13:39
Unordered compressed chunks can benefit from batch sorted merge
optimization just like ordered chunks can because we sort the
batches and merge them during execution time giving us the
same results regardless if the batches are overlapping.
Copy link
Member

@akuzm akuzm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So basically we're enabling batch sorted merge on unordered chunks because it doesn't care about this order, only about the per-batch order. Let's explain this a little in the comments.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Columnstore Related to the column store / compression enhancement An enhancement to an existing feature for functionality

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants