Skip to content

fix(parquet_writer): correctly update upper bound #1520

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

Erigara
Copy link
Contributor

@Erigara Erigara commented Jul 17, 2025

Which issue does this PR close?

It fixes issue with not correct upper bound in case of multiple row groups in parquet file.

Closes #1519

What changes are included in this PR?

  • change > to < for updating upper bound
  • adjust test to write multiple row groups per file

Are these changes tested?

I've changed a test so that this code path is activated.

@Erigara Erigara force-pushed the fix/update_stat_max branch 2 times, most recently from 97f6b94 to 57ed320 Compare July 17, 2025 07:45
@Erigara Erigara force-pushed the fix/update_stat_max branch from 57ed320 to 0b1b8a4 Compare July 17, 2025 07:53
@@ -266,7 +266,7 @@ impl MinMaxColAggregator {
self.upper_bounds
.entry(field_id)
.and_modify(|e| {
if *e > datum {
if *e < datum {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice catch! can we also add an unit test for this?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will look into it, now it's tested as part of test_parquet_writer

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

bug(parquet_writer): incorrect upper bound in data file
2 participants