Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge 53.0.0-dev dev branch to main #6126

Merged
merged 14 commits into from
Jul 26, 2024
Merged

Merge 53.0.0-dev dev branch to main #6126

merged 14 commits into from
Jul 26, 2024

Commits on Jul 16, 2024

  1. bump tonic to 0.12 and prost to 0.13 for arrow-flight (#6041)

    * bump `tonic` to 0.12 and `prost` to 0.13 for `arrow-flight`
    
    Signed-off-by: Bugen Zhao <i@bugenzhao.com>
    
    * fix example tests
    
    Signed-off-by: Bugen Zhao <i@bugenzhao.com>
    
    ---------
    
    Signed-off-by: Bugen Zhao <i@bugenzhao.com>
    BugenZhao authored Jul 16, 2024
    Configuration menu
    Copy the full SHA
    741bbf6 View commit details
    Browse the repository at this point in the history
  2. Remove impl<T: AsRef<[u8]>> From<T> for Buffer that easily accident…

    …ally copies data (#6043)
    
    * deprecate auto copy, ask explicit reference
    
    * update comments
    
    * make cargo doc happy
    XiangpengHao authored Jul 16, 2024
    Configuration menu
    Copy the full SHA
    8f76248 View commit details
    Browse the repository at this point in the history
  3. Make display of interval types more pretty (#6006)

    * improve dispaly for interval.
    
    * update test in pretty, and fix display problem.
    
    * tmp
    
    * fix tests in arrow-cast.
    
    * fix tests in pretty.
    
    * fix style.
    Rachelint authored Jul 16, 2024
    Configuration menu
    Copy the full SHA
    bb5f12b View commit details
    Browse the repository at this point in the history
  4. Update snafu (#5930)

    Jesse-Bakker authored Jul 16, 2024
    Configuration menu
    Copy the full SHA
    756b1fb View commit details
    Browse the repository at this point in the history
  5. Update Parquet thrift generated structures (#6045)

    * update to latest thrift (as of 11 Jul 2024) from parquet-format
    
    * pass None for optional size statistics
    
    * escape HTML tags
    
    * don't need to escape brackets in arrays
    etseidl authored Jul 16, 2024
    Configuration menu
    Copy the full SHA
    fe04e09 View commit details
    Browse the repository at this point in the history
  6. Revert "Revert "Write Bloom filters between row groups instead of the…

    … end (#…" (#5933)
    
    This reverts commit 22e0b44.
    alamb authored Jul 16, 2024
    Configuration menu
    Copy the full SHA
    2e7f7ef View commit details
    Browse the repository at this point in the history
  7. Revert "Update snafu (#5930)" (#6069)

    This reverts commit 756b1fb.
    alamb authored Jul 16, 2024
    Configuration menu
    Copy the full SHA
    effccc1 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2024

  1. Update pyo3 requirement from 0.21.1 to 0.22.1 (fixed) (#6075)

    * Update pyo3 requirement from 0.21.1 to 0.22.1
    
    Updates the requirements on [pyo3](https://github.com/pyo3/pyo3) to permit the latest version.
    - [Release notes](https://github.com/pyo3/pyo3/releases)
    - [Changelog](https://github.com/PyO3/pyo3/blob/main/CHANGELOG.md)
    - [Commits](PyO3/pyo3@v0.21.1...v0.22.1)
    
    ---
    updated-dependencies:
    - dependency-name: pyo3
      dependency-type: direct:production
    ...
    
    Signed-off-by: dependabot[bot] <support@github.com>
    
    * refactor: remove deprecated `FromPyArrow::from_pyarrow`
    
    "GIL Refs" are being phased out.
    
    * chore: update `pyo3` in integration tests
    
    ---------
    
    Signed-off-by: dependabot[bot] <support@github.com>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    crepererum and dependabot[bot] authored Jul 17, 2024
    Configuration menu
    Copy the full SHA
    649d09d View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2024

  1. Configuration menu
    Copy the full SHA
    05e681d View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2024

  1. Add unencoded_byte_array_data_bytes to ParquetMetaData (#6068)

    * update to latest thrift (as of 11 Jul 2024) from parquet-format
    
    * pass None for optional size statistics
    
    * escape HTML tags
    
    * don't need to escape brackets in arrays
    
    * add support for unencoded_byte_array_data_bytes
    
    * add comments
    
    * change sig of ColumnMetrics::update_variable_length_bytes()
    
    * rename ParquetOffsetIndex to OffsetSizeIndex
    
    * rename some functions
    
    * suggestion from review
    
    Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
    
    * add Default trait to ColumnMetrics as suggested in review
    
    * rename OffsetSizeIndex to OffsetIndexMetaData
    
    ---------
    
    Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
    etseidl and alamb authored Jul 19, 2024
    Configuration menu
    Copy the full SHA
    e40b311 View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2024

  1. Update pyo3 requirement from 0.21.1 to 0.22.2 (#6085)

    Updates the requirements on [pyo3](https://github.com/pyo3/pyo3) to permit the latest version.
    - [Release notes](https://github.com/pyo3/pyo3/releases)
    - [Changelog](https://github.com/PyO3/pyo3/blob/v0.22.2/CHANGELOG.md)
    - [Commits](PyO3/pyo3@v0.21.1...v0.22.2)
    
    ---
    updated-dependencies:
    - dependency-name: pyo3
      dependency-type: direct:production
    ...
    
    Signed-off-by: dependabot[bot] <support@github.com>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jul 23, 2024
    Configuration menu
    Copy the full SHA
    81c34ac View commit details
    Browse the repository at this point in the history
  2. Deprecate read_page_locations() and simplify offset index in `Parquet…

    …MetaData` (#6095)
    
    * deprecate read_page_locations
    
    * add to_thrift() to OffsetIndexMetaData
    etseidl authored Jul 23, 2024
    Configuration menu
    Copy the full SHA
    3bc9987 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2024

  1. Configuration menu
    Copy the full SHA
    095130f View commit details
    Browse the repository at this point in the history
  2. Update parquet/src/column/writer/mod.rs

    Co-authored-by: Ed Seidl <etseidl@users.noreply.github.com>
    alamb and etseidl authored Jul 25, 2024
    Configuration menu
    Copy the full SHA
    a6353d1 View commit details
    Browse the repository at this point in the history