Nested list levels calculated incorrectly if list has 0 length element #282
Labels
bug
development-process
Related to development process of arrow-rs
parquet
Changes to the parquet crate
Describe the bug
First documented in #270 (comment).
When trying to write some combinations of nested Arrow data to Parquet, we trigger a bounds error on the level calculations.
The most obvious thing that could be going wrong is that we're not correctly accounting for empty list slot vs null list slot.
This is because the error gets triggered around the logic that does this.
To Reproduce
Try the below test:
Expected behavior
The parquet file should be written correctly, and pyarrow or Spark should be able to read the data correctly.
Additional context
Not sure
The text was updated successfully, but these errors were encountered: