17 Pull requests merged by 9 people

• Add ArrowError::ArithmeticError

  #6130 merged Jul 26, 2024

• Add support for level histograms added in PARQUET-2261 to ParquetMetaData

  #6105 merged Jul 26, 2024

• Merge 53.0.0-dev dev branch to main

  #6126 merged Jul 26, 2024

• Fix clippy in object_store crate

  #6120 merged Jul 25, 2024

• Fix Clippy for the Rust 1.80 release

  #6116 merged Jul 25, 2024

• added a flush method to IPC writers

  #6108 merged Jul 25, 2024

• Prepare 52.2.0 release

  #6110 merged Jul 24, 2024

• Deprecate read_page_locations() and simplify offset index in ParquetMetaData

  #6095 merged Jul 23, 2024

• Update pyo3 requirement from 0.21.1 to 0.22.2

  #6085 merged Jul 23, 2024

• Implement specialized min/max for GenericBinaryView (StringView and BinaryView)

  #6089 merged Jul 23, 2024

• Faster GenericByteView construction

  #6102 merged Jul 23, 2024

• Optimize bool_or using max_boolean

  #6100 merged Jul 23, 2024

• Add benchmark to track byte-view construction performance

  #6101 merged Jul 22, 2024

• Optimize max_boolean by operating on u64 chunks

  #6098 merged Jul 22, 2024

• fix panic in ParquetMetadata::memory_size: check has_min_max_set before invoking min()/max()

  #6092 merged Jul 20, 2024

• Add PartialEq to ParquetMetaData and FileMetadata

  #6082 merged Jul 19, 2024

• Add unencoded_byte_array_data_bytes to ParquetMetaData

  #6068 merged Jul 19, 2024

9 Pull requests opened by 6 people

• Binary / row helpers

  #6096 opened Jul 19, 2024

• No longer write Parquet column metadata after column chunks *and* in the footer

  #6117 opened Jul 25, 2024

• improvements to `(i)starts_with` and `(i)ends_with` performance

  #6118 opened Jul 25, 2024

• Update object store MSRV to `1.64`

  #6123 opened Jul 25, 2024

• Minor: Update release schedule in README

  #6125 opened Jul 25, 2024

• Support construct BooleanArray from &[u8]

  #6127 opened Jul 26, 2024

• Improve `LIKE` performance for "contains" style queries

  #6128 opened Jul 26, 2024

• Improve `ILIKE` performance for "contains" style queries where the needle is ASCII

  #6131 opened Jul 26, 2024

• change ipc::reader and writer APIs for consistent buffering

  #6132 opened Jul 26, 2024

10 Issues closed by 4 people

• Tracking for Parquet size statistics

  #5022 closed Jul 26, 2024

• Implement `Into<Arc<dyn Array>>` for `ArrayData`

  #6104 closed Jul 25, 2024

• Clippy in `object_store` crate after upgrade to Rust 1.80

  #6119 closed Jul 25, 2024

• Clippy fails on main after upgrade to rust 1.80

  #6114 closed Jul 25, 2024

• Should ObjectStore sizes be `u64` instead of `usize`?

  #6111 closed Jul 25, 2024

• RecordReader other than Int32Type?

  #6078 closed Jul 23, 2024

• Faster min/max for string/binary view arrays

  #6088 closed Jul 23, 2024

• Improve performance of constructing `ByteView`s for small strings

  #6034 closed Jul 23, 2024

• Release object store minor `0.10.2` ~or major `0.11.0`~ (Mid July 2024)

  #6022 closed Jul 21, 2024

• Panic in `ParquetMetadata::memory_size` if no min/max set

  #6091 closed Jul 20, 2024

12 Issues opened by 8 people

• [DISCUSSION] Parquet Metadata Improvements

  #6129 opened Jul 26, 2024

• Support DoPutStatementIngest from Arrow Flight SQL 17.0

  #6124 opened Jul 25, 2024

• Update object store MSRV to `1.64`

  #6122 opened Jul 25, 2024

• Release object store `0.11.0` (breaking API) date TBD

  #6121 opened Jul 25, 2024

• ColumnMetaData should no longer be written inline with data

  #6115 opened Jul 25, 2024

• Implement date_part for `Interval`

  #6113 opened Jul 25, 2024

• Bug(arrow-row): calling `convert_raw` function cause "offset overflow" panic

  #6112 opened Jul 25, 2024

• String search optimisations

  #6107 opened Jul 24, 2024

• Ability to chunk download from object store

  #6106 opened Jul 24, 2024

• Optimize bool_and in a similar way as bool_or

  #6103 opened Jul 22, 2024

• Allow flushing or non-buffered writes from `arrow::ipc::writer::StreamWriter`

  #6099 opened Jul 21, 2024

• Consistent naming for Parquet page index structures

  #6097 opened Jul 19, 2024

11 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Add `ParquetMetadataWriter` allow ad-hoc encoding of `ParquetMetadata`

  #6000 commented on Jul 26, 2024 • 10 new comments

• Implement date_part for intervals

  #6071 commented on Jul 26, 2024 • 4 new comments

• Unsafe improvements: arrow/{array_reader,buffer}.

  #6025 commented on Jul 24, 2024 • 2 new comments

• Make it easier to treat `Rows` as bytes

  #6063 commented on Jul 19, 2024 • 0 new comments

• Upgrade arrow-flight to tonic 0.12

  #6072 commented on Jul 22, 2024 • 0 new comments

• [EPIC] Implement `StringViewArray` and `BinaryViewArray`

  #5374 commented on Jul 23, 2024 • 0 new comments

• Release arrow-rs / parquet minor version `52.2.0` (August 2024)

  #5998 commented on Jul 24, 2024 • 0 new comments

• Extend support for BYTE_STREAM_SPLIT to FIXED_LEN_BYTE_ARRAY, INT32, and INT64 primitive types

  #6048 commented on Jul 26, 2024 • 0 new comments

• Add `ListViewArray` and `LargeListViewArray` implementation and layout and basic construction

  #5501 commented on Jul 26, 2024 • 0 new comments

• Can object_store on 32-bit systems read ranges in 4GB+ files? (Should we use `u64` vs `usize`)

  #5351 commented on Jul 26, 2024 • 0 new comments

• Add `GenericListViewArray` for `ListView` & `LargeListView`

  #5723 commented on Jul 24, 2024 • 0 new comments