$ parquet_

Crate

Name: parquet New version: 57.0.0 Release date: 2025-10-23T11:00:57Z

Crate readme

Short description Native Rust implementation of Apache Arrow and Apache Parquet

Long description This repository contains the core Rust implementation for Apache Arrow, a popular in-memory columnar format, and Apache Parquet, a columnar file format. It includes crates for core Arrow functionality (memory layout, arrays, computations), support for the Arrow-Flight IPC protocol, and the Parquet columnar file format. A derived crate, parquet_derive, allows deriving RecordWriter/RecordReader for structs. The project follows Semantic Versioning, releasing approximately monthly with major versions at most quarterly. It guarantees a rolling MSRV (minimum supported Rust version) that is at least 6 months old, updated only in major releases. The project generally prefers Result for invalid user input and panics for unrecoverable states.

Features • arrow crate • arrow-flight crate • parquet crate • parquet_derive crate • Semantic Versioning • Rolling MSRV policy • Prefer Result over panic for invalid input

Code Examples Add arrow-rs crates to Cargo.toml

 [dependencies]
arrow = "*"
arrow-flight = "*"
parquet = "*"
parquet_derive = "*"

Example of deprecating an API

 #[deprecated(since = "51.0.0", note = "Use `date_part` instead")]

Links • https://arrow.apache.org/ • https://crates.io/crates/arrow • https://crates.io/crates/parquet • https://crates.io/crates/parquet-derive • https://crates.io/crates/arrow-flight • https://github.com/apache/arrow-rs-object-store • https://docs.rs/arrow/latest • https://docs.rs/arrow-flight/latest • https://docs.rs/parquet/latest • https://docs.rs/parquet-derive/latest • https://arrow.apache.org/rust • https://semver.org/ • https://github.com/apache/arrow-rs/issues/7835 • https://github.com/apache/arrow-rs/milestone/3 • https://github.com/apache/arrow-rs/milestone/5 • https://github.com/apache/arrow-rs/milestone/6 • https://github.com/apache/arrow-rs/issues/5368 • https://github.com/apache/arrow-rs/blob/main/CONTRIBUTING.md#breaking-changes • https://github.com/apache/arrow-rs/issues/6737 • https://crates.io/crates/datafusion • https://crates.io/crates/ballista • https://crates.io/crates/parquet_opendal • https://github.com/apache/opendal/blob/main/integrations/parquet/README.md • https://github.com/apache/arrow-rs-object-store/blob/main/README.md • https://arrow.apache.org/community/ • https://s.apache.org/slack-invite • https://github.com/apache/arrow-rs/discussions • https://discord.gg/YAb2TdazKQ • https://github.com/apache/arrow-rs/issues • https://www.rust-lang.org/ • https://crates.io/crates/object-store • arrow/README.md • CONTRIBUTING.md • parquet/README.md • arrow-flight/README.md • https://github.com/apache/datafusion/blob/main/README.md • https://github.com/apache/datafusion-ballista/blob/main/README.md • parquet_derive/README.md • https://github.com/apache/arrow-rs/tree/57.0.0 • https://github.com/apache/arrow-rs/compare/56.2.0...57.0.0

https://api.github.com/repos/apache/arrow-rs/releases/256648414

Release info

Release version: 57.0.0

Release description Version 57.0.0 introduces significant changes, including breaking ones, primarily within the parquet and arrow crates. A major refactor in the parquet crate, dubbed 'thrift-remodel', aims to improve its Thrift handling by introducing a custom Thrift parser and storing encodings as a bitmask, centralizing this logic in a new thrift module. This version also sees a shift towards using Arc<FileEncryptionProperties> and Arc<FileDecryptionProperties> universally to reduce memory usage and improve consistency, particularly when encryption is enabled. The arrow-avro crate has been enhanced with new features, including support for Avro binary format and improved handling of data types. The 'Variant' related changes continue to expand, with new implementations for various data types and improved integration for shredding and unshredding operations. Display formatting for several DataType variants has been refined for better readability. Additionally, dependency updates, such as bumping pyo3 to 0.26.0, are included. This release addresses numerous bugs and performance enhancements, demonstrating a strong focus on stability, efficiency, and expanding the capabilities of the Arrow ecosystem.

Code Examples