$ arrow-ord_

Crate

Name: arrow-ord New version: 57.0.0 Release date: 2025-10-23T11:00:57Z

Crate readme

Short description Native Rust implementation of Apache Arrow and Apache Parquet.

Long description This repository provides the native Rust implementation for Apache Arrow, a popular in-memory columnar format, and Apache Parquet, a columnar file format. It includes core functionality for memory layout, arrays, and low-level computations in the arrow crate. The arrow-flight crate supports the Arrow-Flight IPC protocol, while the parquet crate handles the Parquet file format. Additionally, parquet_derive offers derive macros for RecordWriter/RecordReader for structs. The project follows Semantic Versioning and releases approximately monthly, with major versions no more than once a quarter. It is built and tested with stable Rust, maintaining a rolling MSRV policy.

Features • arrow crate • arrow-flight crate • parquet crate • parquet_derive crate • Semantic Versioning • Rolling MSRV policy • Apache Arrow • Apache Parquet

Code Examples Crate Table

 `arrow`          | Core functionality (memory layout, arrays, low level computations)           | [docs.rs](https://docs.rs/arrow/latest)          | [(README)][arrow-readme]          |
`arrow-flight` | Support for Arrow-Flight IPC protocol                                        | [docs.rs](https://docs.rs/arrow-flight/latest)   | [(README)][flight-readme]         |
`parquet`        | Support for Parquet columnar file format                                     | [docs.rs](https://docs.rs/parquet/latest)        | [(README)][parquet-readme]        |
`parquet_derive` | A crate for deriving RecordWriter/RecordReader for arbitrary, simple structs | [docs.rs](https://docs.rs/parquet-derive/latest) | [(README)][parquet-derive-readme] |

Example of deprecation attribute

 #[deprecated(since = "51.0.0", note = "Use `date_part` instead")]

Links • https://arrow.apache.org/ • https://crates.io/crates/arrow • https://crates.io/crates/parquet • https://crates.io/crates/parquet-derive • https://crates.io/crates/arrow-flight • https://github.com/apache/arrow-rs-object-store • https://arrow.apache.org/rust • https://semver.org/ • https://github.com/apache/arrow-rs/issues/7835 • https://github.com/apache/arrow-rs/milestone/3 • https://github.com/apache/arrow-rs/milestone/5 • https://github.com/apache/arrow-rs/milestone/6 • https://github.com/apache/arrow-rs/issues/5368 • https://github.com/apache/arrow-rs/blob/main/CONTRIBUTING.md#breaking-changes • https://github.com/apache/arrow-rs/issues/6737 • https://crates.io/crates/object-store • arrow/README.md • CONTRIBUTING.md • parquet/README.md • arrow-flight/README.md • https://github.com/apache/datafusion/blob/main/README.md • https://github.com/apache/datafusion-ballista/blob/main/README.md • parquet_derive/README.md • https://crates.io/crates/datafusion • https://crates.io/crates/ballista • https://crates.io/crates/parquet_opendal • https://github.com/apache/opendal/blob/main/integrations/parquet/README.md • https://github.com/apache/arrow-rs-object-store/blob/main/README.md • https://arrow.apache.org/community/ • https://s.apache.org/slack-invite • https://github.com/apache/arrow-rs/discussions • https://discord.gg/YAb2TdazKQ • https://github.com/apache/arrow-rs/issues • https://www.rust-lang.org/ • https://github.com/apache/arrow-rs/tree/57.0.0 • https://github.com/apache/arrow-rs/compare/56.2.0...57.0.0

https://api.github.com/repos/apache/arrow-rs/releases/256648414

Release info

Release version: 57.0.0

Release description This release introduces significant enhancements and breaking changes across the Apache Arrow Rust project. A major breaking change involves the consistent use of Arc<FileEncryptionProperties> throughout the parquet component to align with FileDecryptionProperties, aiming to reduce memory footprint and avoid unnecessary copying when encryption is enabled. This version also sees the introduction of a new arrow-avro crate, bringing Avro support to the project. Enhancements focus on improving the display formatting of various DataType variants, including RunEndEncoded, Map, ListView, LargeListView, Union, and Timestamp, providing clearer and more compact representations. The refactoring of the Thrift encryption and encoding mechanisms within the parquet component has been completed, storing encodings as a bitmask and utilizing a custom Thrift parser for parquet metadata, marking Phase 1 of the Thrift remodel. Additionally, optimizations have been made to convert_row_groups and general memory efficiency for compressed Parquet writers. The pyo3 dependency has been updated to 0.26.0. Several bug fixes address issues related to decimal casting, timestamp parsing, Parquet writer flush operations, and memory consumption.

Code Examples