CHANGELOG.md

Changelog

16.0.0 (2022-06-10)

Full Changelog

Breaking changes:

• Seal ArrowNativeType and OffsetSizeTrait for safety (#1028) #1819 [arrow] (tustvold)
• Improve API for csv::infer_file_schema by removing redundant ref #1776 [arrow] (tustvold)

Implemented enhancements:

• List equality method should work on empty offset ListArray #1817 [arrow]
• Command line tool for convert CSV to Parquet #1797 [parquet]
• IPC writer should write validity buffer for UnionArray in V4 IPC message #1793 [arrow]
• Add function for row alignment with page mask #1790 [parquet]
• Rust IPC Read should be able to read V4 UnionType Array #1788 [arrow]
• combine_option_bitmap should accept arbitrary number of input arrays. #1780 [arrow]
• Add substring_by_char kernels for slicing on character boundaries #1768 [arrow]
• Support reading PageIndex from column metadata #1761 [parquet]
• Support casting from DataType::Utf8 to DataType::Boolean #1740 [arrow]
• Make current position available in FileWriter. #1691 [parquet]
• Support writing parquet to stdout #1687 [parquet]

Fixed bugs:

• Incorrect Offset Validation for Sliced List Array Children #1814 [arrow]
• Parquet Snappy Codec overwrites Existing Data in Decompression Buffer #1806 [parquet]
• flight_data_to_arrow_batch does not support RecordBatches with no columns #1783 [arrow-flight]
• parquet does not compile with features=["zstd"] #1630 [parquet]

Documentation updates:

• Update arrow module docs #1840 [arrow] (tustvold)
• Update safety disclaimer #1837 [arrow] (tustvold)
• Update ballista readme link #1765 (tustvold)
• Move changelog archive to CHANGELOG-old.md #1759 (alamb)

Closed issues:

• DataType::Decimal Non-Compliant? #1779 [arrow]
• Further simplify the offset validation #1770 [arrow]
• Best way to convert arrow to Rust native type #1760 [arrow]
• Why Parquet is a part of Arrow? #1715 [parquet] [arrow]

Merged pull requests:

• Make equals_datatype method public, enabling other modules #1838 [arrow] (nl5887)
• [Minor] Clarify PageIterator Documentation #1831 [parquet] (Ted-Jiang)
• Update MIRI pin #1828 (tustvold)
• Change to use resolver v2, test more feature flag combinations in CI, fix errors (#1630) #1822 [parquet] [arrow] (tustvold)
• Add ScalarBuffer abstraction (#1811) #1820 [arrow] (tustvold)
• Fix list equal for empty offset list array #1818 [arrow] (viirya)
• Fix Decimal and List ArrayData Validation (#1813) (#1814) #1816 [arrow] (tustvold)
• Don't overwrite existing data on snappy decompress (#1806) #1807 [parquet] (tustvold)
• Rename arrow/benches/string_kernels.rs to arrow/benches/substring_kernels.rs #1805 [arrow] (HaoYang670)
• Add public API for decoding parquet footer #1804 [parquet] (tustvold)
• Add AsyncFileReader trait #1803 [parquet] (tustvold)
• add parquet-fromcsv (#1) #1798 [parquet] (kazuk)
• Use IPC row count info in IPC reader #1796 [arrow] (viirya)
• Fix typos in the Memory and Buffers section of the docs home #1795 [arrow] (datapythonista)
• Write validity buffer for UnionArray in V4 IPC message #1794 [arrow] (viirya)
• feat:Add function for row alignment with page mask #1791 [parquet] (Ted-Jiang)
• Read and skip validity buffer of UnionType Array for V4 ipc message #1789 [arrow] [arrow-flight] (viirya)
• Add Substring_by_char #1784 [arrow] (HaoYang670)
• Add ParquetFileArrowReader::try_new #1782 [parquet] (tustvold)
• Arbitrary size combine option bitmap #1781 [arrow] (Ismail-Maj)
• Implement ChunkReader for Bytes, deprecate SliceableCursor #1775 [parquet] (tustvold)
• Access metadata of flushed row groups on write (#1691) #1774 [parquet] (tustvold)
• Simplify ParquetFileArrowReader Metadata API #1773 [parquet] (tustvold)
• MINOR: Unpin nightly version as packed_simd releases new version #1771 (viirya)
• Update comfy-table requirement from 5.0 to 6.0 #1769 [arrow] (dependabot[bot])
• Optionally disable validate_decimal_precision check in DecimalBuilder.append_value for interop test #1767 [arrow] (viirya)
• Minor: Clean up the code of MutableArrayData #1763 [arrow] (HaoYang670)
• Support reading PageIndex from parquet metadata, prepare for skipping pages at reading #1762 [parquet] (Ted-Jiang)
• Support casting Utf8 to Boolean #1738 [arrow] (MazterQyou)

* This Changelog was automatically generated by github_changelog_generator