CHANGELOG.md

Changelog

17.0.0 (2022-06-24)

Full Changelog

Breaking changes:

• Add validation to RecordBatch for non-nullable fields containing null values #1890 [arrow] (andygrove)
• Rename ArrayData::validate_dict_offsets to ArrayData::validate_values #1889 [arrow] (frolovdev)
• Add Decimal128 API and use it in DecimalArray and DecimalBuilder #1871 [parquet] [arrow] (viirya)
• Mark typed buffer APIs safe (#996) (#1027) #1866 [parquet] [arrow] (tustvold)

Implemented enhancements:

• add a small doc example showing ArrowWriter being used with a cursor #1927 [parquet]
• Support cast to/from NULL and DataType::Decimal #1921 [arrow]
• Add Decimal256 API #1913 [arrow]
• Add DictionaryArray::key function #1911 [arrow]
• Support specifying capacities for ListArrays in MutableArrayData #1884 [arrow]
• Explicitly declare the features used for each dependency #1876 [parquet] [arrow] [arrow-flight]
• Add Decimal128 API and use it in DecimalArray and DecimalBuilder #1870 [arrow]
• PrimitiveArray::from_iter should omit validity buffer if all values are valid #1856 [arrow]
• Add from(v: Vec<Option<&[u8]>>) and from(v: Vec<&[u8]>) for FixedSizedBInaryArray #1852 [arrow]
• Add Vec-inspired APIs to BufferBuilder #1850 [arrow]
• PyArrow intergation test for C Stream Interface #1847 [arrow]
• Add nilike support in comparison #1845 [arrow]
• Split up arrow::array::builder module #1843 [arrow]
• Add quarter support in temporal kernels #1835 [arrow]
• Rename ArrayData::validate_dictionary_offset to ArrayData::validate_values #1812 [arrow]
• Clean up the testing code for substring kernel #1801 [arrow]
• Speed up substring_by_char kernel #1800 [arrow]

Fixed bugs:

• unable to write parquet file with UTC timestamp #1932 [parquet]
• Incorrect max and min decimals #1916 [arrow]
• dynamic_types example does not print the projection #1902 [arrow]
• log2(0) panicked at 'attempt to subtract with overflow', parquet/src/util/bit_util.rs:148:5 #1901 [parquet]
• Final slicing in combine_option_bitmap needs to use bit slices #1899 [arrow]
• Dictionary IPC writer writes incorrect schema #1892 [arrow]
• Creating a RecordBatch with null values in non-nullable fields does not cause an error #1888 [arrow]
• Upgrade regex dependency #1874 [arrow]
• Miri reports leaks in ffi tests #1872 [arrow]
• AVX512 + simd binary and/or kernels slower than autovectorized version #1829 [arrow]

Documentation updates:

• Blog post about arrow 10.0.0 - 16.0.0 #1808
• Add README for the compute module. #1940 [arrow] (HaoYang670)
• minor: clarify docstring on DictionaryArray::lookup_key #1910 [arrow] (alamb)
• minor: add a diagram to docstring for DictionaryArray #1909 [arrow] (alamb)
• Closes #1902: Print the original and projected RecordBatch in dynamic_types example #1903 [arrow] (martin-g)

Closed issues:

• how read/write REPEATED #1886 [parquet]
• Handling Unsupported Arrow Types in Parquet #1666 [parquet]

Merged pull requests:

• Set adjusted to UTC if UTC timezone (#1932) #1937 [parquet] (tustvold)
• Split up parquet::arrow::array_reader (#1483) #1933 [parquet] (tustvold)
• Add ArrowWriter doctest (#1927) #1930 [parquet] (tustvold)
• Update indexmap dependency #1929 [arrow] (tustvold)
• Complete and fixup split of arrow::array::builder module (#1843) #1928 [arrow] (tustvold)
• MINOR: Replace checked_add/sub().unwrap() with +/- #1924 [arrow] (HaoYang670)
• Support casting NULL to/from Decimal #1922 [arrow] (liukun4515)
• Update half requirement from 1.8 to 2.0 #1919 [arrow] (dependabot[bot])
• Fix max and min decimal for max precision #1917 [arrow] (viirya)
• Add Decimal256 API #1914 [arrow] (viirya)
• Add DictionaryArray::key function #1912 [arrow] (alamb)
• Fix misaligned reference and logic error in crc32 #1906 [parquet] (saethlin)
• Refine the bit_util of Parquet. #1905 [parquet] (HaoYang670)
• Use bit_slice in combine_option_bitmap #1900 [arrow] (jhorstmann)
• Issue #1876: Explicitly declare the used features for each dependency in integration_testing #1898 (martin-g)
• Issue #1876: Explicitly declare the used features for each dependency in parquet_derive_test #1897 [parquet] (martin-g)
• Issue #1876: Explicitly declare the used features for each dependency in parquet_derive #1896 (martin-g)
• Issue #1876: Explicitly declare the used features for each dependency in parquet #1895 [parquet] (martin-g)
• Minor: Add examples to docstring for weekday #1894 [arrow] (alamb)
• Correct nullable in read_dictionary #1893 [arrow] (viirya)
• Feature add weekday temporal kernel #1891 [arrow] (nl5887)
• Support specifying list capacities for MutableArrayData #1885 [arrow] (jhorstmann)
• Issue #1876: Explicitly declare the used features for each dependency in parquet #1881 [parquet] (martin-g)
• Issue #1876: Explicitly declare the used features for each dependency in arrow-flight #1880 [arrow-flight] (martin-g)
• Split up arrow::array::builder module (#1843) #1879 [arrow] (DaltonModlin)
• Fix memory leak in ffi test #1878 [arrow] (viirya)
• Issue #1876 - Explicitly declare the used features for each dependency #1877 [arrow] (martin-g)
• Fixes #1874 - Upgrade regex dependency to 1.5.6 #1875 [arrow] (martin-g)
• Do not print exit code from miri, instead it should be the return value of the script #1873 (jhorstmann)
• Update vendored gRPC #1869 [arrow-flight] (tustvold)
• Expose BitSliceIterator and BitIndexIterator (#1864) #1865 [arrow] (tustvold)
• Exclude some long-running tests when running under miri #1863 [arrow] (jhorstmann)
• Add vec-inspired APIs to BufferBuilder (#1850) #1860 [arrow] (tustvold)
• Omit validity buffer in PrimitiveArray::from_iter when all values are valid #1859 [arrow] (jhorstmann)
• Add two from methods for FixedSizeBinaryArray #1854 [arrow] (HaoYang670)
• Clean up the test code of substring kernel. #1853 [arrow] (HaoYang670)
• Add PyArrow integration test for C Stream Interface #1848 [arrow] (viirya)
• Add nilike support in comparison #1846 [arrow] (MazterQyou)
• MINOR: Remove version check from test_command_help #1844 [parquet] (viirya)
• Implement UnionArray FieldData using Type Erasure #1842 [arrow] (tustvold)
• Add quarter support in temporal #1836 [arrow] (MazterQyou)
• speed up substring_by_char by about 2.5x #1832 [arrow] (HaoYang670)
• Remove simd and avx512 bitwise kernels in favor of autovectorization #1830 [arrow] (jhorstmann)
• Refactor parquet::arrow module #1827 [parquet] (tustvold)
• docs: remove experimental marker on C Stream Interface #1821 [arrow] (wjones127)
• Separate Page IO from Page Decode #1810 [parquet] (tustvold)

* This Changelog was automatically generated by github_changelog_generator