CHANGELOG.md

Changelog

29.0.0 (2022-12-09)

Full Changelog

Breaking changes:

• Minor: Allow Field::new and Field::new_with_dict to take existing String as well as &str #3288 [arrow] (alamb)
• update &Option<T> to Option<&T> #3249 [parquet] [arrow] (Jimexist)
• Hide *_dict_scalar kernels behind *_dyn kernels #3202 [arrow] (viirya)

Implemented enhancements:

• Support writing BloomFilter in arrow_writer #3275 [parquet]
• Support casting from unsigned numeric to Decimal256 #3272 [arrow]
• Support casting from Decimal256 to float types #3266 [arrow]
• Make arithmetic kernels supports DictionaryArray of DecimalType #3254 [arrow]
• Casting from Decimal256 to unsigned numeric #3239 [arrow]
• precision is not considered when cast value to decimal #3223 [arrow]
• Use RegexSet in arrow_csv::infer_field_schema #3211 [arrow]
• Implement FlightSQL Client #3206 [arrow-flight]
• Add binary_mut and try_binary_mut #3143 [arrow]
• Add try_unary_mut #3133 [arrow]

Fixed bugs:

• Skip null buffer when importing FFI ArrowArray struct if no null buffer in the spec #3290 [arrow]
• using ahash compile-time-rng kills reproducible builds #3271 [parquet]
• Decimal128 to Decimal256 Overflows #3265 [arrow]
• nullif panics on empty array #3261 [arrow]
• Some more inconsistency between can_cast_types and cast_with_options #3250 [arrow]
• Enable casting between Dictionary of DecimalArray and DecimalArray #3237 [arrow]
• new_null_array Panics creating StructArray with non-nullable fields #3226 [arrow]
• bool should cast from/to Float16Type as can_cast_types returns true #3221 [arrow]
• Utf8 and LargeUtf8 cannot cast from/to Float16 but can_cast_types returns true #3220 [arrow]
• Re-enable some tests in arrow-cast crate #3219 [arrow]
• Off-by-one buffer size error triggers Panic when constructing RecordBatch from IPC bytes (should return an Error) #3215 [arrow]
• arrow to and from pyarrow conversion results in changes in schema #3136 [arrow]

Documentation updates:

• better document when we need LargeUtf8 instead of Utf8 #3228 [arrow]

Merged pull requests:

• Use BufWriter when writing bloom filters and limit tests (#3318) #3319 [parquet] (tustvold)
• Use take for dictionary like comparisons #3313 [arrow] (tustvold)
• Update versions to 29.0.0 and update CHANGELOG #3315 [parquet] [arrow] [arrow-flight] (alamb)
• refactor: Merge similar functions ilike_scalar and nilike_scalar #3303 [arrow] (askoa)
• Split out arrow-ord (#2594) #3299 [arrow] (tustvold)
• Split out arrow-string (#2594) #3295 [arrow] (tustvold)
• Skip null buffer when importing FFI ArrowArray struct if no null buffer in the spec #3293 [arrow] (viirya)
• Don't use dangling NonNull as sentinel #3289 [arrow] (tustvold)
• Set bloom filter on byte array #3284 [parquet] (viirya)
• Fix ipc schema custom_metadata serialization #3282 [arrow] (Jefffrey)
• Disable const-random ahash feature on non-WASM (#3271) #3277 [parquet] (tustvold)
• fix(ffi): handle null data buffers from empty arrays #3276 [arrow] (wjones127)
• Support casting from unsigned numeric to Decimal256 #3273 [arrow] (viirya)
• Add parquet-layout binary #3269 [parquet] (tustvold)
• Support casting from Decimal256 to float types #3267 [arrow] (viirya)
• Simplify decimal cast logic #3264 [arrow] (tustvold)
• Fix panic on nullif empty array (#3261) #3263 [arrow] (tustvold)
• Add BooleanArray::from_unary and BooleanArray::from_binary #3258 [arrow] (tustvold)
• Minor: Remove parquet build script #3257 [parquet] (tustvold)
• Make arithmetic kernels supports DictionaryArray of DecimalType #3255 [arrow] (viirya)
• Support List and LargeList in Row format (#3159) #3251 [arrow] (tustvold)
• Don't recurse to children in ArrayData::try_new #3248 [arrow] (tustvold)
• Validate dictionaries read over IPC #3247 [arrow] (tustvold)
• Fix MapBuilder example #3246 [arrow] (tustvold)
• Loosen nullability restrictions added in #3205 (#3226) #3244 [arrow] (tustvold)
• Better document implications of offsets (#3228) #3243 [arrow] (tustvold)
• Add new API to validate the precision for decimal array #3242 [arrow] (liukun4515)
• Move nullif to arrow-select (#2594) #3241 [arrow] (tustvold)
• Casting from Decimal256 to unsigned numeric #3240 [arrow] (viirya)
• Enable casting between Dictionary of DecimalArray and DecimalArray #3238 [arrow] (viirya)
• Remove unwraps from 'create_primitive_array' #3232 [arrow] (aarashy)
• Fix CI build by upgrading tonic-build to 0.8.4 #3231 [arrow-flight] (viirya)
• Remove negative scale check #3230 [arrow] (viirya)
• Update prost-build requirement from =0.11.2 to =0.11.3 #3225 [arrow-flight] (dependabot[bot])
• Get the round result for decimal to a decimal with smaller scale #3224 [arrow] (liukun4515)
• Move tests which require chrono-tz feature from arrow-cast to arrow #3222 [arrow] (viirya)
• add test cases for extracing week with/without timezone #3218 [arrow] (waitingkuo)
• Use RegexSet for matching DataType #3217 [arrow] (askoa)
• Update tonic-build to 0.8.3 #3214 [arrow-flight] (tustvold)
• Support StructArray in Row Format (#3159) #3212 [arrow] (tustvold)
• Infer timestamps from CSV files #3209 [arrow] (Jefffrey)
• fix bug: cast decimal256 to other decimal with no-safe #3208 [arrow] (liukun4515)
• FlightSQL Client & integration test #3207 [arrow-flight] (avantgardnerio)
• Ensure StructArrays check nullability of fields #3205 [arrow] (Jefffrey)
• Remove special case ArrayData equality for decimals #3204 [arrow] (tustvold)
• Add a cast test case for decimal negative scale #3203 [arrow] (viirya)
• Move zip and shift kernels to arrow-select #3201 [arrow] (tustvold)
• Deprecate limit kernel #3200 [arrow] (tustvold)
• Use SlicesIterator for ArrayData Equality #3198 [arrow] (viirya)
• Add _dyn kernels of like, ilike, nlike, nilike kernels for dictionary support #3197 [arrow] (viirya)
• Adding scalar nlike_dyn, ilike_dyn, nilike_dyn kernels #3195 [arrow] (psvri)
• Use self capture in DataType #3190 [arrow] (tustvold)
• To pyarrow with schema #3188 [arrow] (doki23)
• Support Duration in array_value_to_string #3183 [arrow] (psvri)
• Support FixedSizeBinary in Row format #3182 [arrow] (tustvold)
• Add binary_mut and try_binary_mut #3144 [arrow] (viirya)
• Add try_unary_mut #3134 [arrow] (viirya)

* This Changelog was automatically generated by github_changelog_generator