New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ARROW-16846: [Website] June 2022 Rust Apache Arrow and Parquet 16.0.0 Highlights #220
Conversation
Thanks for opening a pull request! Could you open an issue for this pull request on JIRA? Then could you also rename pull request title in the following format?
See also: |
_posts/2022-06-11-rust-16.0.0.md
Outdated
* **Improved usability API**: For example, the [parquet writer now uses `std:io::Write`](https://github.com/apache/arrow-rs/pull/1719)) rather custom `ParquetWriter` trait , making it more interoperable with the rest of the Rust ecosystem and the [projection API is easier to use with nested types](https://github.com/apache/arrow-rs/pull/1716). | ||
* **Rewritten support for nested types (e.g. struct, lists)** : @tustvold has revamped / rewritten support for [reading](https://github.com/apache/arrow-rs/pull/1682_ and [writing](https://github.com/apache/arrow-rs/pull/1746) structured types, improving the support for arbitrary nested schemas, and is 30% faster. | ||
|
||
(TODO maybe a picture / example code to make this blog post less textful) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just highlighting this is still here 😅
_posts/2022-06-11-rust-16.0.0.md
Outdated
Some Major Highlights: | ||
|
||
* **Ecosystem Compatibility**: @viriya has put in a massive effort to improve (and prove) compatibility with other Arrow implementations via the rust IPC integration tests. There have been major improvements for corner cases involving nested structures, nullabulity, nested dictionaries, etc. | ||
* **Safety**: We continue to improve the safety of arrow (checkout README https://github.com/apache/arrow-rs/tree/master/arrow#safety and the module level rustdocs TODO linkaftr 16.0.0 is released ). Among other things, we have added additional validation checking to string kernels https://github.com/apache/arrow-rs/issues/1575 and DecimalArrays (https://github.com/apache/arrow-rs/pull/1767). |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Another todo
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
Closes apache/arrow-rs#1808