Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(query): use arrow-rs write parquet #11473

Closed
wants to merge 19 commits into from
Closed

feat(query): use arrow-rs write parquet #11473

wants to merge 19 commits into from

Conversation

jun0315
Copy link
Collaborator

@jun0315 jun0315 commented May 16, 2023

I hereby agree to the terms of the CLA available at: https://databend.rs/dev/policies/cla/

Summary

arrow-rs is more friendly to the encoding of parquet. Previously, we used the plain format by default, but now arrow-rs can automatically choose a better encoding instead of plain.

Closes #issue

@vercel
Copy link

vercel bot commented May 16, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
databend ✅ Ready (Inspect) Visit Preview 💬 Add feedback May 23, 2023 0:38am

@mergify mergify bot added the pr-feature this PR introduces a new feature to the codebase label May 16, 2023
@RinChanNOWWW RinChanNOWWW added the ci-benchmark Benchmark: run all test label May 22, 2023
@jun0315 jun0315 changed the title feat(query): use arrow-rs read/write parquet feat(query): use arrow-rs write parquet May 22, 2023
@xudong963 xudong963 self-requested a review May 23, 2023 09:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pr-feature this PR introduces a new feature to the codebase
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants