Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add metadata_size_hint for optimistic fetching of parquet metadata #2946

Merged
merged 6 commits into from Jul 21, 2022
Merged

Add metadata_size_hint for optimistic fetching of parquet metadata #2946

merged 6 commits into from Jul 21, 2022

Commits on Jul 20, 2022

  1. Add metadata_size_hint for optimistic fetching of parquet metadata

    @thinkharderdev
    thinkharderdev committed Jul 20, 2022
    Configuration menu
    Copy the full SHA
    3e84a04 View commit details
    Browse the repository at this point in the history

  2. Formatting

    @thinkharderdev
    thinkharderdev committed Jul 20, 2022
    Configuration menu
    Copy the full SHA
    61f7eb5 View commit details
    Browse the repository at this point in the history

  3. Update datafusion/core/src/datasource/file_format/parquet.rs 

    Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
    @thinkharderdev @alamb
    thinkharderdev and alamb committed Jul 20, 2022
    Configuration menu
    Copy the full SHA
    ecd0cf4 View commit details
    Browse the repository at this point in the history

  4. Update datafusion/core/src/datasource/file_format/parquet.rs 

    Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
    @thinkharderdev @alamb
    thinkharderdev and alamb committed Jul 20, 2022
    Configuration menu
    Copy the full SHA
    97249e1 View commit details
    Browse the repository at this point in the history

  5. PR comments: Guard against size_hint larger than file size and verify… 

    … request counts in unit test
    @thinkharderdev
    thinkharderdev committed Jul 20, 2022
    Configuration menu
    Copy the full SHA
    93c725f View commit details
    Browse the repository at this point in the history

  6. Update datafusion/core/src/datasource/file_format/parquet.rs 

    Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
    @thinkharderdev @alamb
    thinkharderdev and alamb committed Jul 20, 2022
    Configuration menu
    Copy the full SHA
    d027f16 View commit details
    Browse the repository at this point in the history