Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Olk perf improvement #395

Open
wants to merge 10 commits into
base: master
Choose a base branch
from
Open

Olk perf improvement #395

wants to merge 10 commits into from

Conversation

sumanth43
Copy link
Contributor

@sumanth43 sumanth43 commented Oct 20, 2022 •
edited

What type of PR is this?

Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line:

kind task

What does this PR do / why do we need it: This PR improves performance of openLooKeng

  1. Increase OrcReader#MAX_BATCH_SIZE to 8196
  2. Improve estimation of row count from partition samples
  3. Replace BigArrays with primitive ones in BigInt aggregation
  4. Replace row-wise DefaultPagePartitioner with ColumnarPagePartitioner
  5. Prioritize Utilization Execution Policy
  6. Improve CBO estimates for correlated columns
  7. Allowing Creation Of Dynamic Filters from Table Scan without Predicates
  8. Make partial aggregation adaptive
  9. Prevent Dead Locks With Prioritize Utilization Execution Policy
  10. Prune CTE with Self Join present in DownStream

Which issue(s) this PR fixes:

Fixes #396

Special notes for your reviewers:

@it-is-a-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: sumanth43
To complete the pull request process, please assign haochending
You can assign the PR to them by writing /assign @haochending in a comment when ready.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

openLooKeng performance Improvement
2 participants
@sumanth43 @it-is-a-robot