Skip to content

Commit

Permalink
Reduce SortExec memory usage by void constructing single huge batch (#…
Browse files Browse the repository at this point in the history
…2132)

* wip

* workable version

* sort to bench

* use sort2

* Replace

* revert unexpected changes

* iter rework

* minor

* prepare

* avoid evaluating sort columns twice

* revert unrelated changes

* Update datafusion/core/src/physical_plan/sorts/sort.rs

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>

* resolve comments

* refactor a little bit

* assertion

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
  • Loading branch information
yjshen and alamb committed Apr 5, 2022
1 parent 2a4a835 commit ceffb2f
Showing 1 changed file with 310 additions and 40 deletions.

0 comments on commit ceffb2f

Please sign in to comment.