Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

median on dask arrays #2999

Closed
dcherian opened this issue Jun 5, 2019 · 3 comments · Fixed by #3604
Closed

median on dask arrays #2999

dcherian opened this issue Jun 5, 2019 · 3 comments · Fixed by #3604
Labels
topic-dask

Comments

@dcherian
Copy link
Contributor

dcherian commented Jun 5, 2019

Dask has updated it's percentile, quantile implementation: dask/dask#4677

Can we now update our median method to work with dask arrays?
@carolinarias
Copy link

Is anyone working on adding the median method?

@shoyer
Copy link
Member

shoyer commented Jul 29, 2019

Yes, we could do this as long as we’re careful to default to the new algorithms. See also #1524 (comment)

@jkmacc-LANL jkmacc-LANL mentioned this issue Sep 20, 2019
Closed
@stsievert
Copy link

I have a median method over in dask/dask#3819

@stsievert stsievert mentioned this issue Nov 10, 2019
Closed
4 tasks
dcherian added a commit to dcherian/xarray that referenced this issue Dec 7, 2019
@dcherian
Add nanmedian for dask arrays
55dd4eb 
Close pydata#2999
@dcherian dcherian mentioned this issue Dec 7, 2019
Merged
4 tasks
dcherian added a commit that referenced this issue Dec 30, 2019
@dcherian
Add nanmedian for dask arrays (#3604)
b3d3b44 
* Add nanmedian for dask arrays

Close #2999

* Fix tests.

* fix import

* Make sure that we don't rechunk the entire variable to one chunk

by reducing over all dimensions. Dask raises an error when axis=None
but not when axis=range(a.ndim).

* fix tests.

* Update whats-new.rst
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
topic-dask
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add nanmedian for dask arrays dcherian/xarray
4 participants
@shoyer @stsievert @dcherian @carolinarias