Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for np.take_along_axis? #443

Closed
phizaz opened this issue Jun 10, 2019 · 4 comments
Closed

Support for np.take_along_axis? #443

phizaz opened this issue Jun 10, 2019 · 4 comments

Comments

@phizaz
Copy link

phizaz commented Jun 10, 2019

Numpy take_along_axis reference: https://docs.scipy.org/doc/numpy/reference/generated/numpy.take_along_axis.html

I have found a use for zarr in reinforcement learning which needs to keep a good size of array in memory. Fortunately, this array is very compressible. I think it could make a good use of a library like zarr. For some reason, take_along_axis is important for generalization of code to larger settings. I am here to request such feature.

Thank you.

@jakirkham
Copy link
Member

Have you taken a look at Dask? Many users of Zarr use it in conjunction with Dask to have efficient array storage in conjunction with a NumPy-like API.

@phizaz
Copy link
Author

phizaz commented Jun 10, 2019

@jakirkham I have taken a look, but it seems unclear to me how can I use zarr as underlying storage for dask. Would be much appreciated if you point out a direction!

@jakirkham
Copy link
Member

If you have an existing Zarr Array (z), you can create a Dask Array (d) like so.

import dask.array as da
d = da.from_array(z, chunks=z.chunks)

@phizaz
Copy link
Author

phizaz commented Jun 10, 2019

@jakirkham It seems that take_along_axis is not supported by dask at the moment. Refer: dask/dask#3663.

@phizaz phizaz closed this as completed Jun 10, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants