We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Dear all,
When trying to access an element from a numpy structured array in dask, the dask array shape is not correctly estimated.
On my real world use case, I try to read lazily from a binary file using np.frombuffer/dask and then save my variables in a xarray dataset.
Thanks,
import dask.array as da import numpy as np buffer = da.random.randint(10,size=(100,4), dtype=np.uint8) structured_array = da.map_blocks(np.frombuffer, buffer, ">H, >B, >B", dtype=">H, >B, >B") print(structured_array["f1"].shape) # print (100, 4), not ok print(structured_array["f1"].compute().shape) # print (100,), ok
Environment:
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Dear all,
When trying to access an element from a numpy structured array in dask, the dask array shape is not correctly estimated.
On my real world use case, I try to read lazily from a binary file using np.frombuffer/dask and then save my variables in a xarray dataset.
Thanks,
Environment:
The text was updated successfully, but these errors were encountered: