Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BUG: segfault with pytables tests #42755

Closed
jbrockmendel opened this issue Jul 27, 2021 · 5 comments
Closed

BUG: segfault with pytables tests #42755

jbrockmendel opened this issue Jul 27, 2021 · 5 comments
Labels
Bug IO HDF5 read_hdf, HDFStore Segfault Non-Recoverable Error Upstream issue Issue related to pandas dependency

Comments

@jbrockmendel
Copy link
Member

Started noticing this after doing brew upgrade a couple days ago. Somewhere in pandas/tests/io/test_common.py I get a long warning that starts with

The HDF5 header files used to compile this application do not match
the version used by the HDF5 library to which this application is linked.
Data corruption or segmentation faults may occur if the application continues.
This can happen when an application was compiled by one version of HDF5 but
linked with a different version of static or shared HDF5 library.
You should recompile the application or check your shared library related
settings such as 'LD_LIBRARY_PATH'.
You can, at your own risk, disable this warning by setting the environment
variable 'HDF5_DISABLE_VERSION_CHECK' to a value of '1'.
Setting it to 2 or higher will suppress the warning messages totally.
Headers are 1.12.0, library is 1.12.1

followed by a segfault.

This is likely an upstream issue, but parking this here for now.

@jbrockmendel jbrockmendel added Bug Needs Triage Issue that has not been reviewed by a pandas team member IO HDF5 read_hdf, HDFStore Segfault Non-Recoverable Error and removed Needs Triage Issue that has not been reviewed by a pandas team member labels Jul 27, 2021
@jbrockmendel
Copy link
Member Author

xref PyTables/PyTables#903

@lithomas1
Copy link
Member

Do you use conda? It's possible that conda installed its own hdf5 if you installed pytables with conda.

@jbrockmendel
Copy link
Member Author

pretty much just pip

@mroeschke mroeschke added the Upstream issue Issue related to pandas dependency label Aug 21, 2021
@jbrockmendel
Copy link
Member Author

Solution was to compile from source instead of using a wheel. Discussed in the PyTables/PyTables#903, closing

@sunilshah
Copy link

In native mode, seg fault in tables does occur on M1. Big Sur 11.6.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug IO HDF5 read_hdf, HDFStore Segfault Non-Recoverable Error Upstream issue Issue related to pandas dependency
Projects
None yet
Development

No branches or pull requests

4 participants