Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Windows path containing spaces, reading DeltaTable not possible, %20 issue, blocking to use, not able to read #2425

Open
JvdH-NL opened this issue Apr 17, 2024 · 2 comments
Labels
bug Something isn't working

Comments

@JvdH-NL
Copy link

JvdH-NL commented Apr 17, 2024

Environment

  • Library version: deltalake 0.16.4
  • Windows 11 OS, Visual Code, debugging.

Bug

  • running sample script from homepage results in FileNotFoundError in line 10 (dt.to_pandas). Can acknowlegde the write_deltalake part of sample works.
  • Error:
    Exception has occurred: FileNotFoundError
    Object at location C:\Users\USERNAME\OneDrive%20-%20COMPANY%20NAME\Sources\Lakehouse\Delta-rs\data\delta\0-39b94d51-b8a9-46f7-bfc5-7c9996bececf-0.parquet not found: The system cannot find the file specified. (os error 2)
    File "C:\Users\USERNAME\OneDrive - Rapid Circle\Sources\Lakehouse\Delta-rs\quickstart.py", line 10, in
    df2 = dt.to_pandas()
    ^^^^^^^^^^^^^^
    FileNotFoundError: Object at location C:\Users\USERNAME\OneDrive%20-%20COMPANY%20NAME\Sources\Lakehouse\Delta-rs\data\delta\0-39b94d51-b8a9-46f7-bfc5-7c9996bececf-0.parquet not found: The system cannot find the file specified. (os error 2)
  • Sample script used, source: https://github.com/delta-io/delta-rs

_from deltalake import DeltaTable, write_deltalake
import pandas as pd

write some data into a delta table

df = pd.DataFrame({"id": [1, 2], "value": ["foo", "boo"]})
write_deltalake("./data/delta", df)

Load data from the delta table

dt = DeltaTable("./data/delta")
df2 = dt.to_pandas()

assert df.equals(df2)

@JvdH-NL JvdH-NL added the bug Something isn't working label Apr 17, 2024
@JvdH-NL
Copy link
Author

JvdH-NL commented Apr 25, 2024

Validated (yesterday) with 0.17.1 release, still an issue.

@JvdH-NL
Copy link
Author

JvdH-NL commented May 6, 2024

Validated (06-05-2024) with 0.17.3 release, still an issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant