Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace SerdeDeDataProvider with BufferProvider #1369

Merged
merged 51 commits into from
Dec 9, 2021
Merged

Conversation

sffc
Copy link
Member

@sffc sffc commented Dec 8, 2021

Fixes #837
Progress on #1107
See #1246

This is a large-ish PR but it is mostly refactoring. I couldn't make it smaller in any meaningful way. I suggest looking at the whole PR rather than commit-by-commit, because my commits are rather messy.

I deleted SerdeDeDataProvider and replaced it with BufferProvider. I also moved the deserialization code from provider_fs and moved it into the core provider crate behind feature flags.

I added a field to DataResponseMetadata that specifies the buffer format for Serde to deserialize.

I did not yet remove the deserialization code from provider_blob. However, the change should be extremely small now. I just wanted to save that for another PR since it affects FFI signatures, and I want to be very careful about how it affects binary size. #1368

Manishearth
Manishearth previously approved these changes Dec 9, 2021
Manishearth
Manishearth previously approved these changes Dec 9, 2021
provider/core/src/serde/de.rs Outdated Show resolved Hide resolved
Manishearth
Manishearth previously approved these changes Dec 9, 2021
@sffc sffc merged commit 1d9ddad into unicode-org:main Dec 9, 2021
@sffc sffc deleted the dp-work branch December 9, 2021 17:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Refactor [Fs/Blob]DataProvider to unify Serde support
2 participants