Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for CSV metadata files to ImageFolder #4837

Merged
merged 9 commits into from Aug 31, 2022
Merged

Add support for CSV metadata files to ImageFolder #4837

merged 9 commits into from Aug 31, 2022

Conversation

mariosasko
Copy link
Contributor

Fix #4814

@HuggingFaceDocBuilderDev
Copy link

HuggingFaceDocBuilderDev commented Aug 12, 2022

The documentation is not available anymore as the PR was closed or merged.

@lhoestq
Copy link
Member

lhoestq commented Aug 18, 2022

Cool thanks ! Maybe let's include this change after the refactoring from FolderBasedBuilder in #3963 to avoid dealing with too many unpleasant conflicts ?

@mariosasko
Copy link
Contributor Author

@lhoestq I resolved the conflicts (AudioFolder also supports CSV metadata now). Let me know what you think.

Copy link
Member

@lhoestq lhoestq left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome thanks !

I think we can see if we can stop having to duplicate the tests in both imagefolder and audiofolder later

docs/source/audio_load.mdx Outdated Show resolved Hide resolved
docs/source/image_load.mdx Outdated Show resolved Hide resolved
@mariosasko
Copy link
Contributor Author

@lhoestq Thanks for the suggestion! Indeed it makes more sense to use CSV as the default format in the folder-based builders.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support CSV as metadata file format in AudioFolder/ImageFolder
3 participants