New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Allow list_datasets
to include private datasets
#4745
Comments
Thanks for opening this issue :) If it can help, I think you can already use >>> from huggingface_hub import HfApi
>>> [ds_info.id for ds_info in HfApi().list_datasets(use_auth_token=token) if ds_info.private]
['bigscience/xxxx', 'bigscience-catalogue-data/xxxxxxx', ... ] Though the latest versions of |
Great, thanks @lhoestq the workaround works! I think it would be intuitive to have the support directly in |
i also think that going forward we should replace more and more implementations inside datasets with the corresponding ones from |
|
I am working with a large collection of private datasets, it would be convenient for me to be able to list them.
I would envision extending the convention of using
use_auth_token
keyword argument tolist_datasets
function, then calling:would return the list of all datasets I have permissions to view, including private ones. The only current alternative I see is to use the hub website to manually obtain the list of dataset names - this is in the context of BigScience where respective private spaces contain hundreds of datasets, so not very convenient to list manually.
The text was updated successfully, but these errors were encountered: