Skip to content

Latest commit

 

History

History
22 lines (15 loc) · 571 Bytes

aws-s3-public-datasets.md

File metadata and controls

22 lines (15 loc) · 571 Bytes

aws s3 public datasets

Useful for testing:

A pipe separated csv (2k):

aws s3 --no-sign-request cp s3://tpc-h-csv/nation/nation.tbl -

GBIF data in Parquet ()

aws s3 --no-sign-request ls --human-readable --summarize s3://gbif-open-data-ap-southeast-2/occurrence/2022-07-01/occurrence.parquet/
2022-07-02 03:04:17  166.1 MiB 000000
2022-07-02 03:04:17  202.3 MiB 000001
..

References