Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test publishing with large file #4972

Closed
jcoyne opened this issue May 7, 2024 · 6 comments
Closed

Test publishing with large file #4972

jcoyne opened this issue May 7, 2024 · 6 comments
Assignees

Comments

@jcoyne
Copy link
Contributor

jcoyne commented May 7, 2024

Up to 1 TB

Validate the approach implemented in #4965.

@mjgiarlo mjgiarlo assigned mjgiarlo and unassigned mjgiarlo May 7, 2024
@lwrubel
Copy link
Contributor

lwrubel commented May 20, 2024

@andrewjbtw is testing with a large object currently.

@andrewjbtw
Copy link

andrewjbtw commented May 20, 2024

I've created a test object in stage with a 1TB file plus a few smaller files, using data from a real deposit.

To test shelving, it should be sufficient to

  1. Take the files off stacks
    (assumes the starting point is "publish=yes,shelve=yes" and files are already on stacks)
  • Open a new version
  • Change "publish" and "shelve" to "no" to unshelve the files
  • Close the version
  • Make sure the files are unshelved during accessionWF
  1. Put the files on stacks
    (assumes the starting point is "publish=no,shelve=no" and files are not on stacks)
  • Open a new version
  • Change "publish" and "shelve" to "yes" to shelve the files
  • Close the version
  • Make sure the files are shelved during accessionWF

@jcoyne
Copy link
Contributor Author

jcoyne commented May 21, 2024

It looks like https://argo-stage.stanford.edu/view/druid:fb146xw8568 was published, so I think we can say this worked, right?

@andrewjbtw
Copy link

I don't think this went through the new API yet. I was just making sure it got into the stage systems for future use.

@jcoyne
Copy link
Contributor Author

jcoyne commented May 22, 2024

Blocked by sul-dlss/purl-fetcher#751

@jcoyne jcoyne self-assigned this May 22, 2024
@jcoyne
Copy link
Contributor Author

jcoyne commented May 22, 2024

Looks good:

 #<ActiveStorage::Blob:0x00007f2a2e4e0de0
  id: 246,
  key: "ay4ojwqoehp9n9smt5fof1qwoaxy",
  filename: "DTU_DMS.tar.gz",
  content_type: "application/octet-stream",
  metadata: {},
  service_name: "local",
  byte_size: 1196585612576,
  checksum: "6o51iYPNe6/dloBheVB75A==",
  created_at: Fri, 17 May 2024 13:42:04.495049000 UTC +00:00>

@jcoyne jcoyne closed this as completed May 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants