Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test latency of search within and transcript searching on full dataset from mco-staging #5794

Open
5 tasks
elynema opened this issue Apr 19, 2024 · 1 comment
Open
5 tasks

Comments

@elynema
Copy link
Contributor

elynema commented Apr 19, 2024

Description

Indexing and/or storing transcripts could cause changes in performance of the Solr index in ways we don't anticipate once we have a full dataset from MCO into the index. We would like to test in advance to make sure that change is not highly impactful in a negative way.

In addition, we want to be sure that implementing search within as IIIF content search, which introduces network latency, will not be too slow. We don't want to be blindsided by heavy searching of these documents in Solr if frequently/commonly used.

Questions

  • Adding transcripts to Solr: will that have a significant impact on performance?
  • How performant is this in the context of search within, where we're searching the transcript document in Solr? What can we expect from the search query overhead?

Done Looks Like

  • Take a snapshot of mco-staging Solr index (roll back to snapshot after testing)
  • Index transcripts within the Solr index (add database field, or do without?)
  • Test Solr queries against mco-staging Solr and benchmark response times
    • Catalog search queries
    • Search within queries (Content Search)
@joncameron
Copy link
Contributor

Would be possible to put on mco-staging before release; ensure that we can do this in a way that's easy to revert.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants