New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Runs] Store artifact URIs instead of full artifacts in body [1.6.x] #5544
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good - one small change needed.
mlrun/model.py
Outdated
@@ -1058,6 +1058,7 @@ def __init__( | |||
ui_url=None, | |||
reason: str = None, | |||
notifications: Dict[str, Notification] = None, | |||
artifact_uris: list[str] = None, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This needs to be a dict now, doesn't it?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Cool. Looks good.
…lrun#5544) (cherry picked from commit a54892f)
https://iguazio.atlassian.net/browse/ML-6397
Artifacts stats and preview can bloat the DB when stored in run body.
Instead we now only store the artifact URIs while in memory the run object still holds the artifacts (client side) to maintain easy access.
In the API we strip the artifacts if given and enrich the artifact URIs when storing / updating the runs.
Example from run yaml:
Example from run output html: