Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add missing functions to data_prep_toolkit_kfp lib #113

Merged
merged 7 commits into from
May 15, 2024
Merged

Conversation

revit13
Copy link
Collaborator

@revit13 revit13 commented May 12, 2024

This PR adds missing functions to workflow_utils.py file in data_prep_toolkit_kfp lib

/closes #93

Signed-off-by: Revital Sur <eres@il.ibm.com>
:return: Server response object containing pipleine id and other information.
"""
try:
p = self.kfp_client.upload_pipeline(pipeline_package_path, pipeline_name, description)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you need to check whether pipeline with the given name already exists? And remove the old one?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

would it be cleaner to move this functionality here? With additional flag to overwrite or fail?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, will try to move the implementation. Thanks

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@blublinsky I changed the function as you suggested. Please review again. Thanks

Signed-off-by: Revital Sur <eres@il.ibm.com>
Signed-off-by: Revital Sur <eres@il.ibm.com>
Signed-off-by: Boris Lublinsky <blublinsky@ibm.com>
Signed-off-by: Revital Sur <eres@il.ibm.com>
Copy link
Collaborator

@blublinsky blublinsky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is very good, last nitpick. Lets replace print with logger

Signed-off-by: Revital Sur <eres@il.ibm.com>
@revit13 revit13 mentioned this pull request May 13, 2024
Signed-off-by: Revital Sur <eres@il.ibm.com>
Copy link
Member

@roytman roytman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We change libraries here, should we change the relevant versions and pipelines, or it will be a separate PR.

Copy link
Collaborator

@blublinsky blublinsky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Member

@roytman roytman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@roytman roytman merged commit 0ad5aa0 into IBM:dev May 15, 2024
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Bug] KFP Workflow step is green although task failed
3 participants