From 7043b18cd37c2d996b391f81aa33b61972c90831 Mon Sep 17 00:00:00 2001 From: Jenkins Date: Fri, 14 Jan 2022 20:23:11 +0000 Subject: [PATCH 1/9] Generating changelog for MLflow 1.22.1.dev0 Signed-off-by: Jenkins --- CHANGELOG.rst | 30 ++++++++++++++++++++++++++++++ 1 file changed, 30 insertions(+) diff --git a/CHANGELOG.rst b/CHANGELOG.rst index 5175fefd483fb..c15a9fafaca19 100644 --- a/CHANGELOG.rst +++ b/CHANGELOG.rst @@ -1,5 +1,35 @@ Changelog ========= +1.22.1.dev0 (2022-01-14) +------------------------ +MLflow 1.22.1.dev0 includes several major features and improvements: + +Features: + +- Support specifying 'latest' in model URI to get the latest version of a model regardless of the stage (#5027, @lichenran1234) +- Evaluation Default evaluator (#5092, @WeichenXu123) +- Add a Python API to load model input examples (#5212, @maitre-matt) +- Autologging functionality for scikit-learn integration with LightGBM (Part 1) (#5130, @jwyyy) +- Log model uuid (#5149, @WeichenXu123) +- Implement model evaluation API (part 1) (#5069, @WeichenXu123) +- Make example input and PyFuncInput support csc csr matrix (#5016, @WeichenXu123) +- Automatically update metric plots for in-progress runs #2099 (#5017, @cedkoffeto) +- Add server option for serving only artifacts and proxied serving mode (#5045, @BenWilson2) + +Bug fixes and documentation updates: + +- Do not modify tags dict on start_run() (#5191, @matheusMoreno) +- Fixed incorrect parameter assignment in create-model-version in the R model registry API. (#5185, @bramrodenburg) +- Bugfix: properly pass kwargs to `torch.jit.load` from `mlfow.pytorch.load_model` (#5163, @schmidt-jake) +- Only generate model uuid when logging model (#5167, @WeichenXu123) +- Fixing the horizonal and vertical extra scroll bar issue (#5159, @sunishsheth2009) +- BUG: fixed model serve fail with HTTP 400 on Bad Request. (#5003, @abatomunkuev) +- MLflow Schema enforcement should not cast object to pandas String (#5134, @stevenchen-db) +- Caching boto client to improve artifact download speed (#4695, @Samreay) +- Parse subdirectory with quotes (#5117, @dinaldoap) + +Small bug fixes and doc updates (#5264, #5244, #5249, #5255, #5248, #5243, #5240, #5239, #5232, #5234, #5235, #5082, #5220, #5219, #5226, #5217, #5194, #5188, #5132, #5182, #5183, #5180, #5177, #5165, #5164, #5162, #5015, #5136, #5065, #5125, #5106, #5127, #5120, @harupy; #5156, @pbezglasny; #5202, @jwyyy; #3863, @JoshuaAnickat; #5205, @abhiramr; #4604, @OSobky; #4256, @einsmein; #5140, @AveshCSingh; #5186, #5176, @WeichenXu123; #5260, #5230, #5229, #5206, #5174, #5160, @liangz1) + 1.22.0 (2021-11-29) ------------------------ MLflow 1.22.0 includes several major features and improvements: From 488db3631098cc386727caf8fb04219ffd838c59 Mon Sep 17 00:00:00 2001 From: dbczumar Date: Fri, 14 Jan 2022 16:20:58 -0800 Subject: [PATCH 2/9] Tweaks Signed-off-by: dbczumar --- CHANGELOG.rst | 41 +++++++++++++++++++---------------------- 1 file changed, 19 insertions(+), 22 deletions(-) diff --git a/CHANGELOG.rst b/CHANGELOG.rst index c15a9fafaca19..872ff4da95870 100644 --- a/CHANGELOG.rst +++ b/CHANGELOG.rst @@ -1,34 +1,31 @@ Changelog ========= -1.22.1.dev0 (2022-01-14) +1.23.0 (2022-01-17) ------------------------ -MLflow 1.22.1.dev0 includes several major features and improvements: +MLflow 1.23.0 includes several major features and improvements: Features: -- Support specifying 'latest' in model URI to get the latest version of a model regardless of the stage (#5027, @lichenran1234) -- Evaluation Default evaluator (#5092, @WeichenXu123) -- Add a Python API to load model input examples (#5212, @maitre-matt) -- Autologging functionality for scikit-learn integration with LightGBM (Part 1) (#5130, @jwyyy) -- Log model uuid (#5149, @WeichenXu123) -- Implement model evaluation API (part 1) (#5069, @WeichenXu123) -- Make example input and PyFuncInput support csc csr matrix (#5016, @WeichenXu123) -- Automatically update metric plots for in-progress runs #2099 (#5017, @cedkoffeto) -- Add server option for serving only artifacts and proxied serving mode (#5045, @BenWilson2) +- [Models] Introduce an ``mlflow.evaluate()`` API for evaluating MLflow Models, providing performance and explainability insights (#5069, #5092, #5256, @WeichenXu123) +- [Models] Add an ``mlflow.models.Model.load_input_example()`` Python API for loading MLflow Model input examples (#5212, @maitre-matt) +- [Models] Add a UUID field to the MLflow Model specification. MLflow Models now have a unique identifier (#5149, #5167, @WeichenXu123) +- [Models] Supporting passing SciPy CSC and CSR matrices as MLflow Model input examples (#5016, @WeichenXu123) +- [Model Registry] Support specifying `latest` in model URI to get the latest version of a model regardless of the stage (#5027, @lichenran1234) +- [Tracking] Add support for LightGBM scikit-learn models to ``mlflow.lightgbm.autolog()`` (#5130, #5200, #5271 @jwyyy) +- [Tracking] Improve S3 artifact download speed by caching boto clients (#4695, @Samreay) +- [UI] Automatically update metric plots for in-progress runs (#5017, @cedkoffeto, @harupy) Bug fixes and documentation updates: -- Do not modify tags dict on start_run() (#5191, @matheusMoreno) -- Fixed incorrect parameter assignment in create-model-version in the R model registry API. (#5185, @bramrodenburg) -- Bugfix: properly pass kwargs to `torch.jit.load` from `mlfow.pytorch.load_model` (#5163, @schmidt-jake) -- Only generate model uuid when logging model (#5167, @WeichenXu123) -- Fixing the horizonal and vertical extra scroll bar issue (#5159, @sunishsheth2009) -- BUG: fixed model serve fail with HTTP 400 on Bad Request. (#5003, @abatomunkuev) -- MLflow Schema enforcement should not cast object to pandas String (#5134, @stevenchen-db) -- Caching boto client to improve artifact download speed (#4695, @Samreay) -- Parse subdirectory with quotes (#5117, @dinaldoap) - -Small bug fixes and doc updates (#5264, #5244, #5249, #5255, #5248, #5243, #5240, #5239, #5232, #5234, #5235, #5082, #5220, #5219, #5226, #5217, #5194, #5188, #5132, #5182, #5183, #5180, #5177, #5165, #5164, #5162, #5015, #5136, #5065, #5125, #5106, #5127, #5120, @harupy; #5156, @pbezglasny; #5202, @jwyyy; #3863, @JoshuaAnickat; #5205, @abhiramr; #4604, @OSobky; #4256, @einsmein; #5140, @AveshCSingh; #5186, #5176, @WeichenXu123; #5260, #5230, #5229, #5206, #5174, #5160, @liangz1) +- [Models] Fix a bug in MLflow Model schema enforcement where strings were incorrectly cast to Pandas objects (#5134, @stevenchen-db) +- [Models] Fix a bug where keyword arguments passed to ``mlflow.pytorch.load_model()`` were not used for scripted models (#5163, @schmidt-jake) +- [Model Registry][R] Fix bug in R client ``mlflow_create_model_version`` API that caused ``source`` to be set incorrectly (#5185, @bramrodenburg) +- [Projects] Fix parsing behavior for project URIs containing quotes (#5117, @dinaldoap) +- [Scoring] Use the correct 400-level error code for malformed MLflow Model Server requests (#5003, @abatomunkuev) +- [Tracking] Fix a bug where ``mlflow.start_run()`` modified user-supplied tags dictionary (#5191, @matheusMoreno) +- [UI] Fix a bug causing redundant scroll bars to be displayed on the Experiment Page (#5159, @sunishsheth2009) + +Small bug fixes and doc updates (#5264, #5244, #5249, #5255, #5248, #5243, #5240, #5239, #5232, #5234, #5235, #5082, #5220, #5219, #5226, #5217, #5194, #5188, #5132, #5182, #5183, #5180, #5177, #5165, #5164, #5162, #5015, #5136, #5065, #5125, #5106, #5127, #5120, @harupy; #5045, @BenWilson2; #5156, @pbezglasny; #5202, @jwyyy; #3863, @JoshuaAnickat; #5205, @abhiramr; #4604, @OSobky; #4256, @einsmein; #5140, @AveshCSingh; #5186, #5176, @WeichenXu123; #5260, #5230, #5229, #5206, #5174, #5160, @liangz1) 1.22.0 (2021-11-29) ------------------------ From 7c713b7f0e5baf3c7cd01731dd6c06efc1088328 Mon Sep 17 00:00:00 2001 From: dbczumar Date: Fri, 14 Jan 2022 16:25:59 -0800 Subject: [PATCH 3/9] Tweak Signed-off-by: dbczumar --- CHANGELOG.rst | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/CHANGELOG.rst b/CHANGELOG.rst index 872ff4da95870..7e968addb0365 100644 --- a/CHANGELOG.rst +++ b/CHANGELOG.rst @@ -9,8 +9,8 @@ Features: - [Models] Introduce an ``mlflow.evaluate()`` API for evaluating MLflow Models, providing performance and explainability insights (#5069, #5092, #5256, @WeichenXu123) - [Models] Add an ``mlflow.models.Model.load_input_example()`` Python API for loading MLflow Model input examples (#5212, @maitre-matt) - [Models] Add a UUID field to the MLflow Model specification. MLflow Models now have a unique identifier (#5149, #5167, @WeichenXu123) -- [Models] Supporting passing SciPy CSC and CSR matrices as MLflow Model input examples (#5016, @WeichenXu123) -- [Model Registry] Support specifying `latest` in model URI to get the latest version of a model regardless of the stage (#5027, @lichenran1234) +- [Models] Support passing SciPy CSC and CSR matrices as MLflow Model input examples (#5016, @WeichenXu123) +- [Model Registry] Support specifying ``latest` in model URI to get the latest version of a model regardless of the stage (#5027, @lichenran1234) - [Tracking] Add support for LightGBM scikit-learn models to ``mlflow.lightgbm.autolog()`` (#5130, #5200, #5271 @jwyyy) - [Tracking] Improve S3 artifact download speed by caching boto clients (#4695, @Samreay) - [UI] Automatically update metric plots for in-progress runs (#5017, @cedkoffeto, @harupy) From 5d43baa80bad036b9b1b3dd447018546b16343b5 Mon Sep 17 00:00:00 2001 From: dbczumar Date: Fri, 14 Jan 2022 16:27:26 -0800 Subject: [PATCH 4/9] Fix typo Signed-off-by: dbczumar --- CHANGELOG.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/CHANGELOG.rst b/CHANGELOG.rst index 7e968addb0365..19e74bec3b5ef 100644 --- a/CHANGELOG.rst +++ b/CHANGELOG.rst @@ -10,7 +10,7 @@ Features: - [Models] Add an ``mlflow.models.Model.load_input_example()`` Python API for loading MLflow Model input examples (#5212, @maitre-matt) - [Models] Add a UUID field to the MLflow Model specification. MLflow Models now have a unique identifier (#5149, #5167, @WeichenXu123) - [Models] Support passing SciPy CSC and CSR matrices as MLflow Model input examples (#5016, @WeichenXu123) -- [Model Registry] Support specifying ``latest` in model URI to get the latest version of a model regardless of the stage (#5027, @lichenran1234) +- [Model Registry] Support specifying ``latest`` in model URI to get the latest version of a model regardless of the stage (#5027, @lichenran1234) - [Tracking] Add support for LightGBM scikit-learn models to ``mlflow.lightgbm.autolog()`` (#5130, #5200, #5271 @jwyyy) - [Tracking] Improve S3 artifact download speed by caching boto clients (#4695, @Samreay) - [UI] Automatically update metric plots for in-progress runs (#5017, @cedkoffeto, @harupy) From a49c13e30c41456d0c273ed94539ba7a7ad0fd42 Mon Sep 17 00:00:00 2001 From: dbczumar Date: Fri, 14 Jan 2022 16:29:33 -0800 Subject: [PATCH 5/9] Small fixes Signed-off-by: dbczumar --- CHANGELOG.rst | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/CHANGELOG.rst b/CHANGELOG.rst index 19e74bec3b5ef..448b3c69a5d65 100644 --- a/CHANGELOG.rst +++ b/CHANGELOG.rst @@ -7,7 +7,7 @@ MLflow 1.23.0 includes several major features and improvements: Features: - [Models] Introduce an ``mlflow.evaluate()`` API for evaluating MLflow Models, providing performance and explainability insights (#5069, #5092, #5256, @WeichenXu123) -- [Models] Add an ``mlflow.models.Model.load_input_example()`` Python API for loading MLflow Model input examples (#5212, @maitre-matt) +- [Models] Introduce an ``mlflow.models.Model.load_input_example()`` Python API for loading MLflow Model input examples (#5212, @maitre-matt) - [Models] Add a UUID field to the MLflow Model specification. MLflow Models now have a unique identifier (#5149, #5167, @WeichenXu123) - [Models] Support passing SciPy CSC and CSR matrices as MLflow Model input examples (#5016, @WeichenXu123) - [Model Registry] Support specifying ``latest`` in model URI to get the latest version of a model regardless of the stage (#5027, @lichenran1234) @@ -18,9 +18,9 @@ Features: Bug fixes and documentation updates: - [Models] Fix a bug in MLflow Model schema enforcement where strings were incorrectly cast to Pandas objects (#5134, @stevenchen-db) -- [Models] Fix a bug where keyword arguments passed to ``mlflow.pytorch.load_model()`` were not used for scripted models (#5163, @schmidt-jake) -- [Model Registry][R] Fix bug in R client ``mlflow_create_model_version`` API that caused ``source`` to be set incorrectly (#5185, @bramrodenburg) -- [Projects] Fix parsing behavior for project URIs containing quotes (#5117, @dinaldoap) +- [Models] Fix a bug where keyword arguments passed to ``mlflow.pytorch.load_model()`` were not applied for scripted models (#5163, @schmidt-jake) +- [Model Registry][R] Fix bug in R client ``mlflow_create_model_version()`` API that caused model ``source`` to be set incorrectly (#5185, @bramrodenburg) +- [Projects] Fix parsing behavior for Project URIs containing quotes (#5117, @dinaldoap) - [Scoring] Use the correct 400-level error code for malformed MLflow Model Server requests (#5003, @abatomunkuev) - [Tracking] Fix a bug where ``mlflow.start_run()`` modified user-supplied tags dictionary (#5191, @matheusMoreno) - [UI] Fix a bug causing redundant scroll bars to be displayed on the Experiment Page (#5159, @sunishsheth2009) From 4fdf863cbe9d3c278f5c8ed9264a741e5b2893bd Mon Sep 17 00:00:00 2001 From: dbczumar Date: Fri, 14 Jan 2022 18:15:16 -0800 Subject: [PATCH 6/9] Include model return type Signed-off-by: dbczumar --- CHANGELOG.rst | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/CHANGELOG.rst b/CHANGELOG.rst index 448b3c69a5d65..70cf278acdb25 100644 --- a/CHANGELOG.rst +++ b/CHANGELOG.rst @@ -7,6 +7,7 @@ MLflow 1.23.0 includes several major features and improvements: Features: - [Models] Introduce an ``mlflow.evaluate()`` API for evaluating MLflow Models, providing performance and explainability insights (#5069, #5092, #5256, @WeichenXu123) +- [Models] ``log_model()`` APIs now return information about the logged MLflow Model, including artifact location, flavors, and schema (#5230, @liangz1) - [Models] Introduce an ``mlflow.models.Model.load_input_example()`` Python API for loading MLflow Model input examples (#5212, @maitre-matt) - [Models] Add a UUID field to the MLflow Model specification. MLflow Models now have a unique identifier (#5149, #5167, @WeichenXu123) - [Models] Support passing SciPy CSC and CSR matrices as MLflow Model input examples (#5016, @WeichenXu123) @@ -25,7 +26,7 @@ Bug fixes and documentation updates: - [Tracking] Fix a bug where ``mlflow.start_run()`` modified user-supplied tags dictionary (#5191, @matheusMoreno) - [UI] Fix a bug causing redundant scroll bars to be displayed on the Experiment Page (#5159, @sunishsheth2009) -Small bug fixes and doc updates (#5264, #5244, #5249, #5255, #5248, #5243, #5240, #5239, #5232, #5234, #5235, #5082, #5220, #5219, #5226, #5217, #5194, #5188, #5132, #5182, #5183, #5180, #5177, #5165, #5164, #5162, #5015, #5136, #5065, #5125, #5106, #5127, #5120, @harupy; #5045, @BenWilson2; #5156, @pbezglasny; #5202, @jwyyy; #3863, @JoshuaAnickat; #5205, @abhiramr; #4604, @OSobky; #4256, @einsmein; #5140, @AveshCSingh; #5186, #5176, @WeichenXu123; #5260, #5230, #5229, #5206, #5174, #5160, @liangz1) +Small bug fixes and doc updates (#5264, #5244, #5249, #5255, #5248, #5243, #5240, #5239, #5232, #5234, #5235, #5082, #5220, #5219, #5226, #5217, #5194, #5188, #5132, #5182, #5183, #5180, #5177, #5165, #5164, #5162, #5015, #5136, #5065, #5125, #5106, #5127, #5120, @harupy; #5045, @BenWilson2; #5156, @pbezglasny; #5202, @jwyyy; #3863, @JoshuaAnickat; #5205, @abhiramr; #4604, @OSobky; #4256, @einsmein; #5140, @AveshCSingh; #5186, #5176, @WeichenXu123; #5260, #5229, #5206, #5174, #5160, @liangz1) 1.22.0 (2021-11-29) ------------------------ From f44cd2a83a682c332d1cf543ded7802143059623 Mon Sep 17 00:00:00 2001 From: dbczumar Date: Fri, 14 Jan 2022 18:48:36 -0800 Subject: [PATCH 7/9] Link Signed-off-by: dbczumar --- CHANGELOG.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/CHANGELOG.rst b/CHANGELOG.rst index 70cf278acdb25..9204217b76131 100644 --- a/CHANGELOG.rst +++ b/CHANGELOG.rst @@ -6,7 +6,7 @@ MLflow 1.23.0 includes several major features and improvements: Features: -- [Models] Introduce an ``mlflow.evaluate()`` API for evaluating MLflow Models, providing performance and explainability insights (#5069, #5092, #5256, @WeichenXu123) +- [Models] Introduce an ``mlflow.evaluate()`` API for evaluating MLflow Models, providing performance and explainability insights. For an overview, see https://mlflow.org/docs/latest/models.html#model-evaluation (#5069, #5092, #5256, @WeichenXu123) - [Models] ``log_model()`` APIs now return information about the logged MLflow Model, including artifact location, flavors, and schema (#5230, @liangz1) - [Models] Introduce an ``mlflow.models.Model.load_input_example()`` Python API for loading MLflow Model input examples (#5212, @maitre-matt) - [Models] Add a UUID field to the MLflow Model specification. MLflow Models now have a unique identifier (#5149, #5167, @WeichenXu123) From 1c7322c5cffbc46f56a733f1bb311ab57d4dd942 Mon Sep 17 00:00:00 2001 From: harupy Date: Mon, 17 Jan 2022 12:43:37 +0900 Subject: [PATCH 8/9] add #5273 Signed-off-by: harupy --- CHANGELOG.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/CHANGELOG.rst b/CHANGELOG.rst index 9204217b76131..796a1028c75c8 100644 --- a/CHANGELOG.rst +++ b/CHANGELOG.rst @@ -26,7 +26,7 @@ Bug fixes and documentation updates: - [Tracking] Fix a bug where ``mlflow.start_run()`` modified user-supplied tags dictionary (#5191, @matheusMoreno) - [UI] Fix a bug causing redundant scroll bars to be displayed on the Experiment Page (#5159, @sunishsheth2009) -Small bug fixes and doc updates (#5264, #5244, #5249, #5255, #5248, #5243, #5240, #5239, #5232, #5234, #5235, #5082, #5220, #5219, #5226, #5217, #5194, #5188, #5132, #5182, #5183, #5180, #5177, #5165, #5164, #5162, #5015, #5136, #5065, #5125, #5106, #5127, #5120, @harupy; #5045, @BenWilson2; #5156, @pbezglasny; #5202, @jwyyy; #3863, @JoshuaAnickat; #5205, @abhiramr; #4604, @OSobky; #4256, @einsmein; #5140, @AveshCSingh; #5186, #5176, @WeichenXu123; #5260, #5229, #5206, #5174, #5160, @liangz1) +Small bug fixes and doc updates (#5264, #5244, #5249, #5255, #5248, #5243, #5240, #5239, #5232, #5234, #5235, #5082, #5220, #5219, #5226, #5217, #5194, #5188, #5132, #5182, #5183, #5180, #5177, #5165, #5164, #5162, #5015, #5136, #5065, #5125, #5106, #5127, #5120, @harupy; #5045, @BenWilson2; #5156, @pbezglasny; #5202, @jwyyy; #3863, @JoshuaAnickat; #5205, @abhiramr; #4604, @OSobky; #4256, @einsmein; #5140, @AveshCSingh; #5273, #5186, #5176, @WeichenXu123; #5260, #5229, #5206, #5174, #5160, @liangz1) 1.22.0 (2021-11-29) ------------------------ From 1a4d4cb1afcab58d2e419d42cb1b1b6045b19a69 Mon Sep 17 00:00:00 2001 From: harupy Date: Mon, 17 Jan 2022 16:09:39 +0900 Subject: [PATCH 9/9] add #5275 Signed-off-by: harupy --- CHANGELOG.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/CHANGELOG.rst b/CHANGELOG.rst index 796a1028c75c8..6c6458594b522 100644 --- a/CHANGELOG.rst +++ b/CHANGELOG.rst @@ -26,7 +26,7 @@ Bug fixes and documentation updates: - [Tracking] Fix a bug where ``mlflow.start_run()`` modified user-supplied tags dictionary (#5191, @matheusMoreno) - [UI] Fix a bug causing redundant scroll bars to be displayed on the Experiment Page (#5159, @sunishsheth2009) -Small bug fixes and doc updates (#5264, #5244, #5249, #5255, #5248, #5243, #5240, #5239, #5232, #5234, #5235, #5082, #5220, #5219, #5226, #5217, #5194, #5188, #5132, #5182, #5183, #5180, #5177, #5165, #5164, #5162, #5015, #5136, #5065, #5125, #5106, #5127, #5120, @harupy; #5045, @BenWilson2; #5156, @pbezglasny; #5202, @jwyyy; #3863, @JoshuaAnickat; #5205, @abhiramr; #4604, @OSobky; #4256, @einsmein; #5140, @AveshCSingh; #5273, #5186, #5176, @WeichenXu123; #5260, #5229, #5206, #5174, #5160, @liangz1) +Small bug fixes and doc updates (#5275, #5264, #5244, #5249, #5255, #5248, #5243, #5240, #5239, #5232, #5234, #5235, #5082, #5220, #5219, #5226, #5217, #5194, #5188, #5132, #5182, #5183, #5180, #5177, #5165, #5164, #5162, #5015, #5136, #5065, #5125, #5106, #5127, #5120, @harupy; #5045, @BenWilson2; #5156, @pbezglasny; #5202, @jwyyy; #3863, @JoshuaAnickat; #5205, @abhiramr; #4604, @OSobky; #4256, @einsmein; #5140, @AveshCSingh; #5273, #5186, #5176, @WeichenXu123; #5260, #5229, #5206, #5174, #5160, @liangz1) 1.22.0 (2021-11-29) ------------------------