Skip to content

Commit

Permalink
[doc] remove the doc about killing SparkContext [skip ci] (#7840)
Browse files Browse the repository at this point in the history
  • Loading branch information
wbo4958 committed Apr 25, 2022
1 parent dc2e699 commit bef1f93
Showing 1 changed file with 0 additions and 6 deletions.
6 changes: 0 additions & 6 deletions doc/jvm/xgboost4j_spark_tutorial.rst
Expand Up @@ -16,12 +16,6 @@ This tutorial is to cover the end-to-end process to build a machine learning pip
* Building a Machine Learning Pipeline with XGBoost4J-Spark
* Running XGBoost4J-Spark in Production

.. note::

**SparkContext will be stopped by default when XGBoost training task fails**.

XGBoost4J-Spark 1.2.0+ exposes a parameter **kill_spark_context_on_worker_failure**. Set **kill_spark_context_on_worker_failure** to **false** so that the SparkContext will not be stopping on training failure. Instead of stopping the SparkContext, XGBoost4J-Spark will throw an exception instead. Users who want to re-use the SparkContext should wrap the training code in a try-catch block.

.. contents::
:backlinks: none
:local:
Expand Down

0 comments on commit bef1f93

Please sign in to comment.