Deploy Mode
Deploy mode specifies the location of where driver executes in the deployment environment.
Deploy mode can be one of the following options:
-
client(default) - the driver runs on the machine that the Spark application was launched. -
cluster- the driver runs on a random node in a cluster.
|
Note
|
cluster deploy mode is only available for non-local cluster deployments.
|
You can control deploy mode using spark-submit’s --deploy-mode or --conf command-line options with spark.submit.deployMode setting.
|
Note
|
spark.submit.deployMode setting can be client or cluster.
|
Client Mode
|
Caution
|
FIXME |
Cluster Mode
|
Caution
|
FIXME |