YarnClusterManager — ExternalClusterManager for YARN

YarnClusterManager is the only currently known ExternalClusterManager in Spark. It creates a TaskScheduler and a SchedulerBackend for YARN.

canCreate method

YarnClusterManager can handle the yarn master URL only.

createTaskScheduler method

It throws a SparkException for unknown deploy modes.

Unknown deploy mode '[deployMode]' for Yarn

createSchedulerBackend method

It throws a SparkException for unknown deploy modes.

Unknown deploy mode '[deployMode]' for Yarn

initialize method

results matching ""

    No results matching ""