ExecutorAllocationListener
|
Caution
|
FIXME |
ExecutorAllocationListener is a SparkListener that intercepts events about stages, tasks, and executors, i.e. onStageSubmitted, onStageCompleted, onTaskStart, onTaskEnd, onExecutorAdded, and onExecutorRemoved. Using the events ExecutorAllocationManager can manage the pool of dynamically managed executors.
|
Note
|
ExecutorAllocationListener is an internal class of ExecutorAllocationManager with full access to its internal registries.
|