ExecutorAllocationManagerSource — Metric Source for Dynamic Allocation
ExecutorAllocationManagerSource is a metric source for dynamic allocation with name ExecutorAllocationManager and the following gauges:
-
executors/numberExecutorsToAddwhich exposes numExecutorsToAdd. -
executors/numberExecutorsPendingToRemovewhich corresponds to the number of elements in executorsPendingToRemove. -
executors/numberAllExecutorswhich corresponds to the number of elements in executorIds. -
executors/numberTargetExecutorswhich is numExecutorsTarget. -
executors/numberMaxNeededExecutorswhich simply calls maxNumExecutorsNeeded.
|
Note
|
Spark uses Metrics Java library to expose internal state of its services to measure. |