log4j.logger.org.apache.spark.MapOutputTrackerWorker=DEBUG
MapOutputTrackerWorker — MapOutputTracker for Executors
A MapOutputTrackerWorker is the MapOutputTracker
for executors.
MapOutputTrackerWorker
uses Java’s thread-safe java.util.concurrent.ConcurrentHashMap for mapStatuses
internal cache and any lookup cache miss triggers a fetch from the driver’s MapOutputTrackerMaster.
Note
|
The only difference between MapOutputTrackerWorker and the base abstract class MapOutputTracker is that the mapStatuses internal registry is an instance of the thread-safe java.util.concurrent.ConcurrentHashMap.
|
Tip
|
Enable Add the following line to Refer to Logging. |