ShuffleBlockResolver

ShuffleBlockResolver is used to find shuffle block data.

Note
The one and only implementation of ShuffleBlockResolver contract in Spark is IndexShuffleBlockResolver.
Note
ShuffleBlockResolver is used exclusively in BlockManager to find shuffle block data.

ShuffleBlockResolver Contract

trait ShuffleBlockResolver {
  def getBlockData(blockId: ShuffleBlockId): ManagedBuffer
  def stop(): Unit
}
Note
ShuffleBlockResolver is a private[spark] contract.
Table 1. ShuffleBlockResolver Contract
Method Description

getBlockData

Used when BlockManager is requested to find shuffle block data and later (duplicate?) for local shuffle block data as serialized bytes.

stop

Used when SortShuffleManager stops.

results matching ""

    No results matching ""