ExecutedCommandExec Physical Operator for Command Execution

ExecutedCommandExec is a SparkPlan for executing logical commands with side effects.

ExecutedCommandExec runs a command and caches the result in sideEffectResult internal attribute.

Table 1. ExecutedCommandExec’s Methods (in alphabetical order)
Method Description

doExecute

Executes ExecutedCommandExec physical operator (and produces a result as an RDD of internal binary rows

executeCollect

executeTake

executeToIterator

Executing Logical RunnableCommand and Caching Result As InternalRows — sideEffectResult Internal Lazy Attribute

sideEffectResult: Seq[InternalRow]

sideEffectResult runs the RunnableCommand (that produces a Seq[Row]) and converts the result to a Seq[InternalRow] using a Catalyst converter function for a given schema.

Caution
 FIXME CatalystTypeConverters.createToCatalystConverter?
Note
 sideEffectResult is used when ExecutedCommandExec is requested for executeCollect, executeToIterator, executeTake, doExecute.

results matching ""

    No results matching ""