AggregationIterator — Generic Iterator of UnsafeRows for Aggregate Physical Operators

AggregationIterator is the base for Scala Iterators of UnsafeRow elements that…​FIXME

Iterators are data structures that allow to iterate over a sequence of elements. They have a hasNext method for checking if there is a next element available, and a next method which returns the next element and discards it from the iterator.

Note
 AggregationIterator is a Scala abstract class.
Table 1. AggregationIterator’s Implementations
Name Description

ObjectAggregationIterator

Used exclusively when ObjectHashAggregateExec physical operator is executed.

SortBasedAggregationIterator

Used exclusively when SortAggregateExec physical operator is executed.

TungstenAggregationIterator

Used exclusively when HashAggregateExec physical operator is executed.

Note
 HashAggregateExec operator is the preferred aggregate physical operator for Aggregation execution planning strategy (over ObjectHashAggregateExec and SortAggregateExec).
Table 2. AggregationIterator’s Internal Registries and Counters (in alphabetical order)
Name Description

aggregateFunctions

Aggregate functions

Used when…​FIXME

allImperativeAggregateFunctions

ImperativeAggregate functions

Used when…​FIXME

allImperativeAggregateFunctionPositions

Positions

Used when…​FIXME

expressionAggInitialProjection

MutableProjection

Used when…​FIXME

generateOutput

(UnsafeRow, InternalRow) ⇒ UnsafeRow

Used when…​FIXME

groupingAttributes

Grouping attributes

Used when…​FIXME

groupingProjection

UnsafeProjection

Used when…​FIXME

processRow

(InternalRow, InternalRow) ⇒ Unit

Used when…​FIXME

Creating AggregationIterator Instance

AggregationIterator takes the following when created:

AggregationIterator initializes the internal registries and counters.

initializeAggregateFunctions

Caution
 FIXME

generateProcessRow Method

Caution
 FIXME

results matching ""

    No results matching ""