Powered by GitBook

Unified Memory Management

Unified Memory Management was introduced in SPARK-10000: Consolidate storage and execution memory management.

It uses the custom memory manager UnifiedMemoryManager.

Further reading or watching

(video) Deep Dive: Apache Spark Memory Management
(video) Deep Dive into Project Tungsten (…WGI)
(video) Spark Performance: What’s Next (…WYX4)
SPARK-10000: Unified Memory Management

results matching ""

No results matching ""