Spark Advanced Workshop - Day 2

Agenda

1. Using Listeners to monitor Spark’s Scheduler - 45 mins

2. TaskScheduler and Speculative execution of tasks - 45 mins

3. Developing Custom RPC Environment (RpcEnv) - 45 mins

4. Spark Metrics System - 45 mins

5. Don’t fear the logs - Learn Spark by Logs - 45 mins