Autoplay
Autocomplete
Previous Lesson
Complete and Continue
Spark Performance Tuning with Scala
Warmup
Welcome & Setup (11:12)
Spark Setup for Windows (5:53)
Scala Recap (24:47)
Spark Recap (27:10)
Foundation
Core (16:00)
Spark Job Anatomy (25:07)
Query Plans (27:41)
The Spark UI and DAGs (21:34)
A Tale of Two Spark APIs (23:29)
Deploying & Configuring Spark Applications (22:16)
Catalyst (19:10)
Tungsten (16:50)
Memory, Caching and Checkpointing
Executor Memory Architecture (5:31)
Caching (28:33)
Checkpointing (21:14)
Partitioning
Repartition & Coalesce (11:05)
Partitioning Problems (22:32)
Shuffle Partitioning (10:10)
Custom Partitioners (25:45)
Performance Tuning, Problems and More
Optimizing Cluster Resource Allocation (18:37)
Fixing Data Skews and Straggling Tasks (29:47)
Serialization Problems, Part 1 (22:06)
Serialization Problems, Part 2 (12:36)
Kryo (17:35)
Shuffle Compression (26:24)
Epilogue
You ROCK! (0:41)
Spark Setup for Windows
Content locked
If you're already enrolled,
you'll need to login
.
Enroll in Course to Unlock