Autoplay
Autocomplete
Previous Lesson
Complete and Continue
Spark Optimization with Scala
Welcome
Welcome (9:38)
Windows Setup (5:53)
Scala Recap (24:47)
Spark Recap (27:10)
Spark Performance Foundations
Core (16:00)
Spark Job Anatomy (25:07)
Reading Query Plans (27:41)
Reading DAGs (21:34)
The Different Spark APIs (23:29)
Deploying and Configuring Spark Apps (22:16)
Optimizing DataFrame Transformations (Mostly Joins)
General Join Mechanics (9:01)
Joins Recap (optional) (19:22)
Broadcast Joins (19:34)
Column Pruning (22:27)
Pre-Partitioning (23:24)
Bucketing (23:53)
Skewed Joins (24:12)
Optimizing RDD Transformations (Mostly Joins)
Optimizing RDD Joins (24:38)
Cogrouping (20:30)
Broadcast Joins (14:46)
Skewed Joins (31:26)
Optimizing Key-Value RDDs
RDD Transformations (5:06)
By Key Functions (23:10)
Reusing JVM Objects, Part 1 (24:57)
Reusing JVM Objects, Part 2 (12:11)
Iterator-to-iterator Transformations (21:19)
Iterator-to-iterator Transformations - Exercises (9:40)
Semi-automatic Optimizations
Adaptive Query Execution (AQE) (23:41)
Dynamic Partition Pruning (30:07)
Predicate Pushdown (21:29)
SQL UDFs (20:35)
Epilogue
You ROCK! (0:41)
Dynamic Partition Pruning
Content locked
If you're already enrolled,
you'll need to login
.
Enroll in Course to Unlock