spark Track Masterclass

Apache Spark Curriculum Roadmap

Follow our structured masterclass to learn Apache Spark from scratch. Choose a module below or navigate through lessons using the sidebar.

0 Modules•0 Total Lessons•100% Free & Open

Interactive Hands-On Practice Bypasses Setup!

Put your knowledge to the test inside the browser

Don't just read about algorithms—build them. Write scripts in our Playground or challenge yourself on interactive exercises evaluated via WebAssembly.

1. Fundamentals

11 Lessons

Introduction to Apache Spark Why Apache Spark?History of Apache Spark Spark Ecosystem Spark Core Architecture Driver vs Executors Cluster Managers Spark Application Lifecycle Web UI & Monitoring Installation & Local Setup Running Your First Spark Application

3. Data Sources & Connectors

19 Lessons

CSV JSON Parquet ORC Avro Delta Lake Apache Iceberg Apache Hudi JDBC MySQL PostgreSQL SQL Server BigQuery Snowflake Kafka Hive Amazon S3 Google Cloud Storage Azure Blob Storage

4. RDD API

14 Lessons

Introduction to RDD Creating RRDs RDD Transformations Map & Filter API RDD Actions Pair RDDs ReduceByKey GroupByKey AggregateByKey CombineByKey Persistence Broadcast Variables Accumulators RDD vs DataFrame

5. Structured Streaming

16 Lessons

Introduction to Structured Streaming Streaming Architecture Streaming Sources & Sinks Reading Streams Writing Streams Kafka Streaming File Streaming Watermarks Windowed Aggregations Stateful Processing Stream Joins Output Modes Trigger Types Checkpointing Exactly Once Processing Monitoring Streaming Jobs

7. Spark Internals

10 Lessons

Job Execution Flow Logical Plan Physical Plan Explain Plan DAG Scheduler Task Scheduler Block Manager Shuffle Manager Memory Manager Whole Stage Code Generation

8. Deployment & Cluster Managers