Apache SparkContents Apache Spark Introduction Spark vs Hadoop MapReduce Spark Architecture Spark Setup and Installation Spark Shell and SparkContext Spark SparkSession and Configuration Core Concepts Spark RDD Basics Spark RDD Transformations Spark RDD Actions Spark Pair RDDs Spark Lazy Evaluation Spark DAG, Stages and Tasks Spark Partitioning and Parallelism DataFrames and SQL Spark DataFrames Intro Spark DataFrame Operations Spark Built-in Functions Spark SQL and Queries Spark Window Functions Spark User Defined Functions Spark Datasets Data Sources and I/O Spark Reading and Writing Data Spark File Formats Spark Schema Definition Spark JSON and Nested Data Spark JDBC Connections Spark Tables and Catalog Spark Delta Lake Basics Performance and Optimization Spark Caching and Persistence Spark Joins and Shuffles Spark Broadcast Variables and Accumulators Spark Catalyst Optimizer Spark Adaptive Query Execution Spark Data Skew Handling Spark Tuning and Performance Streaming and Advanced APIs Spark Structured Streaming Spark Streaming Windows and Watermarks Spark Streaming with Kafka Spark MLlib Machine Learning Spark ML Pipelines Spark GraphX and Graph Processing Deployment and Production Spark Cluster Managers Spark Submit and Deployment Spark Cloud Storage Access Spark UI and Monitoring Spark Testing and Debugging Spark Production Best Practices Spark ETL Pipeline Project