Module 9: Big Data & Data Engineering
Learn PySpark, Spark SQL, Kafka and Snowflake with practical data engineering examples.
How to use this module: follow the lessons in order if the stack is new to you, or jump directly to the topic that matches your project. Each lesson includes runnable examples, references and a downloadable notebook.
PySpark Fundamentals
PySpark Tutorial for Data Science Beginners
Spark SQL & DataFrames
Spark SQL & DataFrames Tutorial for Beginners
Kafka Streaming
Kafka Streaming Tutorial for Data Pipelines
Snowflake Warehouse
Snowflake Tutorial for Data Science Teams
Practice strategy
Run the examples locally, change one assumption at a time, and record what changes in output, latency, memory or model quality. For production topics, add one failure test before you call the exercise complete.
Next step
Return to the full Data Science curriculum to continue with the next module.
