Module 5: PySpark Programming: Spark SQL and DataFrame

In this module, we will learn about PySpark programming focusing on the Spark SQL module and the DataFrame API.

Contents:

• PySpark Programming: Spark SQL and DataFrame API
  • Outline
  • Spark SQL Overview
  • Performance optimizations
  • Applications of Spark SQL
  • DataFrame