Tag: Spark

All the articles with the tag "Spark".

• Matei Zaharia - Spark: The Definitive Guide - Life Cycle of a Spark Application

  23 Oct, 2022

  The Life Cycle of a Spark Application (Inside Spark) The SparkSession The first step of any Spark Application is creating a SparkSession. In many interactive modes, this is done for you, but in an

• Matei Zaharia - Spark: The Definitive Guide. Common Operations

  22 Oct, 2022

  Define Schemas manually When using Spark for production Extract, Transform, and Load (ETL), it is often a good idea to define your schemas manually, especially when working with untyped data sources