Posts

All the articles I've posted.

• Enviroments in Virtual Env

  31 Oct, 2022

  The importance of using environments As was said in Setting environments in Python it’s important to use environments for your deployment, even if these are side projects or wild repositories. But at

• Event Driven Architectures

  29 Oct, 2022

  In the Gartner Submit of 2006 Mani Chandy talked about the existence of a misconception of Event Driven Architecture (EDA). So, he proposed to talk about the understanding of EDA and its Return of

• Matei Zaharia - Spark: The Definitive Guide - Architecture of a Spark Application

  23 Oct, 2022

  The Architecture of a Spark Application The Spark driver The driver is the process “in the driver seat” of your Spark Application. It is the controller of the execution of a Spark Application and

• Matei Zaharia - Spark: The Definitive Guide - Life Cycle of a Spark Application

  23 Oct, 2022

  The Life Cycle of a Spark Application (Inside Spark) The SparkSession The first step of any Spark Application is creating a SparkSession. In many interactive modes, this is done for you, but in an

• Matei Zaharia - Spark: The Definitive Guide. Common Operations

  22 Oct, 2022

  Define Schemas manually When using Spark for production Extract, Transform, and Load (ETL), it is often a good idea to define your schemas manually, especially when working with untyped data sources

• Kleppmann - Designing Data Intensive Applications

  17 Oct, 2022

  A data-intensive application is typically built from standard building blocks that provide commonly needed functionality. For example, many applications need to: • Store data so that they, or another

• Testing in Python: Pytest Vs Unit test

  16 Oct, 2022

  How important are the tests? Testing is one of the most important skills we need to develop once we join the industry. In fact, knowing about testing is something that is not as evaluated as it could

• Why is it important to know what Environment Variables are?

  7 Oct, 2022

  While learning to avoid hardcoding some keys in my projects, I found the concept of environment variables. I've found this interesting article about this topic here in medium: An Introduction to