The Architecture of Apache Spark

In this article, we’ll delve into Apache Spark.

We’ll talk about

• History of MapReduce, how it works and issues

• The creation of Apache Spark

• Overview of Spark

• Why is Spark fast

• Spark’s Architecture

• Resilient Distributed Datasets (RDDs)

and more!

This article is only for Quastor Pro readers.

With Quastor Pro, you also get weekly deep dives on topics in building large scale systems (in addition to the blog summaries).

If you’re interested in mid/senior-level roles at Big Tech companies, then Quastor Pro is super helpful for system design interviews.

You should be able to expense Quastor Pro with your job’s learning & development budget. Here’s an email you can send to your manager.

Become a paying subscriber of Quastor Pro to get access to this post and other subscriber-only content.

Already a paying subscriber? Sign In.

A subscription gets you:

• • Weekly Articles Breaking Down Concepts in System Design
• • No Ads in Quastor
• • Support Quastor (run by a solo dev)!