Skip to content

Why Apache Spark

Lecture 2 : Why Apache Spark?🔗

Different Databases image

new formats like video, audio, json,avro started coming in but rdms cannot handle it.

volume of data also increased.

What is Big Data?🔗

image

Data Lake works on Extract Load Transform architecture

Issues with RDBMS🔗

  • Storage
  • Processing - RAM and CPU

Enter Spark...

image

Monolith vs Microservice Architecture🔗

image