Skip to content

Schema In Spark

Lecture 7 : Schema in Spark🔗

StructType and StructField🔗

image

Example:

image

image

How to skip the header row?

df = spark.read.option("skipRows", 2).csv("file.csv")