Skip to content

Spark Ecosystem

Lecture 5 : Read Modes in Spark🔗

image

format data file format : csv,json,jdbc and odbc connection. Format is optional parameter, by default its parquet format

option inferschema, mode and header [optional field]

schema manual schema can be passed here

load path from where we need to read the data [not optional]

DataframeReader API🔗

Access it using 'spark.read' in the spark session

image

mode in Spark🔗

image