Massimiliano Figini
Only My Notes

Only My Notes

Intro to Spark SQL in Python

Nov 21, 20211 min read

Spark SQL is a component of Apache Spark that works with tabular data. # Load data from file df = spark.read.csv("trains.csv", header=True) # Create temporary table called table1 df.createOrReplaceTempView("trains") # Inspect the columns in the t...