Sitemap
Towards Dev

A publication for sharing projects, ideas, codes, and new theories.

Case sensitive and Case insensitive in spark Data Frames

--

Press enter or click to view image in full size

While working on spark Dataframe in spark, I found some useful insights about case sensitive and case insensitive.

  1. col(“column name”)

Here column name is case sensitive, Here follows the code below

2. dataframe.<column name>

Get SIRIGIRI HARI KRISHNA’s stories in your inbox

Join Medium for free to get updates from this writer.

Here Column name is case insensitive

Press enter or click to view image in full size

Here Fname is different what i defined in spark data frame(FNAME)

Press enter or click to view image in full size

Here, If I tried to provided irrespective of column names in dataframe.<column name> it will throws error, be cautious about case insensitive

Press enter or click to view image in full size

Fell free to like,share,comments,suggestions

Dmytro Iakubovskyi:FYI

--

--

SIRIGIRI HARI KRISHNA
SIRIGIRI HARI KRISHNA

Written by SIRIGIRI HARI KRISHNA

Data Engineer passionate about Spark, Databricks, and the Cloud. Simplifying data complexities on my Medium blog. Let's dive into the world of data together!

Towards Dev
Towards Dev

Published in Towards Dev

A publication for sharing projects, ideas, codes, and new theories.