InPython in Plain EnglishbySushil Kumar·Dec 23, 2024Automating .whl File Deployment to Azure Databricks with GitHub ActionsIntroduction
InPython in Plain EnglishbySushil Kumar·Sep 25, 2024The Impact of Row and Column Level Security with Databricks Unity Catalog on Query PerformanceDatabricks Unity Catalog offers a centralized governance platform that provides robust security features, including row and column-level…A response icon2A response icon2
Sushil Kumar·Dec 31, 2023The Big Debate : Databricks vs SnowflakeIn the realm of cloud data warehousing, two prominent contenders have emerged as frontrunners: Databricks and Snowflake. Both platforms…A response icon6A response icon6
InPython in Plain EnglishbySushil Kumar·Oct 17, 2023Policy-Based Access Control (PBAC): What It Is and Why You Need It in Your Modern Data Lakehouse ?My recent project involved implementing PBAC in a Databricks environment. It was a new challenge for me, but I’m excited to share what I…
InPython in Plain EnglishbySushil Kumar·Aug 7, 2023Say Goodbye to Pandas : Introducing PolarsA Lightning-Fast DataFrame Library for PythonA response icon1A response icon1
InPython in Plain EnglishbySushil Kumar·Jul 23, 2023Maximizing Spark Performance: Minimizing Shuffle Overhead“Shuffle the cards, not the problems.” — AnonymousA response icon2A response icon2
InPython in Plain EnglishbySushil Kumar·Jul 20, 2023A Deep Dive into Apache Spark Join StrategiesJoin operations are frequently used in big data analytics to merge two data sets, represented as tables or DataFrames, based on a common…A response icon2A response icon2
InPython in Plain EnglishbySushil Kumar·Jun 4, 2023Unlocking Performance: Exploring Delta Engine Optimizations in Databricks - (Part 1/3)Databricks, with its Delta Engine, offers a suite of powerful optimizations that can significantly enhance the performance of your data…
Sushil Kumar·Jun 3, 2023Spark Ignited: Unleashing the Performance Beast within Apache SparkIntroduction: Apache Spark has revolutionized big data processing, empowering businesses to extract valuable insights from vast datasets…