Medium

Jules S. Damji

Jules S. Damji

·

Oct 2, 2025

Building a Musical Analytics Pipeline with Declarative Pipelines: From Raw Data to Musical Insights

End-to-end developer experience with Databricks Free Edition

Building a Musical Analytics Pipeline with Declarative Pipelines: From Raw Data to Musical Insights

Jules S. Damji

·

Aug 26, 2025

Apache Spark™ 4.0’s Variant Data Type Eliminates Complex JSON String Processing

Three synthetic real-world use cases demonstrate gains and usage through binary encoding and direct field access.

Apache Spark™ 4.0’s Variant Data Type Eliminates Complex JSON String Processing

Jules S. Damji

·

Aug 4, 2025

Mastering PySpark Window Functions: 6 Real-World Use Cases Revisited with Spark Connect

TL; Dr

Mastering PySpark Window Functions: 6 Real-World Use Cases Revisited with Spark Connect

Jules S. Damji

·

Jul 22, 2025

Handling the Chaos: Data Quality Strategies with PySpark Ingestion

Tips and Techniques for Ingesting Large JSON files with PySpark

Handling the Chaos: Data Quality Strategies with PySpark Ingestion

Jules S. Damji

·

May 21, 2025

SQL Scripting in Apache Spark™ 4.0

The upcoming Apache Spark™ 4.0 introduces a new feature for SQL developers and data engineers: SQL Scripting. As such, this feature…

SQL Scripting in Apache Spark™ 4.0

In

The Modern Scientist

by

Jules S. Damji

·

Sep 6, 2024

Understanding Optimizers in DSPy

Optimizers with the right metrics increase accuracy in DSPy applications

Understanding Optimizers in DSPy

In

The Modern Scientist

by

Jules S. Damji

·

Jun 3, 2024

An Exploratory Tour of DSPy: A Framework for Programing Language Models, not Prompting

Is declarative approach appropriate to programming LLMs? A peek at DSPy programming model?

An Exploratory Tour of DSPy: A Framework for Programing Language Models, not Prompting

In

AI Advances

by

Jules S. Damji

·

Apr 29, 2024

An Exploratory Tour of Retrieval Augmented Generation (RAG) Paradigm

An Intuitive guide to what, why, how, and what next?

An Exploratory Tour of Retrieval Augmented Generation (RAG) Paradigm

In

AI Advances

by

Jules S. Damji

·

Mar 22, 2024

An Intuitive 101 Guide to Vector Embeddings

Vector embeddings matter as fundamental building blocks for Generative AI

An Intuitive 101 Guide to Vector Embeddings

In

AI Advances

by

Jules S. Damji

·

Mar 5, 2024

Crafting Intelligent User Experiences: A Deep Dive into OpenAI Assistants API

Elevate, Enhance, and Empower your apps with Assistants APIs and Tools

Crafting Intelligent User Experiences: A Deep Dive into OpenAI Assistants API

Jules S. Damji

Jules S. Damji

Developer at heart; Advocate by nature | Communicator by choice | Avid Arsenal Fan| Love Reading, Writing, APIs, Coding | All Tweets are Mine

Following

Help

Status

About

Careers

Press

Blog

Store

Privacy

Rules

Terms

Text to speech