Sujith Jay Nair·Oct 11, 2019Prefer Unions over Or in Spark JoinsAn anti-pattern in Spark SQL is the use of an `or` in a `join`. This might look intuitive, but has some performance issues.
InLogistimo Engineering BlogbySujith Jay Nair·Oct 2, 2018Dynamo vs Cassandra : Systems Design of NoSQL DatabasesState-of-the-art distributed databases represent a distillation of years of research in distributed systems. The concepts underlying any…
Sujith Jay Nair·Aug 18, 2018A Simple Dichotomy for Modeling Data-Intensive SystemsTL; DR: This post presents a simple, almost trivial, mental-model to help think about data-intensive systems.
InLogistimo Engineering BlogbySujith Jay Nair·Jul 24, 2018Understanding Apache Spark on YARNTL; DR Apache Spark is a lot to digest; running it on YARN even more so. I hope this post helps a bit.
Sujith Jay Nair·Feb 3, 2018An Early Employee’s Field Guide to Workplace ArgumentsConflicts are common in an early-stage startup. This post lists mental models to prevent, judge, diffuse & take leverage of conflicts.
InLogistimo Engineering BlogbySujith Jay Nair·Jan 27, 2018Multiple Parameter Lists in Scala27 Jan 2018