InData MechanicsbyHisham Itani·Nov 25, 2020How to be successful with Apache Spark in 2021 — Data Mechanics BlogApache Spark is the leading technology for data engineering. But making Spark easy-to-use, stable, and cost-efficient remains challenging.
InData MechanicsbyHisham Itani·Nov 7, 2020Spark and Docker: Your Spark development cycle just got 10x faster!Native support for Docker is one of the main reasons companies choose to deploy Spark on top of Kubernetes instead of YARN.
InData MechanicsbyHisham Itani·Oct 20, 2020The Pros and Cons of Running Apache Spark on KubernetesKubernetes support was only recently added for Spark. How does it compare to other deployment modes and is it worth it?
InData MechanicsbyHisham Itani·Oct 20, 2020Performance of Apache Spark on Kubernetes has caught up with YARNLearn our benchmark setup, results, as well as critical tips to make shuffles up to 10x faster when running on Kubernetes!
InData MechanicsbyHisham Itani·Oct 20, 2020Data Mechanics Delight — We’re building a better Apache Spark UI“The Spark UI is my favorite monitoring tool” — said no one ever.
InData MechanicsbyHisham Itani·Oct 20, 2020How we built a Serverless Spark Platform on Kubernetes — Video Tour of Data MechanicsOur mission at Data Mechanics is to give data engineers & scientists the ability to easily build pipelines & models over large datasets.
InData MechanicsbyHisham Itani·Oct 20, 2020How-to guide: Set up, Manage & Monitor Spark on Kubernetes (with code examples)Here’s why (and how) you should be using Spark on Kubernetes!
InDeep.BIbyHisham Itani·May 11, 2020A Quick Guide To Paywalls And How To Choose The Best One For Your SiteChoosing the right paywall can affect user engagement more than you think.
InDeep.BIbyHisham Itani·Mar 24, 2020Real-time Stream Analytics and User Scoring Using Apache Druid, Flink & Cassandra at Deep.BIAt Deep.BI we track user habits, engagement, product & content performance — processing up to terabytes or billions of events of data…A response icon1A response icon1
InDeep.BIbyHisham Itani·Mar 2, 2020What’s all this buzz about first party data?A recent pivot away from third party data has businesses diving into in-house customer data. This first party data is fresh, hot and a…