InSongkick TechbyEric Escalante·May 26, 2023Optimising platform spend with cluster autoscalingThis post was written originally by Phil Hope while we worked together in the Platform Team — I just helped with a bit of editingA response icon1A response icon1
InSongkick TechbyEric Escalante·Nov 17, 2020Getting Kubernetes logs into BigQuery cost-effectivelyHow we navigated those JSON logs safely to BigQuery harbourA response icon1A response icon1
InSongkick TechbyEric Escalante·Sep 23, 2019Migrating our ETL pipeline to Luigi on a CloudPreviously, on Creating a musical (data) pipeline, we shared how we went about creating a custom solution for solving our ETL needs using…
InSongkick TechbyEric Escalante·Jan 15, 2019Parsing ginormous JSON files via streamingTackling very large JSON files in a way that avoids memory limitationsA response icon1A response icon1
InSongkick TechbyEric Escalante·Feb 9, 2018Creating a musical (data) pipelineOur journey towards Big DataA response icon1A response icon1