Noah Kennedy·Jun 27, 2024How To Migrate Multi-Terabyte Datasets to a PGVector DatabaseLessons on Big Data learned through trial and error
InStackademicbyNoah Kennedy·Mar 26, 2024Spark Performance Tuning for BigQuery APIsAt the end of 2023, my team was given an important initiative — run a Natural Language Processing (NLP) algorithm on about a billion pages…
InStackademicbyNoah Kennedy·Feb 7, 2024Reducing BigQuery Costs by 100–200x with dbt Incremental ModelsMany models my team works with at Tempus are large, but not “big data” large. Usually, our tables hover around the hundred-million rows…A response icon2A response icon2
Noah Kennedy·Jan 31, 2024Several Examples of Why AI Is Not Going to Replace Our JobsAnytime soon at least. Disclaimer: this article is not serious.
InStackademicbyNoah Kennedy·Jan 9, 2024Three Key BigQuery Optimizations We Should All Be UsingDuring a recent BigQuery debugging session, I dove deep into BigQuery and learned a few important lessons that I believe are not well-known…A response icon4A response icon4
Noah Kennedy·Dec 14, 2023Debug Diaries: duplicate records in dbt SnapshotsHi, my name is Noah — I’m a Senior Data Engineer at Tempus AI. I write about the tech challenges I face with the hope of creating that…A response icon1A response icon1
InStackademicbyNoah Kennedy·Nov 20, 2023SQL and dbt 101I volunteer on the Tempus Board of Education (TBOE) in my free time. TBOE is a group that aims to provide Tempus employees with courses and…A response icon3A response icon3
Noah Kennedy·Nov 8, 2023Elementary on dbt — An OverviewIf you’ve read my previous articles, you’ll know that I’m a dbt evangelist and a huge advocate of the importance of proper testing…A response icon1A response icon1
Noah Kennedy·Oct 31, 2023Four Simple Frameworks to Improve Communication Skills as an EngineerFrameworks to help you be a more effective communicator, and therefore a more effective Individual Contributor (IC).
Noah Kennedy·Jul 20, 2023Three dbt Macros I Use Every DayLast month my team here at Tempus built out a new data mart using our normal tech stack of SQL + AirFlow + dbt in GCP, and I realized that…A response icon2A response icon2