Infugue-projectbyKevin Kho·Apr 10, 2023Benchmarking PySpark Pandas, Pandas UDFs, and Fugue PolarsA case study on the performance of group-map operations on different backends.A response icon2A response icon2
Infugue-projectbyKevin Kho·Jan 16, 2023Large Scale Image Processing with Spark through FugueHow Clobotics Runs Distributed Image ProcessingA response icon1A response icon1
InTDS ArchivebyKevin Kho·Oct 4, 2022Large Scale Data Profiling with whylogs and Fugue on Spark, Ray or DaskProfiling large-scale data for use cases such as anomaly detection, drift detection, and data validation
InTDS ArchivebyKevin Kho·Aug 23, 2022Why SQL-Like Interfaces are Sub-optimal for Distributed ComputingExamining the limitations of the SQL interfaceA response icon5A response icon5
InTDS ArchivebyKevin Kho·Jun 7, 2022Why Pandas-like Interfaces are Sub-optimal for Distributed ComputingA deep look at the assumptions of the Pandas interfaceA response icon4A response icon4
InThe Prefect BlogbyKevin Kho·Mar 1, 2022Introducing Prefect-ML: Orchestrate a Distributed Hyperparameter Grid Search on DaskUse Prefect as a machine learning experiment tracker by leveraging mapping and artifacts.
InTDS ArchivebyKevin Kho·Feb 14, 2022Introducing Fugue — Reducing PySpark Developer FrictionIncrease developer productivity and decrease costs for big data projectsA response icon2A response icon2
InTDS ArchivebyKevin Kho·Jan 7, 2022Scaling PyCaret with Spark (or Dask) through FugueRun PyCaret functions on each partition of data distributedlyA response icon2A response icon2
InTDS ArchivebyKevin Kho·Nov 8, 2021Delivering Spark Big Data Projects Faster and Cheaper with FugueIncrease developer productivity and decrease compute usage for big data projects
InPlumbers Of Data SciencebyKevin Kho·Nov 5, 2021Using FugueSQL on Spark DataFrames with DatabricksIn a previous article, I wrote about FugueSQL as a SQL interface on top of Spark, Dask, and Pandas DataFrames. For those familiar with…