InData Engineer ThingsbyTuan Minh Vu·19h agoStreaming to Iceberg: Kafka Connect vs FlinkAll Data engineers have to do data ingestion, which is a process of collecting, importing, and moving raw data from diverse sources into a…
InData Engineer ThingsbyTuan Minh Vu·Nov 7Min/Max in Iceberg, why it’s ridiculously fast?I have been working on ingestion recently, from RDBMS to Iceberg. The jobs are operated on batches. Basically, everyone will immediately…A response icon1A response icon1
InData Engineer ThingsbyTuan Minh Vu·Oct 6Do you really understand Apache Iceberg Delete file?A crucial concept in Apache Iceberg: merge-on-read (MOR) and copy-on-write (COW). The default mode is COW, but COW does not fit every use…A response icon2A response icon2
InTowards Data EngineeringbyTuan Minh Vu·Sep 19A myth of Spark repartition and coalesceSpark is no stranger to Data engineers. Our ETLs run smoothly and scalably thanks to Spark. Partition is one of the most basic concept in…A response icon1A response icon1
InTowards Data EngineeringbyTuan Minh Vu·Sep 13Iceberg Isolation levels deep dive: Serializable vs SnapshotI have been working with Apache Iceberg for a few years, searching and configuring table properties is part of my work. Iceberg allows user…A response icon1A response icon1