InSalesforce EngineeringbyZhidong Ke·Sep 23, 2020Engagement Activity Delta LakeUnlike data in our other data lakes, engagement activity is mutable and the mutation ratio is high, which creates a huge challenge for us.A response icon2A response icon2
InSalesforce EngineeringbyZhidong Ke·Jun 30, 2020Guaranteed Data Delivery System for Distributed ServicesWe need our data pipeline to be reliable, with as hight a fault tolerance as possible, to satisfy our commitment to customer trust.A response icon1A response icon1
InSalesforce EngineeringbyZhidong Ke·Aug 1, 2019Our Journey to Optimal Job Sizes for Apache SparkUsing Spark to compact data lake with metadata store and dynamic job scheduler at scale