Hemant Marve·Jul 1Bloom Filters: Preventing Cache Penetration with Just a Few Megabytes of MemoryA practical, deep dive into one of the most underrated data structures in system design.A response icon1A response icon1
Hemant Marve·Feb 25, 2025Accessing iceberg tables managed by watsonx.data using Databricks SparkIntegrating databricks Spark with watsonx.data via the Iceberg REST API enables seamless access to large-scale datasets stored in Iceberg…
Hemant Marve·Jan 8, 2025Connecting Apache Spark to watsonx.data Using the Iceberg REST APIIntegrating Apache Spark with watsonx.data via the Iceberg REST API enables seamless access to large-scale datasets stored in Iceberg…
Hemant Marve·Jan 7, 2025Connect to Snowflake Open Catalog from watsonx.data SparkIn this blog, we will explore how to connect to Snowflake Open Catalog from watsonx.data using Spark. For detailed instructions on setting…
Hemant Marve·Jan 7, 2025Iceberg Rest API on WXD: Java Client PART-3 — Appending Data FilesIn Part1 & Part2 we covered basic operations & how to configure Iceberg Rest catalog Java client to connect to watsonx.data iceberg…
Hemant Marve·Jan 7, 2025Iceberg Rest API on watsonx.data: Java Client PART-2In Part1, we covered how to connect with Iceberg Type catalog in watsonx.data & use it to create a namespace & table with a defined schema…
Hemant Marve·Jan 2, 2025Iceberg Rest API on watsonx.data: Java Client PART-1In this blog post, we’ll explore how to use the Iceberg Java client to interact with Iceberg tables in WXD, leveraging the MDS Iceberg REST…
Hemant Marve·Jan 2, 2025Sync watsonx.data-ManagedParent Topic: https://mrudulamadiraju.medium.com/unity-catalog-api-iceberg-rest-catalog-api-in-watsonx-data-a4600cd8fa04
Hemant Marve·Jan 2, 2025Using AWS API Gateway as a Proxy Between Snowflake and watsonx.dataCurrently, we use an API Gateway as a proxy because the Iceberg REST Catalog is available only on the data plane in WXD. To expose the…