Tom Xiao·Jan 1, 2024Data on EKS Platform Series 2 — Setup IDE for DEP platform (WIP)Following our last blog, we will setup an IDE which provides ad-hoc querying, data development, and job approval workflows.
Tom Xiao·Dec 6, 2023Data on EKS Platform Series 1— A Comprehensive Guide to Permission Management in Big Data…1. Introduction
Tom Xiao·Oct 6, 2023Recovering Accidentally Transitioned S3 Files from the Glacier TierAre you stuck with S3 files that were accidentally moved to the Glacier storage tier? Do you need an efficient yet simple way to restore…A response icon1A response icon1
Tom Xiao·Feb 27, 2022Data Platform from the ground up-Setup Superset in production (High availability/Async) with…In this article, we are going to setup a BI tool with Superset in production environment.A response icon1A response icon1
Tom Xiao·Feb 6, 2022AWS ElastiCache(Redis) With TLSTo help keep your data secure, Amazon ElastiCache and Amazon EC2 provide mechanisms to guard against unauthorized access of your data on…A response icon1A response icon1
Tom Xiao·Jan 3, 2022AWS Network — All You Need to Know (WIP_In this article, we are going to build up entire network on AWS to support our cloud services. The architecture is shown below.
Tom Xiao·Dec 17, 2021Data Platform from the ground up — 1. Cloud ServiceWe are build our data platform on AWS so the very first step is to apply for necessary cloud services. Required resources are listed below: