PinnedInITNEXTbyRamses Alexander Coraspe Valdez·Jul 9, 2022Building a Schema Inference Data Pipeline for Large CSV filesA parallel implementation with pythonA response icon1A response icon1
PinnedInITNEXTbyRamses Alexander Coraspe Valdez·Jun 12, 2022Building Real-time communication with Apache Spark through Apache LivyDockerizing and Consuming an Apache Livy environmentA response icon1A response icon1
PinnedInITNEXTbyRamses Alexander Coraspe Valdez·Jun 7, 2022How to build a DAG based Task Scheduling tool for Multiprocessor systems using pythonScheduling Big Data Workloads and Data Pipelines in the Cloud with pyDag
PinnedInGeek CulturebyRamses Alexander Coraspe Valdez·Jun 5, 2022Design, Development and Deployment of a simple Data PipelineData Engineering technical challenge (part 1)
PinnedInAWS in Plain EnglishbyRamses Alexander Coraspe Valdez·Apr 30, 2021Building an ETL pipeline with Apache Airflow and Visualizing AWS Redshift data using Power BITracking Uber Rides and Uber Eats expenses with Apache Airflow, AWS Redshift and Power BI.A response icon2A response icon2
Ramses Alexander Coraspe Valdez·Dec 21, 2022Working with large CSV files in Python from Scratch5 Techniques
Ramses Alexander Coraspe Valdez·Dec 11, 2022Designing and Planning an Event Store SystemCQRS and Event Sourcing design patterns
InPython in Plain EnglishbyRamses Alexander Coraspe Valdez·Jun 14, 2022Building, Preparing and Cleaning a Real Estate DatasetDockerizing a Python Script for Faster Web Scraping
InPython in Plain EnglishbyRamses Alexander Coraspe Valdez·Apr 20, 2022How to Build a Lossless Data Compression and Data Decompression PipelineA parallel implementation of the bzip2 high-quality data compressor tool in Python.