“With 5 years of experience in data analysis and engineering, Andrew has consolidated requirements across manufacturing, logistics, and sales teams to build a data warehouse with ETL pipelines on AWS cloud for a global electronics company valued at $500 million USD. The data warehouse was designed for data modelling such as regression and forecasting; thus, it was built with a data dictionary and ETL dashboard to monitor data integrity.”
Figure 1. Overview of Data Ingestion Pipeline
Previously, MySQL and phpMyAdmin were set up using Docker containers to store the bicycle rides data from Bix...