The challenge behind the platform.
Teams across several business domains needed a common data foundation spanning ingestion, warehousing, and downstream analytics.
My contribution
Primary solution architect, from initial design through platform evolution and delivery.
Inside the system.
Designed reusable, restartable, metadata-driven ETL patterns to support scalable onboarding.
Architected AWS pipelines orchestrated through Airflow, with Redshift and PostgreSQL warehouse models.
Integrated source-to-target testing with issue-tracking evidence and established CI/CD and regression processes.
Replaced access-key-based access with IAM role-based authentication and optimised EMR configurations for workload needs.
AWS · Airflow · Redshift · PostgreSQL · Python / PySpark
From design to delivery.
Collaborated with business stakeholders on platform and supply-chain solution design. Translated requirements into delivery backlogs, Agile/Scrum execution, data-quality controls, and SLA governance.
Established a shared enterprise data foundation and reusable ingestion and modelling patterns across multiple business domains; workload optimisation improved infrastructure utilisation.