Demo data pipeline with IaC, CI/CD, testing, and data manipulation
Project links
Skills
About this project
This project demonstrates a comprehensive data pipeline using Infrastructure as Code (IaC) with Terraform to provision AWS resources, CI/CD pipelines with GitHub Actions, and various tools for data transformation and orchestration using dbt, Databricks, and Airflow.