AWS YouTube Data Analysis

Analyzed YouTube trending data using AWS to build a scalable pipeline for ingestion, ETL, and centralized storage. Created QuickSight dashboard showing video views by country, category, and region. Workflow included data ingestion, preprocessing, cataloging, and analysis.

End-to-End Pipeline with Docker, Kafka, Airflow, Spark, and Cassandra

Scalable end-to-end pipeline using Docker, Kafka, Airflow, Spark, Cassandra, PostgreSQL. Ingests API data, streams through Kafka, processes with Spark, stores in Cassandra, PostgreSQL. Fault-tolerant, containerized setup for seamless ingestion, processing, storage.

Azure Medallion Pipeline

Implemented a complete data engineering pipeline using the Medallion Architecture (Bronze, Silver, and Gold layers) within Azure Databricks. Integrates several Azure services and dbt to orchestrate data ingestion, transformation, and storage, ensuring a robust, scalable, and secure solution.

Simple ELT Pipeline

Built a simple ELT pipeline using dbt (Data Build Tool) to transform data in Snowflake, with orchestration managed by Apache Airflow. This setup showcases a modern data engineering workflow, essential for handling large-scale data transformations efficiently.

G20 Bank Data Analytics and Dashboard

Dynamic exploratory data analysis (EDA) of G20 countries using Python and Tableau. Leveraging live data from the World Bank API, it highlights economic and social trends like GDP, inflation, and trade balances. Interactive dashboards reveal actionable insights for policymakers and analysts.

HR Analytics: Absenteeism Analysis and Dashboard

Combined SQL and Power BI to analyze employee absenteeism and reward healthy behaviors. Key features: identifying employees for bonuses, wage increases for non-smokers, insights into absenteeism trends. Dashboard delivers actionable insights for HR decision-making and policy optimization.