Retail Data Analytics Pipeline
Built an end-to-end ETL pipeline processing 541K+ real-world retail transactions, including data ingestion, cleaning, transformation, validation, and analytical loading. Designed a star-schema data warehouse with customer, product, date, and country dimensions, enabling SQL-based analysis of revenue, sales trends, products, and customer activity. Cleaned and validated raw transactional data by handling duplicates, cancellations, invalid quantities, missing customer identifiers, and inconsistent records before loading curated datasets. Implemented automated data-quality and transformation tests with Pytest and configured GitHub Actions CI to validate the pipeline on every push and pull request.
PythonSQLPandasDuckDBParquetPytestGitHub Actions