A Data Engineer with a Strong Software Engineering Background

Projects

A collection of data pipelines, warehouses, and streaming systems built to solve real data engineering problems.

SQL Data Warehouse

• Integrates ERP and CRM sales data into a unified SQL Server data warehouse, where raw source data passes through the Medallion Architecture for cleansing, standardization, and transformation before being modeled into a star schema for analytical reporting and business insights.

Near Real-Time Data Pipeline

• A near-real-time retail and e-commerce data platform combining batch and streaming pipelines. Batch data moves from CSV sources through Hadoop into Databend, while real-time clickstream events are ingested with Kafka, enriched with Apache Spark, and delivered to Databend, with Apache Airflow orchestrating the end-to-end workflows.

Social Media Productivity Prediction

• Analyzes and predicts the impact of social media usage on productivity. Data is fetched from a PostgreSQL database and explored through EDA for insights. Findings are presented with an interactive Streamlit dashboard and visualization