The article covers the entire engineering process, from project planning and architecture design to data ingestion, transformation, validation, dimensional modeling, and the key engineering decisions made along the way.
Aug 10, 2026·Data Engineering
A hands-on walkthrough of a real-time e-commerce pipeline, tracking clickstream events from Kafka through Spark into Databend. Covers the engineering decisions behind combining streaming, batch processing, and Airflow orchestration.
Aug 22, 2025·Data Engineering
An article that focuses on designing the warehouse, orchestrating transformations with Airflow and dbt, and turning raw sources into reliable, analytics-ready data.
may 20, 2025·Data Engineering
