High-Level Architecture
The following diagram summarises the end-to-end data flow:
| Layer | DAG / Process | Description |
|---|---|---|
| Source Systems | cust_src_ldz_master_dagcamp_src_ldz_master_dag | Bespoke ETL from HCL Unica Campaign / Customer |
| RAW LDZ | cust_src_ldz_master_dag | History-preserving raw copies with load timestamps |
| ANP | cust_ldz_anp_master_dag | Anonymisation / Normalisation intermediate layer |
| RDV / BDV | cust_anp_rdv_bdv_master_dag | Raw Data Vault (Hub, Link, Satellite) + Business Data Vault |
| Bridge & 360 | cdm_bridge_aggregate_360_dag360_master_dag | Customer 360 core tables and views |
| ML Enrichment | cdm_ml_master_dag | ML feature generation and enrichment |
| Publish | cdm_publish_db | Dimensional views for downstream consumption |