Data Ingestion into Enterprise Data Warehouse using Recon Framework, 7billion records in 25mins!

Our client was retiring the legacy systems and moving in to a single Integrated Data Store. Multiple data conversion activities relating to this retirement required a reconciliation report to identify the correct system of record.
Our associate worked towards a CVA that developed ADW Backfill Reconciliation process in a short period. The solution provides comparison of two data sets and generates attribute level change summary for the before and after snapshot.
The effort being a great success has been adopted as a common recon framework for data Ingestion into Enterprise Data Warehouse (EDW).
This reconciliation helps the requirement team to analyze the impact, refine the results and share with consumers.
During production migration, the framework reconciled around 7 billion records in just 25 minutes. This was all achieved without any implementation cost. Since the framework is metadata driven, it is highly scalable and reusable.
Subscribe to BUD for the latest CVA’s