Load the DWH Dimension Tables Idea load the DWH dimension tables using SCD Type I Level Basic Project Star Schema Integration Job Reading Order 5/7 Project Date @August 10, 2022 Purpose Requirements Job overview Components Connect DWH Select ODS Account Set UID and data types Write SCD Get metadata Write metadata Select ODS Entity Set UID and data types Write SCD Get metadata Write metadata Purpose Once the data is loaded into the staging ODS area, the purpose of this job is to : Make a couple of simple transformations (data type update, integration of the UID) Update the DWH information with up-to-date dimension information Keep a track record of the metadata Requirements Load the DWH Dimension Tables 1 We use SCD Type I based on the below requirement : Account and Entity information rarely change but it should be possible for the client to easily update this information and dynamically re-assign historical values to the updated information. Previous Account and Entity value assignments are irrelevant for the client. As usual, we update the audit table based on the defined requirements : Each data ETL load/reload batch should be traceable through a uniquely generated UID. All DML changes should be tracked in a metadata table. This metadata table should contain the number of rows deleted, inserted, updates, rejected, as well as the batch UID. Job overview Components Connect DWH Load the DWH Dimension Tables 2 Select ODS Account Set UID and data types Load the DWH Dimension Tables 3 Write SCD Get metadata Load the DWH Dimension Tables 4 Write metadata Select ODS Entity Set UID and data types Load the DWH Dimension Tables 5 Write SCD Get metadata Load the DWH Dimension Tables 6 Write metadata Load the DWH Dimension Tables 7
Enter the password to open this PDF file:
-
-
-
-
-
-
-
-
-
-
-
-