QuestionQ57

VerifiedIngest and transform data

You have a Fabric warehouse named DW1 that contains a Type 2 slowly changing dimension (SCD) table named DimCustomer. DimCustomer has 100 columns and 20 million rows. The columns use various data types, including int, varchar, date, and varbinary.

You need to identify incoming changes to the table and update records whenever a change occurs. The solution must minimize resource consumption.

What should you use to identify attribute changes?

Explanation

A hash of the tracked source attributes provides a compact value for change detection, so comparisons do not need to evaluate every attribute individually for each row. In a Type 2 SCD process, the source hash can be compared with the corresponding dimension hash to identify new or changed records efficiently; changed dimension versions can then be expired and replaced with new versions.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!