QuestionQ40

Data Ingestion and Transformation

A company keeps historical customer data in an Amazon Redshift table. A column named Email has null entries and values that are not email addresses. The quality of the Email column is critical to multiple downstream processes. A data engineer must create an AWS Glue Data Quality rule that fails if the percentage of valid email addresses in the Email column is below 90%.

Which component of an AWS Glue Data Quality rule meets these requirements?

  • A Uniqueness "Email" matches "[%@%.%]" with a threshold set to > 0.9
  • B ColumnValues "Email” matches "[%@%.%]" with a threshold set to > 0.1
  • C ColumnValues "Email" matches "[%@%.%]" with a threshold set to > 0.9
  • D UniqueValueRatio "Email" matches "[%@%.%]" with a threshold set to > 0.1
Explanation

AWS Glue Data Quality uses ColumnValues to evaluate values in a specific column against a regular expression. A matches condition with with threshold > 0.9 requires more than 90% of Email values to match the pattern; null values fail this positive match and therefore count against the threshold. Uniqueness and UniqueValueRatio evaluate value distinctness, not whether values have a valid email format.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!