QuestionQ40

VerifiedData Ingestion and Transformation

A company keeps historical customer data in an Amazon Redshift table. A column named Email has null entries and values that are not email addresses. The quality of the Email column is critical to multiple downstream processes. A data engineer must create an AWS Glue Data Quality rule that fails if the percentage of valid email addresses in the Email column is below 90%.

Which component of an AWS Glue Data Quality rule meets these requirements?

Explanation

AWS Glue Data Quality uses ColumnValues to evaluate values in a specific column against a regular expression. A matches condition with with threshold > 0.9 requires more than 90% of Email values to match the pattern; null values fail this positive match and therefore count against the threshold. Uniqueness and UniqueValueRatio evaluate value distinctness, not whether values have a valid email format.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!