QuestionQ298
Data Security and GovernanceA company reviews data in a data lake each quarter to conduct inventory assessments. A data engineer uses AWS Glue DataBrew to identify personally identifiable information (PII) about customers in the data. The company’s privacy policy treats certain custom information categories as PII. However, these categories are not covered by the standard DataBrew data quality rules.
The data engineer must update the existing process to scan multiple datasets in the data lake for the custom PII categories.
Which solution meets these requirements with the LEAST operational overhead?
- A Manually review the data for custom PII categories.
- B Implement custom data quality rules in DataBrew. Apply the custom rules across datasets.
- C Develop custom Python scripts to detect the custom PII categories. Call the scripts from DataBrew.
- D Implement regex patterns to extract PII information from fields during extract transform, and load (ETL) operations into the data lake.
Community Discussion