QuestionQ113

VerifiedData Operations and Support

An investment company must manage and derive insights from an ever-growing volume of semi-structured data.

A data engineer must deduplicate this semi-structured data, delete duplicate records, and remove common misspellings among duplicates.

Which solution meets these requirements with the LEAST operational overhead?

Explanation

AWS Glue FindMatches is a managed machine learning record-matching transform that identifies duplicate or matching records even when there is no shared unique identifier and fields do not match exactly, including variations such as different spellings. It supports deduplication and incremental matching for continuously growing datasets, avoiding the custom matching logic and operational management required by the alternatives.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!