QuestionQ31
VerifiedData Ingestion and TransformationA company has created several AWS Glue extract, transform, and load (ETL) jobs that validate and transform data from Amazon S3. The ETL jobs load data into Amazon RDS for MySQL in batches once per day. The ETL jobs use a DynamicFrame to read the S3 data.
The ETL jobs currently process all data in the S3 bucket. However, the company wants the jobs to process only the daily incremental data.
Which solution will satisfy this requirement with the LEAST coding effort?
Community Discussion