DP-750: Implementing Data Engineering Solutions Using Azure DatabricksDemo

By Microsoft · Question Mode

QuestionQ15

Prepare and process data

You have an Azure Databricks workspace enabled for Unity Catalog containing a Delta table named db1.sales_orders. The table is updated nightly and has change data feed (CDF) enabled.

You must ingest every change from db1.sales_orders—inserts, updates, and deletes—into a downstream pipeline.

Complete the PsySpark code segment by selecting the appropriate options.

Select
spark.readStream \
    .format(“delta”) \
    .option(, “true”) \
    .option(, “false”) \
    .table(“db1.sales_orders”)
Explanation

readChangeFeed=true makes Structured Streaming read Delta Change Data Feed records, which include insert, update, and delete changes. skipChangeCommits=false prevents the reader from skipping commits that modify or delete existing records.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!