DP-750: Implementing Data Engineering Solutions Using Azure DatabricksDemo

By Microsoft · Question Mode

QuestionQ75

Prepare and process data

You have an Azure Databricks workspace enabled for Unity Catalog. You must ingest CSV files from an external Azure Data Lake Storage Gen2 container into a managed Delta table.

The solution must:

  • Load data incrementally as new files arrive.
  • Minimize custom code and operational effort.

How should you complete the SQL statement?

Select
 main.sales.orders
 'abfss://raw@storage1.dfs.core.windows.net/orders/'
FILEFORMAT = CSV
Explanation

COPY INTO incrementally and idempotently loads files from a cloud-storage location into an existing Delta table, skipping files that were already loaded. FROM introduces the source location, and FILEFORMAT = CSV specifies the source format. This meets the requirement to ingest newly arriving CSV files with minimal custom processing.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!