DP-750: Implementing Data Engineering Solutions Using Azure DatabricksDemo

Question

HOTSPOT -

You have an Azure Databricks workspace enabled for Unity Catalog. You plan to run the following PySpark code.

Question Image

For each of the following statements, select Yes if the statement is true. Otherwise, select No.

Yes or No

Statements	Yes	No
When a new element is found in the source data, the element will be written to table1 successfully.
The streaming process will resume from a failure without data loss.
Data will be written to a JSON file.

Explanation

failOnNewColumns makes Auto Loader fail when it detects new columns without evolving the schema, so the new element is not written successfully. The checkpoint preserves Auto Loader progress and supports recovery with exactly-once writes to Delta Lake. cloudFiles.format identifies JSON as the input format, while toTable writes the output to a Delta table.

Learn more

DP-750: Implementing Data Engineering Solutions Using Azure DatabricksDemo

AstroTutor

Notes

Readiness

QuestionQ13

Community Discussion