Certified Data Analyst AssociateDemo

By Databricks · Question Mode

QuestionQ23

Analyzing Queries

A data analyst is troubleshooting a Databricks SQL query that fails while processing large datasets and complex join operations. Logs show that the job repeatedly aborts because of cluster resource-constraint errors.

Which Query Profile metric should the analyst use to find the operator causing the resource overuse?

  • A Time spent per operator
  • B Shuffle read size per operator
  • C Memory peak per operator
  • D Bytes spilled to disk per operator
Explanation

Peak memory by operator directly shows which query-plan operator consumes the most memory and is therefore the likely source of a memory-related resource constraint failure. Databricks Query Profile exposes Memory peak as an operator metric in the execution DAG.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!