QuestionQ32

VerifiedMaintain a data analytics solution

You have a Fabric tenant that contains a lakehouse named Lakehouse1. Lakehouse1 contains a Delta table that has one million Parquet files.

You need to remove files that were NOT referenced by the table during the past 30 days. The solution must ensure that the transaction log remains consistent, and the ACID properties of the table are maintained.

What should you do?

Explanation

The VACUUM command is the correct operation for removing unreferenced Parquet files from a Delta table while preserving transaction log consistency and ACID properties. It safely removes files no longer referenced by the table without affecting data integrity. File explorer deletion would bypass safety checks, and OPTIMIZE with Z-order or V-order are used for performance tuning, not file cleanup.

Community Discussion

No comments yet. Be the first to start the discussion!