A data engineering team enables automatic liquid clustering (CLUSTER BY AUTO) on a Unity Catalog managed Delta table using Databricks Runtime 15.4 LTS. Which of the following statements CORRECTLY describes how automatic liquid clustering selects and maintains clustering keys?
Answer & explanation
Correct answer: C
WHY C: The Databricks documentation describes automatic liquid clustering as follows: (1) 'Analyzes query workload: Databricks analyzes the table's historical query workload and identifies the best candidate columns for clustering.' (2) 'Adapts to changes: If your query patterns or data distributions change over time, automatic liquid clustering selects new keys to optimize performance.' (3) 'Cost-aware selection: Databricks changes clustering keys only when the predicted cost savings from data skipping improvements outweigh the data clustering cost.' Additionally, automatic key selection requires predictive optimization and runs asynchronously as a maintenance operation, not during writes.
WHY NOT A: Automatic liquid clustering does NOT select a fixed column at creation time and hold it. Its defining characteristic is adaptation: if query patterns change over time, the platform selects new clustering keys to reflect the updated workload. Cardinality alone does not determine key selection; historical query filter patterns are the primary signal.
WHY NOT B: CLUSTER BY AUTO does NOT require the engineer to specify initial clustering columns. The point is that Databricks selects the keys based on workload analysis. Engineers specify CLUSTER BY AUTO (or ALTER TABLE ... CLUSTER BY AUTO) and the platform handles key selection.
WHY NOT D: Automatic liquid clustering does NOT recluster the existing records on every INSERT. OPTIMIZE operations trigger the incremental physical reclustering, and they run asynchronously via predictive optimization. Write operations apply clustering on write only when data in the transaction meets a defined size threshold. Reclustering every record on every write would be prohibitively expensive for large tables.