Certified Data Engineer Professional Exam

Exam Certified Data Engineer Professional All QuestionsBrowse all questions from this exam

Question 135

Which statement describes Delta Lake optimized writes?

Before a Jobs cluster terminates, OPTIMIZE is executed on all tables modified during the most recent job.

An asynchronous job runs after the write completes to detect if files could be further compacted; if yes, an OPTIMIZE job is executed toward a default of 1 GB.

A shuffle occurs prior to writing to try to group similar data together resulting in fewer files instead of each executor writing multiple files based on directory partitions.

Optimized writes use logical partitions instead of directory partitions; because partition boundaries are only represented in metadata, fewer small files are written.

Correct Answer: C

A shuffle occurs prior to writing to try to group similar data together resulting in fewer files instead of each executor writing multiple files based on directory partitions. This description aligns with the concept of Delta Lake optimized writes, where data is reorganized before writing to reduce the number of output files and improve efficiency.

Discussion

vexor3Option: C

C is correct