Certified Data Engineer Professional Exam

Exam Certified Data Engineer Professional All QuestionsBrowse all questions from this exam

Question 133

Which statement regarding stream-static joins and static Delta tables is correct?

The checkpoint directory will be used to track updates to the static Delta table.

Each microbatch of a stream-static join will use the most recent version of the static Delta table as of the job's initialization.

The checkpoint directory will be used to track state information for the unique keys present in the join.

Stream-static joins cannot use static Delta tables because of consistency issues.

Correct Answer: B

Each microbatch of a stream-static join uses the most recent version of the static Delta table as of the job's initialization. This means that the static Delta table does not update with each new microbatch; it remains constant for the duration of the streaming job. This approach allows for consistent joins during the entire streaming process without the need for updating the static dataset continuously.

Discussion

MDWPartnersOption: B

When Databricks processes a micro-batch of data in a stream-static join, the latest valid version of data from the static Delta table joins with the records present in the current micro-batch. Because the join is stateless, you do not need to configure watermarking and can process results with low latency. The data in the static Delta table used in the join should be slowly-changing. https://docs.databricks.com/en/transform/join.html#stream-static