Which statement regarding stream-static joins and static Delta tables is correct?
Which statement regarding stream-static joins and static Delta tables is correct?
Each microbatch of a stream-static join uses the most recent version of the static Delta table as of the job's initialization. This means that the static Delta table does not update with each new microbatch; it remains constant for the duration of the streaming job. This approach allows for consistent joins during the entire streaming process without the need for updating the static dataset continuously.
When Databricks processes a micro-batch of data in a stream-static join, the latest valid version of data from the static Delta table joins with the records present in the current micro-batch. Because the join is stateless, you do not need to configure watermarking and can process results with low latency. The data in the static Delta table used in the join should be slowly-changing. https://docs.databricks.com/en/transform/join.html#stream-static