A Delta Live Table pipeline includes two datasets defined using STREAMING LIVE TABLE. Three datasets are defined against Delta Lake table sources using LIVE TABLE.
The table is configured to run in Production mode using the Continuous Pipeline Mode.
Assuming previously unprocessed data exists and all definitions are valid, what is the expected outcome after clicking Start to update the pipeline?
In a Delta Live Table pipeline running in Production mode with Continuous Pipeline Mode, all datasets are updated at set intervals as new data arrives. The compute resources are dynamically deployed to handle the updates and are terminated when the pipeline is stopped. This ensures that the pipeline continuously processes and updates data until it is manually shut down, allowing for efficient resource management and real-time or near-real-time updates.
C. All datasets will be updated at set intervals until the pipeline is shut down. The compute resources will be deployed for the update and terminated when the pipeline is stopped. Explanation: Continuous Pipeline Mode in Production mode implies that the pipeline continuously processes incoming data updates at set intervals, ensuring the datasets are kept up-to-date as new data arrives. Since the pipeline is set to Continuous Pipeline Mode, it will keep running and updating the datasets until it is manually shut down. The compute resources are allocated dynamically to process and update the datasets as needed, and they will be terminated when the pipeline is stopped or shut down. This mode allows for real-time or near-real-time updates to the datasets from the streaming/live tables, ensuring that the data remains current and reflects the changes occurring in the data sources.
C. All datasets will be updated at set intervals until the pipeline is shut down. The compute resources will be deployed for the update and terminated when the pipeline is stopped. In the scenario described: The Delta Live Table pipeline is configured in Production mode, which means it will continuously process data using the Continuous Pipeline Mode. There are both STREAMING LIVE TABLE datasets and LIVE TABLE datasets defined. When you click Start to update the pipeline in Continuous Pipeline Mode: All datasets, including both STREAMING LIVE TABLE and LIVE TABLE datasets, will be updated at set intervals. Compute resources will be deployed for the update, ensuring that the pipeline processes data. The compute resources will be terminated when the pipeline is stopped or shut down. This setup allows for continuous data processing while efficiently managing compute resources, and the pipeline can be stopped when no longer needed.
No answer is correct. Prod Continuous mode processes data at set intervals until pipe is shutdown. However, compute must be always-on and will not terminate. https://docs.databricks.com/delta-live-tables/updates.html#continuous-triggered
You could be correct: "Triggered pipelines can reduce resource consumption and expense since the cluster runs only long enough to execute the pipeline. However, new data won’t be processed until the pipeline is triggered. Continuous pipelines require an always-running cluster, which is more expensive but reduces processing latency."
Actually it could make A the correct answer?
Answer: C
Answer: D Official Databricks practice exam with answers - question 36
Correct Answer is C. That question in the practice test is using a Triggered Pipeline. This question is using a Continuous.
Yes, You're right. Thanks.
E is not the right answer. The correct answer is C https://www.databricks.com/product/delta-live-tables
Correct is C
C. All datasets will be updated at set intervals until the pipeline is shut down. The compute resources will be deployed for the update and terminated when the pipeline is stopped. In a Delta Live Table pipeline running in Continuous Pipeline Mode, when you click Start to update the pipeline, the following outcome is expected: All datasets defined using STREAMING LIVE TABLE and LIVE TABLE against Delta Lake table sources will be updated at set intervals. The compute resources will be deployed for the update process and will be active during the execution of the pipeline. The compute resources will be terminated when the pipeline is stopped or shut down. This mode allows for continuous and periodic updates to the datasets as new data arrives or changes in the underlying Delta Lake tables occur. The compute resources are provisioned and utilized during the update intervals to process the data and perform the necessary operations.
Answer: C Pipeline mode - This specifies how the pipeline will be run. Choose the mode based on latency and cost requirements. * Triggered pipelines run once and then shut down until the next manual or scheduled update. * Continuous pipelines run continuously, ingesting new data as it arrives.
Correct answer is "C".
daje gianluca
Correct : C
All datasets will be updated at set intervals until the pipeline is shut down. The compute resources will be deployed for the update and terminated when the pipeline is stopped.