Certified Data Engineer Professional Exam QuestionsBrowse all questions from this exam

Certified Data Engineer Professional Exam - Question 89


A Databricks job has been configured with 3 tasks, each of which is a Databricks notebook. Task A does not depend on other tasks. Tasks B and C run in parallel, with each having a serial dependency on Task A.

If task A fails during a scheduled run, which statement describes the results of this run?

Show Answer
Correct Answer: CD

In Databricks job execution, if a task that other tasks depend on fails, the dependent tasks will not be executed. Since Tasks B and C depend on Task A and Task A failed, Tasks B and C will be skipped. Some logic expressed in Task A may have been committed before the failure occurred.

Discussion

4 comments
Sign in to comment
mouad_attaqiOption: D
Oct 28, 2023

D is correct, taks B and C will definitely be skipped, since Task A is notebook, the ACID logic is at cell level, some logic might be executed before failing cell

sturcuOption: D
Oct 25, 2023

Some ops in task A may have fished before fail

DileepvikramOption: D
Nov 9, 2023

D is the answer

aragorn_bregoOption: D
Nov 21, 2023

In Databricks job execution, if a task that other tasks depend on fails, the dependent tasks will not be executed. Since Tasks B and C depend on the successful completion of Task A, they will be skipped if Task A fails. However, if Task A performs any operations that commit changes before the failure occurs (such as writing to a Delta table), those changes remain and are not automatically rolled back unless the logic within Task A specifically includes rollback mechanisms for partial failures.