Certified Data Engineer Associate Exam

Exam Certified Data Engineer Associate All QuestionsBrowse all questions from this exam

Go to Exam

Question 80

A dataset has been defined using Delta Live Tables and includes an expectations clause:

CONSTRAINT valid_timestamp EXPECT (timestamp > '2020-01-01') ON VIOLATION FAIL UPDATE

What is the expected behavior when a batch of data containing data that violates these constraints is processed?

Records that violate the expectation are dropped from the target dataset and recorded as invalid in the event log.

Records that violate the expectation cause the job to fail.

Records that violate the expectation are dropped from the target dataset and loaded into a quarantine table.

Records that violate the expectation are added to the target dataset and recorded as invalid in the event log.

Records that violate the expectation are added to the target dataset and flagged as invalid in a field added to the target dataset.

Correct Answer: B

When a Delta Live Table has an expectations clause with the condition 'ON VIOLATION FAIL UPDATE', it signifies that the job should fail if any record violates the specified constraint. Therefore, records that do not meet the expectation will cause the job to fail, requiring manual intervention before re-processing.

Discussion

meow_akkOption: B

Ans B : delta live tables data quality expectations . - https://docs.databricks.com/en/delta-live-tables/expectations.html Action Result warn (default) Invalid records are written to the target; failure is reported as a metric for the dataset. drop Invalid records are dropped before data is written to the target; failure is reported as a metrics for the dataset. fail Invalid records prevent the update from succeeding. Manual intervention is required before re-processing.

55f31c8Option: B

https://docs.databricks.com/en/delta-live-tables/sql-ref.html#sql-properties ON VIOLATION Optional action to take for failed rows: FAIL UPDATE: Immediately stop pipeline execution. DROP ROW: Drop the record and continue processing.

BakhtiyorOption: B

ON VIOLATION FAIL UPDATE: Immediately stop pipeline execution. DROP ROW: Drop the record and continue processing.

benni_aleOption: B

b is ok