Certified Data Engineer Professional Exam

Exam Certified Data Engineer Professional All QuestionsBrowse all questions from this exam

Question 151

The data governance team is reviewing code used for deleting records for compliance with GDPR. The following logic has been implemented to propagate delete requests from the user_lookup table to the user_aggregates table.

Assuming that user_id is a unique identifying key and that all users that have requested deletion have been removed from the user_lookup table, which statement describes whether successfully executing the above logic guarantees that the records to be deleted from the user_aggregates table are no longer accessible and why?

No; the Delta Lake DELETE command only provides ACID guarantees when combined with the MERGE INTO command.

No; files containing deleted records may still be accessible with time travel until a VACUUM command is used to remove invalidated data files.

No; the change data feed only tracks inserts and updates, not deleted records.

Yes; Delta Lake ACID guarantees provide assurance that the DELETE command succeeded fully and permanently purged these records.

Correct Answer: B

Successfully executing the above logic does not guarantee that the records to be deleted from the user_aggregates table are no longer accessible. In Delta Lake, deleted records can still be accessible through the time travel feature until a VACUUM command is used to permanently remove the invalidated data files. Thus, to ensure that the records are not accessible, the VACUUM command must be executed after the DELETE command.

Discussion

imatheushenriqueOption: B

B. No; files containing deleted records may still be accessible with time travel until a VACUUM command is used to remove invalidated data files.