Certified Data Engineer Professional Exam QuestionsBrowse all questions from this exam

Certified Data Engineer Professional Exam - Question 99


The data governance team is reviewing code used for deleting records for compliance with GDPR. The following logic has been implemented to propagate delete requests from the user_lookup table to the user_aggregates table.

Assuming that user_id is a unique identifying key and that all users that have requested deletion have been removed from the user_lookup table, which statement describes whether successfully executing the above logic guarantees that the records to be deleted from the user_aggregates table are no longer accessible and why?

Show Answer
Correct Answer: B

No; files containing deleted records may still be accessible with time travel until a VACUUM command is used to remove invalidated data files. In Delta Lake, data deletion does not immediately remove the data files containing the deleted records. The deleted data can still be accessed through Delta Lake's time travel feature until the VACUUM command is executed to remove the invalidated data files permanently.

Discussion

2 comments
Sign in to comment
60tiesOption: B
Nov 15, 2023

B is best. VACUUM command is needed to completely remove logs of the deleted files.

alexvnoOption: B
Dec 19, 2023

Delta travel