Certified Data Engineer Professional Exam

Exam Certified Data Engineer Professional All QuestionsBrowse all questions from this exam

Question 78

The data engineering team maintains the following code:

Assuming that this code produces logically correct results and the data in the source table has been de-duplicated and validated, which statement describes what will occur when this code is executed?

The silver_customer_sales table will be overwritten by aggregated values calculated from all records in the gold_customer_lifetime_sales_summary table as a batch job.

A batch job will update the gold_customer_lifetime_sales_summary table, replacing only those rows that have different values than the current version of the table, using customer_id as the primary key.

The gold_customer_lifetime_sales_summary table will be overwritten by aggregated values calculated from all records in the silver_customer_sales table as a batch job.

An incremental job will leverage running information in the state store to update aggregate values in the gold_customer_lifetime_sales_summary table.

An incremental job will detect if new rows have been written to the silver_customer_sales table; if new rows are detected, all aggregates will be recalculated and used to overwrite the gold_customer_lifetime_sales_summary table.

Correct Answer: C

When this code executes, it performs a batch aggregation operation on the 'silver_customer_sales' table grouped by 'customer_id'. It calculates the first and last transaction dates, the average sales, the total number of distinct orders, and the lifetime value of sales for each customer. The .mode('overwrite') operation specifies that the output table 'gold_customer_lifetime_sales_summary' should be overwritten with the result of this aggregation. This means that every time this code runs, it replaces the existing 'gold_customer_lifetime_sales_summary' table with a new version that reflects the aggregate calculations of the 'silver_customer_sales' table.

Discussion

sturcuOption: C

it does overwrite, so no incremental load

aragorn_bregoOption: C

The code is performing a batch aggregation operation on the "silver_customer_sales" table grouped by "customer_id". It calculates the first and last transaction dates, the average sales, the total number of distinct orders, and the lifetime value of sales for each customer. The .mode("overwrite") operation specifies that the output table "gold_customer_lifetime_sales_summary" should be overwritten with the result of this aggregation. This means that every time this code runs, it will replace the existing "gold_customer_lifetime_sales_summary" table with a new version that reflects the current state of the "silver_customer_sales" table.

mouad_attaqiOption: C

Correct Answer is C, it is an overwrite mode

hal2401meOption: C

C. there's nowhere implicating streaming.

DileepvikramOption: C

C is the answer