Certified Data Engineer Associate Exam

Exam Certified Data Engineer Associate All QuestionsBrowse all questions from this exam

Question 78

A data engineer is using the following code block as part of a batch ingestion pipeline to read from a composable table:

Which of the following changes needs to be made so this code block will work when the transactions table is a stream source?

Replace predict with a stream-friendly prediction function

Replace schema(schema) with option ("maxFilesPerTrigger", 1)

Replace "transactions" with the path to the location of the Delta table

Replace format("delta") with format("stream")

Replace spark.read with spark.readStream

Correct Answer: E

To enable the code block to work when the transactions table is a stream source, you need to replace 'spark.read' with 'spark.readStream'. The 'readStream' method is specifically designed to read streams of data, in contrast to 'read', which is intended for batch processing.

Discussion

55f31c8Option: E

Example from https://docs.databricks.com/en/structured-streaming/delta-lake.html spark.readStream.table("table_name") spark.readStream.load("/path/to/table")

in89_io_90

have you cleared the exam

meow_akkOption: E

Ans E; for streaming source you use readstream. https://docs.databricks.com/en/structured-streaming/delta-lake.html

AndreFROption: E

https://docs.databricks.com/en/structured-streaming/tutorial.html#use-auto-loader-to-read-streaming-data-from-object-storage

benni_aleOption: E

E is ok