Which statement characterizes the general programming model used by Spark Structured Streaming?
Which statement characterizes the general programming model used by Spark Structured Streaming?
Structured Streaming models new data arriving in a data stream as new rows appended to an unbounded table. This concept is integral to understanding how Spark Structured Streaming operates. It treats streaming data as an append-only table, allowing for continuous incremental processing, which is similar in operation to traditional batch processing but applied in a real-time context.
Correct. Structured streaming needs to be considered as a table with append
Yes. answer is D
correct; The key idea in Structured Streaming is to treat a live data stream as a table that is being continuously appended. This leads to a new stream processing model that is very similar to a batch processing model. You will express your streaming computation as standard batch-like query as on a static table, and Spark runs it as an incremental query on the unbounded input table. Let’s understand this model in more detail. https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html
vote for D
D. Structured Streaming models new data arriving in a data stream as new rows appended to an unbounded table.