Certified Associate Developer for Apache Spark Exam QuestionsBrowse all questions from this exam

Certified Associate Developer for Apache Spark Exam - Question 120


Which of the following operations will fail to trigger evaluation?

Show Answer
Correct Answer: D

DataFrame.join() is a transformation operation in Spark. It does not trigger an evaluation. Instead, it defines a new DataFrame that will be evaluated later when an action is performed. Transformations like join() are lazy and only build up a plan for the computation, while actions like collect(), count(), first(), and take() trigger the execution of that plan.

Discussion

1 comment
Sign in to comment
AnweeeOption: D
Feb 4, 2024

Join is a tranformation so it will not throw results, while others are actions, so Join() is correct