Certified Associate Developer for Apache Spark Exam

Exam Certified Associate Developer for Apache Spark All QuestionsBrowse all questions from this exam

Question 104

The code block shown below contains an error. The code block is intended to create and register a SQL UDF named “ASSESS_PERFORMANCE” using the Scala function assessPerformance() and apply it to column customerSatisfaction in the table stores. Identify the error.

Code block:

spark.udf.register(“ASSESS_PERFORMANCE”, assessPerforance)

spark.sql(“SELECT customerSatisfaction, assessPerformance(customerSatisfaction) AS result FROM stores”)

The customerSatisfaction column cannot be called twice inside the SQL statement.

Registered UDFs cannot be applied inside of a SQL statement.

The order of the arguments to spark.udf.register() should be reversed.

The wrong SQL function is used to compute column result - it should be ASSESS_PERFORMANCE instead of assessPerformance.

There is no sql() operation - the DataFrame API must be used to apply the UDF assessPerformance().

Correct Answer: D

The error in the code block is that the wrong SQL function is used to compute the column result. The registered UDF name 'ASSESS_PERFORMANCE' should be used in the SQL statement instead of the Scala function name 'assessPerformance'. Therefore, the SQL query should be 'SELECT customerSatisfaction, ASSESS_PERFORMANCE(customerSatisfaction) AS result FROM stores'.

Discussion

cd6a625Option: D

D is the correct answer

SaiPavan10Option: C

D is the right choice.

veli4koOption: D

D is correct

thanabOption: D

D The error in the code block is D. The wrong SQL function is used to compute column result - it should be ASSESS_PERFORMANCE instead of assessPerformance.

Ram459Option: D

yup D is correct

zozoshankyOption: D

D is the answer