Certified Associate Developer for Apache Spark Exam

Exam Certified Associate Developer for Apache Spark All QuestionsBrowse all questions from this exam

Question 170

The code block shown below contains an error. The code block is intended to create and register a SQL UDF named "ASSESS_PERFORMANCE" using the Python function assessPerformance() and apply it to column customerSatistfaction in table stores. Identify the error.

Code block:

spark.udf.register("ASSESS_PERFORMANCE", assessPerformance)

spark.sql("SELECT customerSatisfaction, assessPerformance(customerSatisfaction) AS result FROM stores")

There is no sql() operation — the DataFrame API must be used to apply the UDF assessPerformance().

The order of the arguments to spark.udf.register() should be reversed.

The customerSatisfaction column cannot be called twice inside the SQL statement.

Registered UDFs cannot be applied inside of a SQL statement.

The wrong SQL function is used to compute column result — it should be ASSESS_PERFORMANCE instead of assessPerformance.

Correct Answer: E

The error in the code block is that the wrong SQL function is used to compute the column result. Instead of assessPerformance, the registered UDF name ASSESS_PERFORMANCE should be used in the SQL query.

Discussion

Sowwy1Option: E

E. The wrong SQL function is used to compute column result — it should be ASSESS_PERFORMANCE instead of assessPerformance.