Certified Data Engineer Professional Exam

Exam Certified Data Engineer Professional All QuestionsBrowse all questions from this exam

Question 118

Which statement regarding Spark configuration on the Databricks platform is true?

The Databricks REST API can be used to modify the Spark configuration properties for an interactive cluster without interrupting jobs currently running on the cluster.

Spark configurations set within a notebook will affect all SparkSessions attached to the same interactive cluster.

When the same Spark configuration property is set for an interactive cluster and a notebook attached to that cluster, the notebook setting will always be ignored.

Spark configuration properties set for an interactive cluster with the Clusters UI will impact all notebooks attached to that cluster.

Correct Answer: D

Spark configuration properties set for an interactive cluster with the Clusters UI will impact all notebooks attached to that cluster. This is because the cluster-level configuration applies globally to any notebooks or jobs running on that cluster. Therefore, any setting specified in the Clusters UI will affect the environment in which all notebooks and jobs operate, ensuring consistency across workloads.

Discussion

vexor3Option: D

Should be D