Certified Data Engineer Professional Exam - Question 3

To schedule Structured Streaming jobs for production with an automatic recovery from query failures while keeping costs low, you should use a new job cluster to ensure an isolated and streamlined environment, set retries to unlimited to handle and recover from any failures automatically, and limit maximum concurrent runs to 1 to avoid resource contention and ensure only one instance of the query runs at a time. This configuration efficiently manages resources and ensures the job's reliability and cost-effectiveness.