SnowPro Advanced Data Engineer Exam

Exam SnowPro Advanced Data Engineer All QuestionsBrowse all questions from this exam

Question 49

A CSV file, around 1 TB in size, is generated daily on an on-premise server. A corresponding table, internal stage, and file format have already been created in Snowflake to facilitate the data loading process.

How can the process of bringing the CSV file into Snowflake be automated using the LEAST amount of operational overhead?

Create a task in Snowflake that executes once a day and runs a COPY INTO statement that references the internal stage. The internal stage will read the files directly from the on-premise server and copy the newest file into the table from the on-premise server to the Snowflake table.

On the on-premise server, schedule a SQL file to run using SnowSQL that executes a PUT to push a specific file to the internal stage. Create a task that executes once a day in Snowflake and runs a COPY INTO statement that references the internal stage. Schedule the task to start after the file lands in the internal stage.

On the on-premise server, schedule a SQL file to run using SnowSQL that executes a PUT to push a specific file to the internal stage. Create a pipe that runs a COPY INTO statement that references the internal stage. Snowpipe auto-ingest will automatically load the file from the internal stage when the new file lands in the internal stage.

On the on-premise server, schedule a Python file that uses the Snowpark Python library. The Python script will read the CSV data into a DataFrame and generate an INSERT INTO statement that will directly load into the table. The script will bypass the need to move a file into an internal stage.

Correct Answer: C

To automate the process of bringing the daily generated CSV file into Snowflake with the least amount of operational overhead, scheduling a SQL file on the on-premise server using SnowSQL to execute a PUT to the internal stage followed by creating a pipe in Snowflake for auto-ingestion is the most efficient approach. Snowpipe auto-ingest ensures that new files are automatically loaded into Snowflake as soon as they are available in the internal stage, reducing manual intervention and operational steps compared to other options.

Discussion

aws_rajeshOption: C

Option C, considering "LEAST amount of operational overhead" requirement in the question

stopthisnowOption: B

B seems like a good option