DP-201 Exam QuestionsBrowse all questions from this exam

DP-201 Exam - Question 69


Note: This question is part of a series of questions that present the same scenario. Each question in the series contains a unique solution that might meet the stated goals. Some question sets might have more than one correct solution, while others might not have a correct solution.

After you answer a question in this section, you will NOT be able to return to it. As a result, these questions will not appear in the review screen.

You have an Azure Data Lake Storage account that contains a staging zone.

You need to design a daily process to ingest incremental data from the staging zone, transform the data by executing an R script, and then insert the transformed data into a data warehouse in Azure Synapse Analytics.

Solution: You use an Azure Data Factory schedule trigger to execute a pipeline that copies the data to a staging table in the data warehouse, and then uses a stored procedure to execute the R script.

Does this meet the goal?

Show Answer
Correct Answer: B

The proposed solution involves scheduling a trigger in Azure Data Factory to execute a pipeline that copies data into a staging table in the data warehouse and then uses a stored procedure to execute the R script. However, Azure Synapse Analytics does not support direct execution of R scripts. The correct approach would involve using Azure Data Factory to run the R script externally, such as via an Azure Databricks or an HDInsight cluster with R installed, and then ingesting the transformed data into Azure Synapse Analytics. Therefore, the solution does not meet the goal.

Discussion

10 comments
Sign in to comment
Nieswurz
Aug 17, 2020

The proposed solution seems to let the R function do the loading into Synapse. The answer then should be 'no', but more likely the description seems again to be incomplete.

Pairon
Mar 23, 2021

I agree with you. The insert operation into the DWH should be come after the R script process.

cadio30
May 25, 2021

Agree with the statement and as of this year, the Azure Synapse doesn't support R language unless it is executed against Azure SQL Manage Instance

Nieswurz
Aug 17, 2020

The explanation of the answer contains R on an HDInsight-Cluster. This kind of solution is stated to be incorrect in another questions explanation - in favor of an Azure function.

Bob123456
Aug 23, 2020

can we run a stored procedure to execute the R script ?? I don't think so.

Bob123456
Aug 23, 2020

https://docs.microsoft.com/en-us/sql/machine-learning/tutorials/quickstart-r-create-script?view=sql-server-ver15 i believe this answers the question . Answer should be 'yes'

pablocg
Nov 10, 2020

That is for sql server and managed instances and the question is about Azure Synapse Analytics

pablocg
Nov 10, 2020

That is for sql server and managed instances and the question is about Azure Synapse Analytics

VMLearn
Dec 18, 2020

possible

AJMorgan591
Sep 21, 2020

Should use a tumbling window trigger in ADF for incremental loading. https://docs.microsoft.com/en-us/azure/data-factory/solution-template-copy-new-files-lastmodifieddate

sandGrain
Nov 6, 2020

You can do incremental load using schedule trigger. Does not have to be Tumbling window

azurrematt123
Jun 14, 2021

Looks like executing R is possible(sp_execute_external_script), please review the link. https://docs.microsoft.com/en-us/sql/relational-databases/system-stored-procedures/sp-execute-external-script-transact-sql?view=sql-server-ver15

azurrematt123
Jun 14, 2021

My bad it only applies to SQL Server 2016 & Azure SQL Managed Instance, Moderator please dont post this.

Anonymous
Jun 27, 2021

there is no moderator human

Anonymous
Jun 27, 2021

there is no moderator human

syu31svc
Dec 8, 2020

Solution proposed is on data pipeline and orchestration so I would say yes

S3
Jan 10, 2021

I am still not clear as to what is the correct answer

Madhumita88
Mar 16, 2021

I am also not cleared with this answer

I
Mar 17, 2021

The answer should be No. Because MS always supply options for users so it won't engage in one specific programming language such as R.

dbdev
May 9, 2021

https://www.mssqltips.com/sqlservertip/6622/stored-procedure-in-sql-server-with-r-code/ The R function can be used inside stored procedure activity, so answer makes sense to me.

dbdev
May 30, 2021

https://docs.microsoft.com/en-US/azure/data-factory/transform-data#custom-activity

KRV
Jun 6, 2021

yes R function can be used within the Stored procedure for SQL Server or Azure SQL Managed instance , however the statement states that the data is loaded using SQL Synapse which does not support R at this time