You have an Azure data factory named DF1. DF1 contains a single pipeline that is executed by using a schedule trigger.
From Diagnostics settings, you configure pipeline runs to be sent to a resource-specific destination table in a Log Analytics workspace.
You need to run KQL queries against the table.
Which table should you query?
In the context of Azure Data Factory, the table you should query for pipeline run information in a Log Analytics workspace is typically 'ADFPipelineRun'. This table specifically contains logs for pipeline runs, capturing details such as run IDs, start and end times, statuses, and other pertinent information regarding the execution of the pipeline itself. This allows for tracking and analyzing the performance and outcomes of your pipelines.
The answer is not D because the workspace was set to Resource-specific. See doc below. I'm torn between A (PipelineRun) vs B (TriggerRun) because the wording is so generic. However, since they mentioned the scheduling of the pipeline, I would lean on B. https://learn.microsoft.com/en-us/azure/azure-monitor/essentials/resource-logs#send-to-log-analytics-workspace
I would say it's A, because in the ADFTriggerRun it would only contain information on when was the pipeline executed and which pipeline, the question asks for "pipeline runs", but yes it's very generic, because by pipeline runs you can also think that it's about when it was executed, but since it doesn't implicitely say so, I'd go with A
Remember that you are setting "pipeline runs" logs from diagnostics settings to be sent to a Log Analytics workspace, not the "trigger runs" or "activity runs" logs. Azure Diagnostics stores resource logs for Azure services that use Azure Diagnostics mode. Resource logs describe the internal operation of Azure resources. Azure services that use resource-specific mode store data in a table specific to that service and do not use the AzureDiagnostics table https://learn.microsoft.com/en-us/azure/azure-monitor/reference/tables/azurediagnostics
ADFTriggerRun The ADFTriggerRun table stores logs related to trigger runs, which are the events that initiate pipeline executions. This table includes the trigger name, pipeline name, run ID, start time, end time, status, and a message about the trigger run. This table is useful for understanding how triggers are firing and how pipelines are being executed.
Chat GPT answer: To run KQL queries against the pipeline runs sent to a Log Analytics workspace, you should query the table that corresponds to the pipeline runs. Since you configured pipeline runs to be sent to a resource-specific destination table in the Log Analytics workspace, you should query the table corresponding to pipeline runs. Therefore, the correct table to query is: A. ADFPipelineRun
When you configure pipeline runs to be sent to a Log Analytics workspace in Azure Data Factory, the data is typically stored in the "AzureDiagnostics" table. Therefore, you should query the "AzureDiagnostics" table to retrieve information about pipeline runs. So, the correct answer is: D. AzureDiagnostics
It has already been stated that the destination table is sent to 'resource specific', not azure diagnostic
I would choose Activity Run as a preference as it would show detailed activities of the run. However, I believe this question may seem to concern with the trigger rather than the pipeline. https://learn.microsoft.com/en-us/azure/data-factory/monitor-schema-logs-eventsactivities.
A is correct
https://learn.microsoft.com/en-us/azure/azure-monitor/reference/tables/adfpipelinerun
Should be D.
Per the other two comments, answer should be D. Adding a voting comment so it can show on "show answer"
Answer is D https://learn.microsoft.com/en-us/azure/azure-monitor/essentials/resource-logs all data from any diagnostic setting is collected in the AzureDiagnostics table
IMHO activity run should show all the details