A machine learning engineer is in the process of implementing a concept drift monitoring solution. They are planning to use the following steps:
1. Deploy a model to production and compute predicted values
2. Obtain the observed (actual) label values
3. _____
4. Run a statistical test to determine if there are changes over time
Which of the following should be completed as Step #3?
After obtaining the observed (actual) label values, the next logical step is to compute the evaluation metric using the observed and predicted values. This allows the engineer to compare these values and assess the model's performance. If there are significant changes in the evaluation metric over time, it can indicate potential concept drift. Therefore, computing the evaluation metric is a crucial step before running a statistical test to determine if there are changes over time.
By computing evaluation metrics such as accuracy, precision, recall, or F1 score using these values, the engineer can assess the model's performance over time and detect any potential concept drift.
concept drift can only be detected by observing model performance metrics.
E. Compute the evaluation metric using the observed and predicted values
E. Compute the evaluation metric using the observed and predicted values
A is correct
It should be E
Answer is E