Certified Generative AI Engineer Associate Exam QuestionsBrowse all questions from this exam

Certified Generative AI Engineer Associate Exam - Question 47


A Generative AI Engineer has just deployed an LLM application at a manufacturing company that assists with answering customer service inquiries. They need to identity the key enterprise metrics to monitor the application in production.

Which is NOT a metric they will implement for their customer service LLM application in production?

Show Answer
Correct Answer:

Discussion

1 comment
Sign in to comment
DavidMillerOption: A
May 3, 2025

MMLU is a benchmarking score used during LLM pre-training and evaluation, not something you’d monitor in a deployed, real-world production setting.