QuestionQ72

Implement generative AI and agentic solutions

You are configuring an evaluation in Microsoft Foundry for a Retrieval Augmented Generation (RAG) chat application.

You need to obtain scores for the following:

  • Groundedness
  • Relevance
  • Harmful content categories

Which two evaluation categories should you use, where each correct answer represents a complete solution?

Choose two
  • A risk and safety metrics
  • B fluency evaluator
  • C similarity evaluators
  • D AI quality (NLP) metrics
  • E AI quality (AI assisted) metrics
Explanation

Groundedness and relevance are AI-assisted quality metrics in Microsoft Foundry — they require a model to judge outputs against retrieved context and the user query, so they belong to the 'AI quality (AI assisted) metrics' category (unlike 'AI quality (NLP) metrics,' which covers traditional statistical NLP metrics that don't include groundedness or relevance). Harmful content categories, such as hateful and unfair content, sexual content, violent content, and self-harm-related content, are evaluated through the 'risk and safety metrics' category. Together, these two categories provide the required groundedness, relevance, and harmful content scores for a RAG chat app evaluation.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!