Home / GenAI Engineer practice test / Evaluation and Monitoring / Question

Databricks Generative AI Engineer Associate · free practice question

When assessing a Retrieval Augmented Generation (RAG) application using Databricks Agent Evaluation with various Large Language Model (LLM) judges, a team…

Exam-style question on Evaluation and Monitoring from the free GenAI Engineer practice test, with the answer and a full explanation below.

Updated November 11, 2026

Evaluation and Monitoring

When assessing a Retrieval Augmented Generation (RAG) application using Databricks Agent Evaluation with various Large Language Model (LLM) judges, a team needs to determine which evaluation metric necessitates a pre-existing, labeled 'correct' answer for its scoring. Which of the following judges ABSOLUTELY REQUIRES ground truth data for evaluation?

  1. AGroundedness (faithfulness), which assesses whether the response is supported by the information in the retrieved source documents
  2. BSafety (toxicity), which detects whether the response contains potentially harmful or offensive content
  3. CRelevance to query (answer relevance), which assesses whether the response directly addresses the user's original query
  4. DCorrectness (answer correctness), which assesses whether the response is factually accurate for the question asked
Answer & explanation

Correct answer: D

WHY D is correct: The correctness judge is an LLM judge that compares the generated answer with a labeled reference: the expected_response (or expected_facts) in the evaluation set. Without that labeled reference it has nothing to judge against, so it cannot run without ground truth.

WHY NOT A: Groundedness (faithfulness) measures consistency between the generated response and the retrieved document chunks — both are available at inference time in a RAG system. No pre-labeled ground truth is needed; the judge only needs the response and its source context.

WHY NOT B: The safety judge looks only at the response text and decides whether it contains harmful or offensive content. It needs no labeled reference answer.

WHY NOT C: Relevance to query evaluates whether the response addresses the user's question — it only requires the question and the response, both available at inference time. No pre-labeled expected answer is needed to judge topical alignment.

Take the full GenAI Engineer practice test free →

Would you pass today?

This question is one of 45 in the free, timed Databricks Generative AI Engineer Associate practice test. Take it and get a section-by-section score.

Start the free test →