Home / GenAI Engineer practice test / Evaluation and Monitoring / Question

Databricks Generative AI Engineer Associate · free practice question

When inference logging is enabled for a Databricks Model Serving endpoint, a developer observes that the logged request information does not include the…

Exam-style question on Evaluation and Monitoring from the free GenAI Engineer practice test, with the answer and a full explanation below.

Updated November 11, 2026

Evaluation and Monitoring

When inference logging is enabled for a Databricks Model Serving endpoint, a developer observes that the logged request information does not include the document chunks retrieved by a RAG application. Only the final user query and the model's response are captured. What is the fundamental reason for this behavior?

  1. AInference tables log the endpoint's request and response payloads, and the retrieved chunks are part of neither one.
  2. BInference tables are turned off when a new model version is promoted and have to be re-enabled by hand after each promotion.
  3. CThe chunks are in fact logged: inference tables capture intermediate pipeline data without changes to the RAG chain's code.
  4. DThe model was not logged with the PyFunc flavor, which is the flavor that can write retrieved document chunks to inference tables.
Answer & explanation

Correct answer: A

WHY A: Inference tables log what is actually sent to and returned from the model serving endpoint. If the RAG chain assembles retrieval results internally without including them in the logged request payload, they will not appear in the inference table. The developer must either restructure the chain to include retrieved chunks in the request/response payload (so they are captured in inference logs) or enable MLflow Tracing, which captures intermediate span-level data including retrieval results separately from the inference table.

WHY NOT B: Inference tables are configured at the endpoint level and persist across model version promotions. They are not automatically disabled on promotion and do not require re-enabling.

WHY NOT C: Inference tables capture the serialized request and response payloads at the endpoint's HTTP interface boundary. They do not automatically introspect or capture internal Python state, intermediate function calls, or variables that were not included in those payloads.

WHY NOT D: Both PyFunc and LangChain model flavors support inference logging. The flavor does not determine whether intermediate pipeline data is logged; the payload structure does.

Take the full GenAI Engineer practice test free →

Would you pass today?

This question is one of 45 in the free, timed Databricks Generative AI Engineer Associate practice test. Take it and get a section-by-section score.

Start the free test →