> For the complete documentation index, see [llms.txt](https://docs.owkin.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.owkin.com/governance-and-security/model-governance/explainability-and-traceability.md).

# Explainability and traceability

### Ensuring citation and reference integrity

K Pro leverages Retrieval-Augmented Generation (RAG) on PubMed abstracts to provide accurate and verifiable citations. A key component of this system is the validation that all returned PubMed IDs correspond to actual published articles. While a minimal risk exists that the language model may generate responses that don't fully align with the retrieved article content, this probability is kept low through our RAG architecture.

Our commitment to citation accuracy extends beyond basic validation. We conduct internal evaluations against established public benchmarks for literature review tasks, and we continuously refine our daily evaluation protocols. Future enhancements will include more sophisticated analysis to verify that generated answers appropriately incorporate and reflect the content of retrieved PubMed IDs.

### Measuring and preventing hallucinations

K Pro implements comprehensive monitoring systems designed to detect and mitigate hallucinations at multiple stages of the response generation process.

**Tool call accuracy monitoring:** Daily automated tracking uses metrics such as Tool Call Accuracy (TCA) to measure how frequently the system correctly identifies and invokes the appropriate tools. This monitoring enables early detection of systemic issues, including cases where the agent incorrectly requests a tool, fails to recognize when a tool is necessary, or selects a suboptimal tool for the task at hand.

**Parameter validation:** Correct tool selection alone is insufficient—the parameters passed to those tools must also be accurate and complete. When incorrect parameters are supplied, the resulting actions can produce erroneous outputs that appear as hallucinations in the final response. To address this, we continuously monitor parameter accuracy and completeness through automated testing against a carefully curated set of evaluation questions, ensuring that tool invocations are not only appropriate but also properly configured.

***

**Logging & audit trail.** All events are recorded in the audit trail. K Pro uses end-to-end request tracing. Logs are structured and include correlation fields to support investigations and auditability. LLM usage is logged and tool-call sequencing is traceable at the orchestrator level.

**Access controls (for audit/log systems).** Observability systems are restricted to authorized personnel, behind internal network controls and authenticated via corporate identity.

**Traceability of AI recommendations.** Every AI-generated answer can be traced to:

1. The user prompt / session context
2. The tools invoked and data services queried
3. The step-by-step orchestration trace

Tracing is segregated by customer and is not used for model training without explicit consent from the customer.


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.owkin.com/governance-and-security/model-governance/explainability-and-traceability.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.