Assess whether the system is high-risk under the EU AI Act (05b509)

Situation

An examiner request for the current model inventory put incident log of hallucinated citations in a legal memo in front of EU AI Act implementation manager in a pharma company using LLMs on trial documents. This AI Governance / Bias and Training Data close is the system is high-risk from incident log of hallucinated citations in a legal memo, and the live options are Policy or governance breach, Model defect, Dual failure.

Decision

EU AI Act implementation manager in a pharma company using LLMs on trial documents must choose Policy or governance breach / Model defect / Dual failure / Hold for the missing fact using incident log of hallucinated citations in a legal memo after an examiner request for the current model inventory.

Hypotheses to test

• Incident log of hallucinated citations in a legal memo reads as Policy or governance breach once an examiner request for the current model inventory is lined up to the same AI Governance population.
• Incident log of hallucinated citations in a legal memo is closer to Model defect after an examiner request for the current model inventory; Policy or governance breach would over-claim this Bias and Training Data extract.
• Dual failure is still live in incident log of hallucinated citations in a legal memo for EU AI Act implementation manager in a pharma company using LLMs on trial documents.
• Incident log of hallucinated citations in a legal memo is missing the fact EU AI Act implementation manager needs after an examiner request for the current model inventory; stop this AI Governance close.

Analysis required

• Walk the model input/output path recorded in incident log of hallucinated citations in a legal memo and mark each hop approved, shadow, or unlogged.
• Verify data provenance and the human-oversight gate EU AI Act implementation manager can actually point to.
• Walk the model input/output path recorded in incident log of hallucinated citations in a legal memo and mark each hop approved, shadow, or unlogged.
• For this AI Governance Bias and Training Data file, read incident log of hallucinated citations in a legal memo against an examiner request for the current model inventory and write the one fact that would move the system is high-risk for EU AI Act implementation manager.

Recommendation