Risk AssessmentCritical riskConsensus useful

AI Clinical Trial Data Anomaly Detection & Regulatory Risk Assessment Playbook

Your FDA advisory committee has received a BLA submission for a novel biologic. During pre-submission review, a biostatistician flagged inconsistencies in the Phase III efficacy data — three trial sites show implausibly low adverse event rates compared to the other 22 sites, and one site's randomization sequence shows signs of post-hoc modification. The agency has 30 days to issue a complete response letter.

When to use this playbook

  • Use this playbook when the decision looks like the situation above: Your FDA advisory committee has received a BLA submission for a novel biologic.
  • It is a fit when you have source files in hand and need a structured, reviewable analysis — not a generic chat answer about "Clinical Trial Data Anomaly Detection & Regulatory Risk Assessment".
  • Do not use it as a substitute for licensed, legal, clinical, or authorized official judgment in the domain.

What you'll need

  • Phase III trial efficacy and safety data (all 25 sites) - Randomization log for the flagged site - Site monitoring reports and audit trail - Sponsor's statistical analysis plan (SAP)

Attachments: Documents (Documents)

The Prompt

You are an FDA regulatory reviewer and biostatistics analyst conducting a data integrity review of a BLA submission.  I am attaching: - Phase III trial efficacy and safety data (all 25 sites) - Randomization log for the flagged site - Site monitoring reports and audit trail - Sponsor's statistical analysis plan (SAP)

Work only from the attached source files. If a conclusion is not supported, say so.

Produce:
1. Perform a cross-site statistical comparison of adverse event rates — identify all sites that are statistical outliers at the p<0.05 level and assess whether the magnitude of the discrepancy is consistent with legitimate site-level variation or indicative of data suppression.
2. Analyze the randomization log for the flagged site against the SAP-specified randomization procedure — identify any deviations, timestamp anomalies, or sequence patterns inconsistent with prospective randomization.
3. Review the site monitoring reports and audit trail for documentation of corrective actions, protocol deviations, or investigator notifications that were not reflected in the final submission data.
4. Assess the cumulative impact of the flagged anomalies on the overall efficacy and safety conclusions — determine whether removal of the three outlier sites would materially change the primary endpoint result.
5. Draft a complete response letter framework identifying each deficiency, the evidentiary basis, and the specific additional data or audits required before approval can proceed.

Call out where independent models are likely to disagree, and list follow-up documents a reviewer should request.

What to expect

  • Multi-model consensus on data integrity risk classification
  • Cross-site statistical anomaly report with outlier confidence scores
  • Randomization sequence deviation analysis
  • Efficacy sensitivity analysis excluding flagged sites
  • Draft complete response letter framework with model-agreement threshold noted

Review before you act

  • Validate this output against source files before relying on it: Perform a cross-site statistical comparison of adverse event rates — identify all sites that are statistical outliers at the p<0.05 level and assess whether the magnitude of the discrepancy is consistent with legitimate site-level variation or indicative of data suppression.
  • Validate this output against source files before relying on it: Analyze the randomization log for the flagged site against the SAP-specified randomization procedure — identify any deviations, timestamp anomalies, or sequence patterns inconsistent with prospective randomization.
  • Validate this output against source files before relying on it: Review the site monitoring reports and audit trail for documentation of corrective actions, protocol deviations, or investigator notifications that were not reflected in the final submission data.
  • Validate this output against source files before relying on it: Assess the cumulative impact of the flagged anomalies on the overall efficacy and safety conclusions — determine whether removal of the three outlier sites would materially change the primary endpoint result.
  • Confirm every cited figure, date, counterparty, or requirement against the attached originals — models compress and can drop a qualifier.
  • Treat disagreement between models as a review item, especially on classification, materiality, and recommended next action.
  • Do not authorize an operational, clinical, legal, credit, or enforcement action solely because the models agree.

Why compare models on this

For Clinical Trial Data Anomaly Detection & Regulatory Risk Assessment, running the same attachments across independent models is useful because the hard part is classification and completeness, not fluency. The workflow is already designed to surface multi-model consensus on data integrity risk classification; cross-site statistical anomaly report with outlier confidence scores; randomization sequence deviation analysis; efficacy sensitivity analysis excluding flagged sites. Those are comparison artifacts — they only exist if more than one model runs. Threshold-splitting, sanctions hits, and exam-readiness calls are exactly where models diverge. Record the split and the human resolution.

US FederalHealthcare Compliance FraudRisk AssessmentCriticalDocuments

See governed multi-model AI on your own prompt

Compare GPT-5, Claude, and Gemini side by side, with human review and a decision record built in.