Answer framing: Require separate measures for rule compliance, evidence support, estimate correctness and whole-file acceptance. One percentage should not stand in for all four.
Why it matters to buyers: Verisk’s documentation distinguishes audit-rule reports from estimate activity and revision reports. Cotality describes Validate as a rules-based estimate-review product. These functions identify what a system checks; they do not, by themselves, establish that every material omission or unsupported inference has been detected. That last distinction is the desk’s evaluation inference. (xactanalysis.helpdocs.io)
Put this to: Brunko, Gray and an independent carrier QA reviewer.
A good answer should define the following proposed scorecard:
| Metric | Proposed definition | What to keep visible |
|---|---|---|
| First-pass acceptance | First submissions accepted without substantive correction ÷ first submissions reviewed | Carrier edits count even if no formal return was issued |
| Material-error file rate | Audited files containing at least one defined material defect ÷ files audited | Both under-scoping and over-scoping; sampling method |
| Evidence support | Tested material assertions or items with adequate supporting evidence | How omissions and missing assertions are tested |
| Review effort | All carrier review and correction minutes for the cohort | Accepted and rejected files; reviewer seniority |
| Time to usable file | Elapsed time from defined receipt to acceptance | Pauses, queue time, median and upper-percentile results |
| Service coverage | In-scope assignments actually undertaken ÷ in-scope assignments offered | Refusals, transfers, escalations and incomplete cases |
Define materiality before scoring. Include unsupported quantities, omitted relevant damage, wrong-location evidence and consequential narrative conflicts—not just arithmetic errors.
Sharp follow-up: “How do you detect a missing item that never appeared in the estimate and therefore never triggered a line-item rule?”
Artifact to request: metric definitions, raw counts, sampling rules and disagreement-resolution records.
Expert quote: [Reserved for approved quotation, contributor, role and interview date.]
Sources cited on this page
- xactanalysis.helpdocs.ioxactanalysis.helpdocs.io