Section 09 of 12 / Compare and decide
Scorecard
Decide how to score a production supplier or an internal plan on the same terms.
- Pages
- 18
- Sources cited
- 12
- Evidence date
- 20 Oct 2026

Pages in this section
- 01How should an insurer judge a production supplier or an internal improvement plan?Judge the complete operating model on total cost per accepted file, independently checked quality and retained claims control—not the price or speed of the first estimate.Read →
- 02What exactly is being scored?Score a defined inspection-to-accepted-file workflow, not a company name or an isolated software feature.Read →
- 03Which failures should stop procurement regardless of the score?Use six mandatory gates. Mark each Pass, Fail or Unverified, with an evidence reference and accountable carrier owner.Read →
- 04What are the recommended weights?Use the following 100-point allocation as the default.Read →
- 05How do you calculate a defensible score?Rate each criterion from 0 to 5, cap that rating by the strength of its evidence, and multiply by its weight.Read →
- 06What do good and bad look like for every criterion?Use observable outcomes and artefacts, not adjectives such as “enterprise-ready” or “high accuracy”.Read →
- 07What should the claim file acceptance checklist contain?Acceptance should mean that the production package meets a versioned carrier standard—not that the claim is covered, payable, settled or closed.Read →
- 08Which metrics prevent a supplier from gaming the result?Publish a denominator dictionary alongside the dashboard.Read →
- 09How should property claims estimate outsourcing cost be calculated?Use actual cohort costs where available and label estimates explicitly.Read →
- 10How should a claims automation pilot produce trustworthy scores?Use a buyer-controlled, representative test with a concurrent or carefully matched comparator.Read →
- 11What practical tests expose weak controls?Require demonstrations of failure handling, not just the happy path.Read →
- 12How should catastrophe production capacity be stress-tested?Test accepted-file throughput across the entire chain.Read →
- 13Which US regulatory boundaries need explicit diligence?Maintain a jurisdiction-and-task matrix approved by claims counsel.Read →
- 14What would a completed weighted comparison look like?The following fictional ratings demonstrate the mechanics—not vendor performance.Read →
- 15What must procurement put into the contract?Translate the scorecard into definitions, evidence rights and remedies.Read →
- 16Who should sign the final decision?Separate the people paying for production from the people paying for correction.Read →
- 17What does the public evidence establish—and what remains unknown?The reviewed sources establish relevant product scopes, integration mechanisms, regulatory expectations and testing methods.Read →
- 18Sources1. NAIC, Model Bulletin: Use of Artificial Intelligence Systems by Insurers, adopted 4 December 2023.Read →
Research quality
- Buyer fit
- 9/10
- Depth
- 9/10
- Search coverage
- 9/10
- Sources
- 8/10
The desk’s own rating of fit, depth, search coverage and sourcing for this section. It is not an external audit.