Provider Scorecard Skill
When to Use
- Monthly/weekly ops reviews of enrichment vendors.
- Before renewing contracts or adjusting credit allocations.
- After outages or performance regressions to inform routing changes.
Framework
- Metric Definition – success rate, fill %, latency, credit burn, confidence.
- Data Sources – provider logs, credit usage tables, QA samples, incident tickets.
- Scoring Model – weight metrics by enrichment type and business priority.
- Visualization – dashboard or memo highlighting leaders/laggards.
- Action Tracker – document optimization experiments and owner assignments.
Templates
- Scorecard table per provider.
- Executive summary slide with top takeaways.
- Jira/Asana template for provider improvement tasks.
Tips
- Normalize metrics per enrichment type to avoid unfair comparisons.
- Capture qualitative notes (support responsiveness, roadmap access).
- Pair with
waterfall-blueprintupdates to reflect routing decisions.