AP-6 · AI Personalization · 125 XP · ~20 min
The Failure Modes at Scale
As volume increases, these problems emerge:
At 500 contacts/week, a 10% failure rate means 50 broken emails going to prospects. You need a QA layer.
Building an Automated QA Layer
QA Check 1: Word count
QA Check 2: Constraint compliance
QA Check 3: Personalization depth
QA Check 4: Hallucination detection
Master QA score:
Batch Review Process
Even with automated QA, spot-check 10% of approved emails manually. Build a review queue:- Filter
qa_status = approved_with_notes→ all get human review - Filter
qa_status = approved→ random sample 10% for spot-check - Filter
qa_status = needs_revision→ AI auto-retry with the same prompt (often fixes constraint violations) - Filter
qa_status = reject→ manual rewrite or discard
Auto-Retry for Failed Emails
Forneeds_revision rows, build a retry prompt:
Scale Operations Checklist
For any outreach batch over 100 contacts:- All 4 QA checks running as columns
- Master QA status column populated
-
needs_revisionrows: auto-retry column - Review queue filtered: all
approved_with_notesreviewed - Spot-check: 10% of
approvedreviewed manually - Final send list: only
approvedrows exported - Send rate: no more than 50 new contacts/sending domain/day
AP-6 Challenge: Build the QA Infrastructure (+125 XP)
Take a batch of 50 AI-generated emails (from any previous challenge) and run them through the full QA system. Requirements:- All 4 QA check columns implemented
- Master QA status column
- Auto-retry column for all
needs_revisionrows - Final send list (only approved rows)
- QA audit summary: what % passed on first attempt? What were the most common failure modes?
Submit AP-6 Challenge →
Share your grid + QA audit summary. +125 XP on approval.
Next: AP-7 — AI Personalization Capstone →
Build and run a fully personalized outbound campaign with QA infrastructure. Earn the AI Personalization Specialist certification.