AP-6 · AI Personalization · 125 XP · ~20 min
The Failure Modes at Scale
As volume increases, these problems emerge:| Problem | Frequency at Scale | Impact |
|---|---|---|
| AI generates generic output despite context | 5–15% of rows | Sounds automated; hurts reply rates |
| Word count violations | 10–20% of rows | Emails too long; lower reads |
| Hallucinated context | 2–5% of rows | References things that aren’t true; embarrassing |
| Missing personalization signals | 15–30% of rows | Drops to Level 1 without flagging |
| Constraint violations | 5–10% of rows | Wrong structure, wrong CTA, banned phrases |
Building an Automated QA Layer
QA Check 1: Word count
QA Check 2: Constraint compliance
QA Check 3: Personalization depth
QA Check 4: Hallucination detection
Master QA score:
Batch Review Process
Even with automated QA, spot-check 10% of approved emails manually. Build a review queue:- Filter
qa_status = approved_with_notes→ all get human review - Filter
qa_status = approved→ random sample 10% for spot-check - Filter
qa_status = needs_revision→ AI auto-retry with the same prompt (often fixes constraint violations) - Filter
qa_status = reject→ manual rewrite or discard
Auto-Retry for Failed Emails
Forneeds_revision rows, build a retry prompt:
Scale Operations Checklist
For any outreach batch over 100 contacts:- All 4 QA checks running as columns
- Master QA status column populated
-
needs_revisionrows: auto-retry column - Review queue filtered: all
approved_with_notesreviewed - Spot-check: 10% of
approvedreviewed manually - Final send list: only
approvedrows exported - Send rate: no more than 50 new contacts/sending domain/day
AP-6 Challenge: Build the QA Infrastructure (+125 XP)
Take a batch of 50 AI-generated emails (from any previous challenge) and run them through the full QA system. Requirements:- All 4 QA check columns implemented
- Master QA status column
- Auto-retry column for all
needs_revisionrows - Final send list (only approved rows)
- QA audit summary: what % passed on first attempt? What were the most common failure modes?
Submit AP-6 Challenge →
Share your grid + QA audit summary. +125 XP on approval.
Next: AP-7 — AI Personalization Capstone →
Build and run a fully personalized outbound campaign with QA infrastructure. Earn the AI Personalization Specialist certification.