Skip to main content
AP-6 · AI Personalization · 125 XP · ~20 min
The systems you’ve built across AP-1 through AP-5 work beautifully for small batches. At 500 contacts per week, new problems emerge: AI failures, inconsistent quality, personalization that’s technically correct but tone-deaf, and QA bottlenecks that kill the time savings you’re trying to create. This module covers the operational infrastructure for personalization at scale.

The Failure Modes at Scale

As volume increases, these problems emerge:
ProblemFrequency at ScaleImpact
AI generates generic output despite context5–15% of rowsSounds automated; hurts reply rates
Word count violations10–20% of rowsEmails too long; lower reads
Hallucinated context2–5% of rowsReferences things that aren’t true; embarrassing
Missing personalization signals15–30% of rowsDrops to Level 1 without flagging
Constraint violations5–10% of rowsWrong structure, wrong CTA, banned phrases
At 500 contacts/week, a 10% failure rate means 50 broken emails going to prospects. You need a QA layer.

Building an Automated QA Layer

QA Check 1: Word count

QA Check 2: Constraint compliance

QA Check 3: Personalization depth

QA Check 4: Hallucination detection

Master QA score:


Batch Review Process

Even with automated QA, spot-check 10% of approved emails manually. Build a review queue:
  1. Filter qa_status = approved_with_notes → all get human review
  2. Filter qa_status = approved → random sample 10% for spot-check
  3. Filter qa_status = needs_revision → AI auto-retry with the same prompt (often fixes constraint violations)
  4. Filter qa_status = reject → manual rewrite or discard
This process keeps review time under 20 minutes per 500-contact batch.

Auto-Retry for Failed Emails

For needs_revision rows, build a retry prompt:
Run auto-retry once. If the retry also fails QA, flag for manual review — don’t loop indefinitely.

Scale Operations Checklist

For any outreach batch over 100 contacts:
  • All 4 QA checks running as columns
  • Master QA status column populated
  • needs_revision rows: auto-retry column
  • Review queue filtered: all approved_with_notes reviewed
  • Spot-check: 10% of approved reviewed manually
  • Final send list: only approved rows exported
  • Send rate: no more than 50 new contacts/sending domain/day

Quick Check: What are the four automated QA checks? What QA status triggers auto-retry? What percentage of approved emails should be spot-checked manually?

AP-6 Challenge: Build the QA Infrastructure (+125 XP)

Take a batch of 50 AI-generated emails (from any previous challenge) and run them through the full QA system. Requirements:
  • All 4 QA check columns implemented
  • Master QA status column
  • Auto-retry column for all needs_revision rows
  • Final send list (only approved rows)
  • QA audit summary: what % passed on first attempt? What were the most common failure modes?

Submit AP-6 Challenge →

Share your grid + QA audit summary. +125 XP on approval.

Next: AP-7 — AI Personalization Capstone →

Build and run a fully personalized outbound campaign with QA infrastructure. Earn the AI Personalization Specialist certification.