AI Evaluator Academy
AI-evaluation work pays real money for a sharp mind and good English. The gate is a brutal, timed, feedback-free assessment that screens out capable people and never says why.
This is the why — and the exact method reviewers score. Built by a teacher and assessor, from real written reviewer feedback.
Real systems for real solutions.
The flagship
Everything, in order — from "I think I did okay?" to knowing exactly what a reviewer scores and how to produce it under pressure.
Here are the five reasons capable people get marked down — none of them intelligence:
Seven modules make all five automatic — the mindset, the calibrated rubric and severity ladder, the education-specialist track, multi-turn scoring, performance under a clock, the platform map, and the multimodal frontier. Plus a Unified Review Protocol, an Exam-Day Quick Reference, a sentence bank, and three full mock exams worked end to end.
Start free
The free tier isn't a teaser — it's the first honest answer you've been given about why capable people get screened out.
Free · Module 1 + one drill
The complete first module of the program plus one worked drill — the single mindset shift most applicants never make, and the vocabulary every assessment is written in. Drop your email and it's yours.
Get Module 1 free →Free · No sign-up
One evaluation drill, no account, no key. Rate it, justify it, then reveal a worked example — a real attempt, exactly how it was graded, and the answer that scores.
Try the drill →Go deeper
Optional companions to the Program. Reading the method isn't the same as performing it cold — these are where you drill it.
Type your rating and justification; it grades your write-up against real criteria — on track, partly, or off, with the answer that scores. Bring your own AI key, about a cent a drill.
The AI voice interview builds each question from your last answer. Walk in with the three-move shape — rule, example, record — and the exact words that score under a timer.
Both tracks together — the Generalist Screen (27 questions) and Rubrics & Criteria (19 questions), the education-and-assessment spine. Covers both sides of the exam.
I built this because I sat those exams myself. I'm a teacher and assessor — evaluating written work against explicit criteria is my day job — and I still got knocked back with feedback so vague it could have meant anything. So I got the actual written feedback and reverse-engineered what the reviewers were really scoring. It wasn't intelligence. It was a handful of habits nobody teaches. I wrote them down as rules you can follow under a timer.