Confident staleness
A dated rule or figure is presented as current without disclosing its applicable period.
Read the concept definition →Independent benchmark · No rates · No leads
Do AI assistants get annuities right? We check.
AnnuityRates.AI is preparing a recurring, reproducible benchmark of answers about annuity taxes, safety, surrender, and income mechanics. The same fixed prompts will be graded against disclosed sources under a published rubric.
Benchmark run #1 has not started. API spend requires Galen’s explicit approval and is outside this foundation build.
Quarterly benchmark
The scoreboard
Published results will show computed scores only after two independent grading passes and logged adjudication.
Awaiting benchmark run #1
No assistant answers have been collected, graded, or scored. Results will appear only after an approved run completes the published review protocol.
Awaiting run #1. No sample assistants, fabricated scores, or implied findings are shown.
Error library
A taxonomy for evaluating answer failures
These are definitions for future grading, not claims about any assistant and not examples from a completed run.
Jurisdiction blur
A state-specific protection or rule is flattened into a supposedly universal answer.
Read the concept definition →Product conflation
Features of distinct annuity types are blended into an answer about a different contract type.
Read the concept definition →Phantom guarantees
An answer invents or overstates a protection, guarantee, or form of access.
Read the concept definition →Methodology
Built to be reproduced, not believed
The protocol fixes inputs before results exist and publishes the evidence needed to inspect every grade.
Fixed questions
A versioned set is frozen before each run.
Identical prompts
Each assistant receives the same prompt in a fresh session.
Disclosed sources
Expected claims are checked against listed primary sources.
Two grading passes
Independent passes precede logged adjudication.
Public transcripts
Prompts, answers, grades, and notes ship with a report.