Woodstitch

Research

Blinded listening studies on speech AI, run with paid human raters. Each report states its sample size, its confidence intervals and what it does not show. We publish results that go against us.

Interim research report 3 November 2026 · Hawkes T

Can listeners distinguish AI narration from human narration?

A blinded listening study of ElevenLabs v4 and human-read audiobook excerpts of 15, 30 and 60 seconds.

48.9%accuracy, 176 judgments
95% CI 42.2–56.1
−0.2 pp60 s vs 15 s clips
no length effect detected
33.3%accuracy when “very confident”
lowest of four levels

35 listeners · 6 AI voices · 10 narrators · 210 clips analysedRead the report →

Study 29 October 2026

ElevenLabs v4 vs a fine-tuned open model, on audiobook narration

20 matched passages from 20 books, heard from both systems by every listener, sides counterbalanced.

ElevenLabs v4
117
Fine-tuned model
10
No preference
11

127 decisive judgments · 6 listeners · we built the losing systemRead the study →

Collecting now

StudyQuestionJudgmentsListenersStatus
AI vs human narrationContinuation of the report above to its planned 1,050 judgments17635Collecting
TTS engine preferenceDo listeners prefer any of five current engines?20237Collecting
Voice preference, audiobooksWhich voice properties predict what listeners choose?488Collecting
Instrumental loop preferenceWhich model composes the piano loop listeners prefer?14725Collecting

Counts as of 4 November 2026. Each study is reported at a sample size fixed before collection; anything published earlier is labelled interim. Null results are published the same as any other. How studies are run →