Webnovel Translation Benchmark

All models

Qwen3.8 27B for web novel translation

How Qwen3.8 27B by Alibaba translated eleven chapters of a Korean web novel into English: rank 21 of 28.

54.0quality score of 100
$0.127per chapter at list price
$12.70per 100 chapters
867head-to-head rating

Gemini 3.8 Flash scored higher (88.0) for $0.083 a chapter.

Score by quality

Accuracy2.5 / 5meaning carried over correctly
Terminology2.4 / 5names, titles and martial-arts terms kept consistent across chapters
Register3.1 / 5tone and speech levels (honorifics, banter, formality)
Fluency3.1 / 5reads as natural English prose
Fidelity4.4 / 5nothing added, dropped or summarised
Sanitization4.8 / 5violence and crude language kept, not softened

11 of 11 chapters were scored; a chapter the model refused or failed is counted separately. It wrote about 41,713 output tokens per chapter, reasoning included.