Webnovel Translation Benchmark

All models

GLM-5.3 for web novel translation

How GLM-5.3 by Z.ai translated eleven chapters of a Korean web novel into English: rank 5 of 28.

82.0quality score of 100
$0.237per chapter at list price
$23.67per 100 chapters
1107head-to-head rating

Gemini 3.8 Flash scored higher (88.0) for $0.083 a chapter.

Score by quality

Accuracy4.3 / 5meaning carried over correctly
Terminology2.5 / 5names, titles and martial-arts terms kept consistent across chapters
Register5.0 / 5tone and speech levels (honorifics, banter, formality)
Fluency5.0 / 5reads as natural English prose
Fidelity4.7 / 5nothing added, dropped or summarised
Sanitization5.0 / 5violence and crude language kept, not softened

11 of 11 chapters were scored; a chapter the model refused or failed is counted separately. It wrote about 87,781 output tokens per chapter, reasoning included.