Webnovel Translation Benchmark

All models

Muse Spark 1.2 for web novel translation

How Muse Spark 1.2 by Meta translated eleven chapters of a Korean web novel into English: rank 7 of 28.

79.6quality score of 100
$0.0022per chapter at list price
$0.22per 100 chapters
1128head-to-head rating

No model in this test scored higher for the same price or less.

Score by quality

Accuracy4.1 / 5meaning carried over correctly
Terminology2.5 / 5names, titles and martial-arts terms kept consistent across chapters
Register4.9 / 5tone and speech levels (honorifics, banter, formality)
Fluency4.6 / 5reads as natural English prose
Fidelity4.9 / 5nothing added, dropped or summarised
Sanitization5.0 / 5violence and crude language kept, not softened

11 of 11 chapters were scored; a chapter the model refused or failed is counted separately. It wrote about 8,684 output tokens per chapter, reasoning included.