Webnovel Translation Benchmark

All models

Muse Spark 1.3 for web novel translation

How Muse Spark 1.3 by Meta translated eleven chapters of a Korean web novel into English: rank 8 of 28.

79.3quality score of 100
$0.0024per chapter at list price
$0.24per 100 chapters
1066head-to-head rating

Muse Spark 1.2 scored higher (79.6) for $0.0022 a chapter.

Score by quality

Accuracy4.3 / 5meaning carried over correctly
Terminology1.9 / 5names, titles and martial-arts terms kept consistent across chapters
Register5.0 / 5tone and speech levels (honorifics, banter, formality)
Fluency4.9 / 5reads as natural English prose
Fidelity4.9 / 5nothing added, dropped or summarised
Sanitization5.0 / 5violence and crude language kept, not softened

11 of 11 chapters were scored; a chapter the model refused or failed is counted separately. It wrote about 10,030 output tokens per chapter, reasoning included.