IsManga vs Qwen-MT-Image 2.0: Three Manga Pages Side by Side

We ran three raw Japanese manga pages through Qwen-MT-Image 2.0 and IsManga and graded all 41 lines. IsManga got twice as many right and was 2 to 4 times faster.
B

3 min leestijd

IsManga vs Qwen-MT-Image 2.0: Three Manga Pages Side by Side

Translating a manga page takes more than translating text. A tool has to find every bubble, read vertical Japanese (including hand-drawn lettering), translate it in context, erase the original and letter the English back in.

We ran three raw Japanese pages through Qwen-MT-Image 2.0, Alibaba's image translation model, and our own IsManga model, and graded all 41 lines of dialogue. Neither output was edited by hand.

Accuracy

Each line was graded correct, a minor error (the meaning survives), wrong, or left in Japanese. Small sound effects aren't counted.

41 linesIsMangaQwen
Correct2713
Minor error58
Wrong715
Left in Japanese or romanized25

IsManga got twice as many lines right, and the gap grows as the pages get harder.

Page 1: a quiet opening page

Original Japanese opening page of I Got Caught Up in a Hero Summoning, but the Other World Was Peaceful
From I Got Caught Up in a Hero Summoning, but the Other World Was Peaceful.
The opening page translated by Qwen-MT-Image 2.0 and IsManga
Correct lines: IsManga 5 of 7, Qwen 3 of 7.

On a clean page the two are close, and Qwen beat us on the title. It read the logo correctly, while the stylized lettering turned ours into "Hero Summoning 18 Vessels 1297 the Other World Was Peaceful". Qwen's main slip was reading the small furigana above a name as well, so the caption says "Miyama Kaito Miyama Kaito".

Page 2: a gag comedy page

Original Japanese gag comedy page about sea creature spirits
Original page.
The gag comedy page translated by Qwen-MT-Image 2.0 and IsManga
Correct lines: IsManga 7 of 11, Qwen 4 of 11.

The joke depends on which sea creatures have spirits, so every noun and every "not" matters.

  • ウミウシの精霊もイカの精霊もいない ("no sea slug spirits, no squid spirits either"). Qwen: "The spirit of the sea slug also exists. The spirit of the squid also exists.", the opposite. IsManga kept the meaning.
  • 乗りかかった船ですしね, an idiom for "we've come this far". Qwen: "It's a boat I was riding on". IsManga: "Since we've already embarked on this ship together".

Page 3: a busy action-comedy page

Original Japanese action comedy page from Tsukimichi: Moonlit Fantasy
From Tsukimichi: Moonlit Fantasy.
The action comedy page translated by Qwen-MT-Image 2.0 and IsManga
Correct lines: IsManga 15 of 23, Qwen 6 of 23.

This is where Qwen falls apart. It squeezes horizontal English into tall vertical bubbles by splitting words ("W-ho is it!?", "li-m-e") and often reads each column as its own line. IsManga letters each bubble in a comic font sized to fit.

  • 一石三鳥 (three birds with one stone). Qwen: "kill two birds with one stone". IsManga: "three birds with one stone". The count matters: the next panel makes it four.
  • 頭に白い布巻いた褐色でヒゲのおっさん!? Qwen: "Answer: From (1) N top = 6". IsManga: "A brown-skinned middle-aged man with a beard and a cloth wrapped around his head!?"
  • The hand-drawn screams. Qwen: "persimmon", "mountain bird", "sacrifice". IsManga: "Nng-aaaaah! My head, gah!"

Speed

We also timed how long each model took to return a translated page.

ModelTime per page
IsManga2 to 2.5 seconds
Qwen-MT-Image 2.04.8 to 8.5 seconds

IsManga was 2 to 4 times faster, which adds up over a whole chapter.

Where we still slip

Most of our wrong lines come from three things:

  • Sound effects. そっ (moving quietly) became "So?", and しぬぅう ("I'm dying!") was romanized instead of translated.
  • Names. We invented a "Yuko" on page 2 and spelled one character both "Ufufu" and "Yufufu".
  • Stylized text. Besides the page 1 logo, one bubble on page 3 repeated another bubble's line, and 腐葉土 (leaf mold) became "ripe magic leaves", a line Qwen got right.

These are what we're working on next.

Try it

Three pages aren't a benchmark, but they show where each tool is today. To try IsManga on your own manga, install the Chrome extension or the Manga Translator app from ismanga.com and open any raw chapter.

Considering self-hosted AI instead of a cloud API? Try our ROI calculator to see how much you could save.

  • #ai-translation
  • #manga-translation
  • #qwen
  • #model-comparison
  • #raw-manga