Signs in five languages: FLUX.3 klein, Qwen-Image 2.1 and MOSS-Image on a 12 GB card
Yesterday's Japanese text test showed that all three models can write short Japanese on a 12 GB card. Today we asked the same question for five more languages: English, Spanish, Chinese, Arabic and Hindi.
The test
Three scenes per language, each with the exact text in quotes: a cafe sign ("OPEN", "ABIERTO", 「营业中」, «مفتوح», «खुला है»), a summer-festival poster title, and a two-line chalk menu ("Today's special / Green tea latte" and its translations). Two seeds (300, 301), 1024×1024, the same model settings as the Japanese test, one rented RTX 5070 12GB per model. A picture counts as correct only if every quoted string is spelled exactly; stray extra text elsewhere was not counted as a miss.
| Language | FLUX.3 klein | Qwen-Image 2.1 | MOSS-Image SFT |
|---|---|---|---|
| English | 6/6 | 6/6 | 6/6 |
| Spanish | 6/6 | 6/6 | 5/6 |
| Chinese | 6/6 | 6/6 | 6/6 |
| Hindi | 4/6 (+2 unclear) | 2/6 | 2/6 |
| Arabic | 1/6 | 2/6 | 1/6 |
| Total | 23–25/30 | 22/30 | 20/30 |
| Median per picture | 11.5 s | 12.7 s | 15.7 s |
What we saw
- English, Spanish and Chinese are solved for short text. The only miss was MOSS writing "leiche" for "leche" once.
- Arabic failed for everyone. The one-word sign usually worked, but the poster title «مهرجان الصيف» and the menu's first line «طبق اليوم» were wrong in all six pictures of every model: letters are joined correctly but the wrong letters appear (for example «طيق» or «طرق» for «طبق»).
- Hindi separated the models. FLUX.3 klein wrote both menu lines and the sign correctly every time. Qwen and MOSS dropped or replaced conjunct letters: «विशेथ» or «विशेस» for «विशेष», «याय» for «चाय», «उलव» for «उत्सव». FLUX's two poster titles render «ग्रीष्म» with an odd-looking conjunct; we could not decide, so they are shown as a range.
- Qwen-Image's first run lost 28 of 30 pictures to errors; the table uses a full rerun with the same prompts and seeds.
How much to trust this
- We are not native readers of Arabic or Hindi and graded by comparing letters with the prompt. If you read either language and see a mistake in our grading, please tell us via the report page.
- Two seeds per prompt, one machine per model, short strings only.
- Krea 2 Turbo is still failing on our setup, so it is missing from this test.