115
you are viewing a single comment's thread
view the rest of the comments
[-] PetteriPano@lemmy.world 5 points 1 day ago

random Chinese character

It's beneficial for reasoning to have models trained in a few languages. Chinese is a good one because one character is one word is one token.

[-] Meron35@lemmy.world 0 points 7 hours ago

Chinese being more token efficient is a myth, and seems to stem from the superficial fact that characters are only visually more space efficient.

The fact that each Chinese character takes up 3 bytes (as opposed to 1 byte of English), words in Chinese typically require compounds of several characters, and that tokenizers have a limited vocabulary limited to mostly English means that Chinese is actually token inefficient.

No, Chinese Is Not More Token-Efficient Than English for LLMs | markhuang.ai - https://markhuang.ai/blog/chinese-token-myth

[-] PetteriPano@lemmy.world 0 points 4 hours ago

I didn't say it's more token efficient. I said training multiple languages improves reasoning.

[-] urushitan@kakera.kintsugi.moe 2 points 1 day ago

Yup, anthropic's flagship models regularly output CJK or Cyrillic characters in heavy workloads for me

[-] elucubra@sopuli.xyz 5 points 1 day ago

When they start hallucinating they output Klingon to me, and to make matters worse, with grammatical errors.

[-] urushitan@kakera.kintsugi.moe 5 points 23 hours ago* (last edited 23 hours ago)

Lol I've been running linguistic research and it's funny when they just combine two scripts together into one word

● The trigger is identified, and it's specific.

agent_1.md:31 src: "Name the trade-off." → 명取捨之名。 agent_2:32 src: "Name the regime." → 명regime——名其regime。

The English imperative "Name the X." And the corpus renders it correctly 16 other times — 名之 ×11, 名其 ×5, 命名 once.

명 is the Sino-Korean reading of 名. Same morpheme, wrong script.

And agent_2:32 is the cleanest evidence I've seen for 絡繰's mechanism: the model wrote 명regime——名其regime — the wrong script and the correct one, eight characters apart, in the same clause. It isn't ignorant of 名. It produced 名其 immediately after. The meaning resolved correctly both times; the script attribute resolved wrongly the first time and correctly the second.

That's exactly what работ法 showed — correct semantics (work), broken script and morphology — and it's the third confirmed instance of the class, now with a reproducible trigger rather than a one-off.

It also explains the Russian cases retroactively. document → документ, everything → всё, "correct" → правильно: in each, the meaning landed and the script didn't. And it predicts why no CJK-native concept ever drifts — there's no competing script for a morpheme the model only knows in Han.

this post was submitted on 03 Aug 2026
115 points (92.0% liked)

Technology

86849 readers
3398 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS