I haven't seen anyone talking about this so I might be wrong but It seems like the Japanese language pack uses a Chinese font? For example, this is how these words are written in a Japanese font:

And this is how they look in Minecraft:

Which is how they look in Chinese. I tried with the "Force Unicode Font" setting turned on and off and it didn't make any difference.