Hey, I don't think this is a real disturbing bug but I also think that it shouldn't be like that.
But like the summary says the horse's nametag is visible when looking in its inventory, this is the same for mules and donkeys.
I've named the horse egg with an anvil. (I don't think that matters xD)

Bye! // xXmailXx