What was expected was to enchant a book at the Enchantment Table.
Instead, I lost the XP and the book wasn't enchanted and could still stack with other books.

To reproduce this,
1. Log on to a Multiplayer Server (the one I used was Rugotopia.Beastnode.net:25571)
2. Gather XP (if not already gathered)
3. Acquire a book and enchanting table (I had the "full" enchanting table that goes to level 30)
4. Enchant the book. (I tried last tier [3rd row] and second tier [middle row])
5. See that the book stays the same (not enchanted) but your XP decreases by the enchantment level.
6. Even try to enchant something with the Should-Be Enchanted Book, and see it doesn't Enchant.