Survival mode only:

Non-empty Knowledge books in off-hand play the hand animation when used in third-person view but appear not to in first person view.

This seems to be caused by the fact that the book disappears too quickly from the off-hand, so it looks like animation is missing, while it actually isn't