From the 1.11.1 blog post on minecraft.net:

Changed the attack indicator to hint when you should attack

In 16w50a, the attack indicator displayed an exclamation mark when fully loaded and focussing on an entity, this is no longer the case.