You can hit them, look in their eyes, etc. They will not attack you if you make them hostile towards you, then go into creative then switch back to survival, but they will teleport and follow you everywhere still.

This also happens if you make them hostile towards you, then dont attack them for 1-2 minutes, possibly even running away, and then when they give up on you(unhostile) they still teleport and follow you everywhere.