Cave spiders are able to hit you while under a fence two blocks away. Normally they cant hit you at all from under a fence. This happens on 1.11.1 too but the affected versions box only has 1.11.2 and a snapshot.