Horses are going through walls and closed fence gates

What I expected to happen was...: I put horses in fences with a wall at the back and i had a fence gate.

What actually happened was...: The horse went through the wall and fence gate a couple times