When a solid block is given redstone power using a redstone repeater, any attached redstone torches, on any of the remaining sides or the top, remain on. It is not direction dependent.

If the block is powered using any other usual ways, the torch turns off, as expected. This bug only happens when the block is powered using a repeater.