In grimstone areas in mountain biomes silverfish infested stone still spawns, however there is no fitting block for them to spawn in. This also causes the silverfish to have nowhere to go once they go out of the infested stone because there is no stone to infest.