While digging a hole I came across a few (more than 10) blocks that contained silverfish. After a search for the suspected stronghold nearby, I didn't find anything.

Screenshots show that it really was inside a swamp.