Even when not within simulation distance, if large amounts of snow layers (and supposedly mycelium as well) are being rendered, they will cause massive lag. It used to cause lag in the past as well, but it's gone up exponentially since 1.16.200. Lag spikes are very common, with TPS dropping to 0. It's especially clear on realms.