Bees seem to multiply in loaded chunks over time. After further testing it seems like the issue occurs if the behive is right behind the border of an unloaded chunk while the chunk with the bees is still loaded. Bees trying to enter the unloaded beehive seems to cause the issue.

Vanilla instalation of the 1.18.1 version, singleplayer