You can see the bug in the picture. It doesn'a appear to be a problem when rtx is off. I've tried it with 2 different texture packs, the bug is present for both of them so it's probably not the texture pack's fault.

Edit: also appears to be the case with glass blocks instead of nether portal blocks. Might be a general issue with beacon beams and transparent blocks