When connecting a noteblock into a redstone clock, the Allay will connect to that noteblock as normal.

However, after deactivating the redstone clock, I waited a few seconds and the Allay disconnects from that noteblock, however, the allay stops following me, even if they have an item.

They will still try to pick up the item and drop it off near me, however, their follow behaviour is broken.

I used the comparator clock thing, to make the noteblock constantly attract the allay's attention. there are images of the redstone contraption below.

I hope this helps!