I consider this as a bug because every other container menu without storage have the same behavior to return an item to your inventory.

Steps to reproduce:
1. Open beacon menu
2. Place iron ingot in payment slot
3. Close beacon menu

Observed result: Iron ingot is dropped on the ground
Expected result: Iron ingot will be returned to my inventory