I'm using the Oculus Rift with the Touch controllers. While playing, at seemingly random times, using an item will swap to another item on the hot bar (usually consistently the same spot, although not consistent between instances of the bug).

For example: If I try to mine stone with a pick-axe, right when I start mining, it swaps to the bread in a different slot. Bread is the wrong tool for the job. Even worse, this can happen during combat, forcing me to change my sword to a baked potato, a tactically inferior choice in this situation.

When this happens, no button presses seem to resolve the issue, other than exiting and rejoining the map. I've yet to find the scenario that reproduces the issue, but it tends to happen multiple times a session. 

I regret having paid for a Realm last year, as this issue convinced me to stop playing. I tried playing again recently only to find that the issue still persists. I'm hoping raising the issue here can help resolve this so I can finally play again without frustration.