Setting a keybind to Button5 doesn't disable it's ability to navigate backwards.

In my case specifically, I set Button5 to Menu Tab Right. When I opened the Play menu and tried to go to the Servers tab, I was booted back to the main menu.