When you hold both shifts down then release and press "e" it makes it so when you click on an item in your inventory it just moves around as if you are holding shift. By rapidly pressing both shift keys again I was able to fix it.