The top row, furthest right inventory slot can only be selected if the cursor is at the very bottom of the box. So with the attached picture, the only way to get the oak planks out of that slot is to click the very bottom of the box.