Once you open debug screen with debug pie it cannot be hidden. After hiding debug screen debug pie stops updating but it is still visible even in menus. Game must be restarted to hide it.