If you spam click (or change the "use item" controls from "right button" to any key and hold down that key) with a disc in your hand at a jukebox, when you take the disc out, the music will still be playing, even if you break the jukebox. The only way to stop the music is to relog into your world.