When you are playing songs & rearranging your library, right click the songs and choose either "Play next in iTunes DJ" or "Add to iTunes DJ". The songs you pick will still play, but because they're not playing through your library, it won't make the screen jump from where you are to whatever the next song is.