When performing Love Is Like Jazz, musicians are apparently asked to play their own improvisations, following certain rules, independently of each other. This kind of free improvisation typifies the avant garde fringes of jazz rather than its mainstream [essay].
The song takes on a different character in live performance where the anarchy finds comic theatrical expression. Daniel Handler, in particular, is known for throwing in snippets of Vangelis's Chariots of Fire theme, Peter Gabriel songs, and other motifs suitable to the occasion, on his accordion.
- [Lyrics and guitar tab] from stephinsongs web site.