Of course, this got me thinking about the song, and I realized a small thing about it: "away" in the line "Far into the night and drift away" is sung with a melisma (D A G, I think). Musically, this gives something of an impression of the movement of "drift[ing] away."