I finally got around to looking up the lyrics for "Rocket Man" to find out what that line really says. It's "burning out his fuse up here alone." Not "burning all the shoes I ever owned."
That's still what it sounds like but I never could remember to google the words.