Okay, I was ready to be extremely bored by the halfway mark of the first song... and then it hit its peak (when he sings the title phrase "halfway home") and damn was I digging the groove. It led into the second song, which thoroughly impresised me with its funk vibes, and then the straight hip-hop approach of the third song caught me off-guard still. I hope you're beginning to get the picture? The thing is, despite the album being all over the place, everything it does, it does well. I was extremely skeptical when I heard people talking about a TV on the Radio album as album of the year material (or even top 5), but I can see that, now.
As odd as it sounds, I think this album is more along the lines of what I expected out of the new Of Montreal. And some songs ("Halfway Home" and "Stork and Owl" in particular) are written in a similar style, too (smaller musical "ideas" welded together into the larger song), but with less schizophrenia and more clean, gentle flowing from piece to piece. The result is much, much better.
P.S.: Fight you, sir, re: "Family Tree." I think the song works well in its place.