I only see vinyl sold in a few places. There's thrift stores that sell old Cher or Tom Jones albums for $1, and there's record stores that sell limited edition vinyl releases of Bright Eyes and hipster emo albums for $25. I think I will stick with CDs for new music purchases.
That said, my dad was a big music collector when he was younger, and I've had some good times going through his old vinyl. He has a pretty good collection. Lots of classics, and there is definitely something special about the feel of a record.
I like CDs because I have a cassette adapter in my car that lets me play them. I don't have an mp3 player, so I burn stuff off of my computer. I like making mix CDs especially. Also, from time to time I drive across my state to get home from college. I usually get on a rideshare board because carpooling saves the planet and scores me some gas money, so I wind up traveling with people who might not appreciate much of my music, so I have a couple of "inoffensive" mixes that won't make anyone hate the trip, including me. I usually check out their Facebook profiles, giggle at their terrible taste, and then pick the couple of bands they like that don't suck, a few bands I like that aren't too "weird," and make up a mix.
I used to not have a portable CD player, so I did listen to a lot of tapes. I found pretty good ones hella cheap too. Unfortunately they don't hold up very well in a hot car, so most of my favorites got ruined.
I like mp3s because I have a nice big hard drive, and Media Monkey so I can find any song in seconds.
Basically, I like music. I'm not enough of an audiophile to really care about subtle differences in medium, and I'm too poor to listen through anything that'd let me hear the differences anyway, so whatever's most convenient to the situation makes me happy.