I have a similar problem. When I'm out buying CDs, I am always on the lookout for bands I haven't heard of before, but unfortunatly, my subconcious has very specific things it looks for when I am browsing CD collections. The things that actually attract me to albums are inherently shallow. The only reason I own any My Morning Jacket albums is because I bought It Still Moves on the basis that it had a bear on the front cover. Its silly and absurd, and its not a good way to gauge the music at all, but seeing as I really don't trust most people to share similar tastes with me, its the only system I have for finding bands outside of my city anymore.
I shudder to think of how many albums I've passed over simply because the cover art wasn't any more than functional. I also have an annoying habit of dismissing bands for having names that I consider to be ripoffs of existing band names, even if the connection is some bizzare coincidence or something.
Mostly I'm just glad its easy to download music in entire albums over bittorrent, because that is the only way I have been able to buy CDs I actually enjoy anymore.
Otherwise I would probably just own nothing but Tool, Funkadelic and Mr Big albums, and I would be that guy who is a real jerk about liking all of those bands, because I have nothing else to listen to.