I like what I like because, well, I like stuff that is creative and different, and never takes itself way too seriously. Sometimes my taste in music doesn't seem to make much sense, such as my liking Curve but not Bloc Party, or how I like (nay, adore) Overseer but not much else in terms of rap or techno. Basically, I think that any band that's not afraid to screw around once in a while, try making a record with many different elements and emotions, or with a beat that changes quite a bit from song to song, is a good band for trying their best to evolve and be different.
For example, One of my favorite bands ever, the Plastilina Mosh, is a duo from Mexico who simply cannot stick to one single style or mood. Each of their songs is so radically different and downright confusing that it's almost impossible to discern them all as being written by the same artist. From growling raps to upbeat sing-alongs to sexy and danceable to the most confusing breakbeat song ever, with samples from a tape on how to learn Japanese, no less, Plastilina Mosh will always remain my favorites for refusing to stay the same. Always shifting techniques and jumping from one genre to another, their songs are always fun to listen to because they share almost nothing in common.
And that basically explains my taste in music.