Thrift stores? Usually if you search about 5 you'll find one good one. And they're never more than $20, in my experience. I'd say searching through thrift store shelves for an afternoon is much more entertaining than sitting around on ebay or walking into target and paying $100(not to put down any of those activities, I just enjoy the concept better personally)
Hit up five last night and found not one good one. Found three, none good.
One was too small to play full-size records (dunno the terminology).
Two was completely inoperable.
Three had no needle (and though you can get replacement ones I didn't want to have to buy the thing, order a new needle, wait for it to arrive, and then find out the thing didn't work anyway).
But, after my long and arduous search, I came across the fact that my dad had a record player in his new store that he opened up. Somehow he didn't know I was in the market.
The thing is gigantic. It's not just a player, but a cabinet with the player and stereos somewhere inside. Sound quality is actually quite good considering the thing is pretty old. My dad also had hundreds of records he's supposed to sell at this store, that now reside in my living room. I am to go through them and catalog what we have. As payment, keep what I want.
Sound quality is actually not bad, depending on the record (but that'll happen with anything, no doubt). Better than I thought it would be, though not perfect.
To stay more on topic: Personally, I would suggest finding an old, cheap one to start out with. I hope to upgrade sometime soon, but for now this does me quite well.