Any good quality soap, really. Something like Dove will last you for ages, and as an extra bonus it'll treat your skin way way better, and give you a better shave than any of that expensive-ass goop in a can that gets foisted on poor unsuspecting sods as shaving cream.
As for razors, if you have one of those multi-blade things with the platic knobbly bits and the racing stripe and the vibrator and the microchip and all of that ridiculous junk... Toss it. A pack of four blades for those things cost, what, like >$20? Pish posh. Once again, the much cheaper alternative will also happen to give the superior shave. For a dude on a particularly heavy budget, I'd suggest looking for a single-blade disposable razor, in particularly the BIC brand. Disposable razors are always going to be a bit dodgy but the BIC single-blade is probably as good as they get. Slightly more expensive is the Gillette Sensor which is a two-blade "shaving system" (i.e; handle with replaceable blade cartridge). The Sensor is still fairly common so it shouldn't be hard at all to find blades but it has long been superseded by the Mach 3 and Fusion models and as such is rather cheap.
Another alternative is to try your luck looking for second-hand (or new!) safety razors on eBay or the like. Safety razors are great not just because they are old-school as hell and deliver what is probably the best shave you're likely to get short of a professional barber straight razor shave, but also because blades are ridiculously cheap. So even though you may outlay slightly more on the razor itself, you will more than make your money back within pretty much no time. Of particular note are the Israeli-made generic "Personna" blades. You can get 100 of the motherfuckers for $10, which is enough for two years of daily shaves. And they are great blades, very much a favourite among the discerning shavegeek.
It's possible to get new & used safety razors, some more than 50 years old, for next to nothing on eBay. Obviously, buyer beware, make sure that they are in good condition before buying and thoroughly clean and disinfect any used razor that you purchase. Look for Merkur and Gillette razors, and avoid no-name/generics.
Of course I know that you said that shaving wasn't so much a big worry for you, Tyler, but this thread has pretty much become general savings advice anyway, and I'll seize any excuse to preach stentorian from the mount about shaving.