Great advice all...
I also agree to keep it simple & cheap for your first couple of batches. Keep it fun... then you'll start to see what you want to upgrade or expand to next!
When I started in '92, my starter kit was $65 and included the ingredients for the 1st batch. I'm sure it would be more now... but it was basically:
1 5-gal bucket fermenter
1 5-gal bottling bucket
1 hydrometer
1 fermentation lock w/stopper
1 bottle brush
1 racking cane & 5' of tubing
1 hand capper
1 bag of bottle caps
1 5# bucket of liquid malt extract
some hops
packet of yeast
priming sugar
2 page instructions
I got some used bottles from the local sushi bar, borrowed my mom's chili pot, used a bleach solution to sanitize everything (not recommended BTW), and used the kitchen's gas stove top & sink.
I made beer. Simple, lackluster beer. But it was a good start! Aside for adding a stainless brew kettle, I used most of that equipment for like 10 years. You'll have plenty of time for nifty upgrades later...
Good luck!
--LexusChris