Thanks Chris.
I was initially planning to try and buy it all second-hand, sure I'll struggle along the way, but the learning curve will be part of the fun.
I won't be buying a Crosley (although seeing them in the first place got me interested in vinyl), but I think it's wise if I start with a very low budget. I can then upgrade as I go on / as I learn more about the equipment etc.
Glad I've now got a cheap turntable on the way, now to find an amp and speakers!