If you're new to reloading, like I was 5 or 6 years ago, I would suggest you DO start with a reloading kit that includes basics like press, scale, reloading manual, primer seating tool, etc. You'll get a better price on the things you will need, even though some of the included tools will never get used.
If you wait until Black Friday to make your purchase you'll save more money and frequently there will be special kits available. Mine included an ultra-sonic cleaner. And if you go online and buy (for instance) Cabalas gift cards at 15% (or more) off, you'll save even more. Get them early, they go fast. Giftcardgranny is one I can think of immediately.
There are some really good presses out there, but for what you're looking for, I'd suggest one of the Hornaday loading press kits as they use a 1/6 turn cam-in die installation that takes a lot of the frustration out of die use for a newbie. It's not on par with the best presses, but it's quite adequate for a starter.
Hornaday makes a lot of other reloading tools that you'll need for measuring various components at different stages of loading. You'll need a OAl gage set, and headspace comparator set also. Digital Calipers are a must.
Get your cash hoard built up, including discount cards and wait for a big sale. Then be the first one in the door in the morning, shopping cart in hand. That will get you started for not a lot of coin.