Kegging is a serious investment, so I would be sure you'll want to get serious about the hobby before going down that road. When you do decide to start kegging, you can invest in a setup that will match your fridge/freezer and how you want to serve some beer, and probably save money over a prepared kit too.
I would also think seriously about whether or not you want a setup that comes with glass carboys for fermenters. Glass vs plastic is a perpetual debate among homebrewers, but plastic is safer and cheaper.
+1 to the kegging comment, and the plastic vs. glass comment. When I started homebrewing a few years back I did everything budget minded because I wasn't sure I would enjoy the hobby. Turns out I loved it, but it isn't for everyone. Not everyone enjoys burning the better part of a day cleaning and boiling and cleaning some more and sanitizing and did I mention the cleaning part?
If you have the money and you don't mind the risk of not enjoying the hobby, I say go for it. I would definitely suggest better bottles over glass carboys, though, simply because they are easier to handle. I have dropped mine several times and was very thankful I went with plastic vs. glass. Plus the ported models make life easier - no need to mess with a siphon.
Hope that helps.