First of all costs are a part of doing business in any venture. So, itemize them and create a plan.
I recently read where most start up fail. I also read that a majority of them a owned by a single individual and that almost 70% of jointly own business succeed. So, it seems that a partnership with one or more people could be advantageous.
Use you contacts. If you don't have any contacts then you are in trouble. They are the ones that get you started.
Most success in our business for small consulting companies is word of mouth. If you do a good job for someone they will help sell you.
Don't rely on a website to market you. That might help IBM, EDS, and CSC, but you ain't none of them.
A friend on mine started a small consulting business by offering his services as charity to local churches and other organizations. The word spread pretty rapidly and he now has a thriving business.
Getting into the consulting business on a part-time agenda might be a good way to start. But, I have found that people don't usually want us part-time. But, if you can manage it, then do it. If you are a success you will know when to leave your perm position and concentrate fully on the consulting business.
And lastly, I wish you all the luck in the world.
Mike