Sure it looks cool but when is it over k

I have never dealt with purchasing server hardware or a whole new server before how do you decide what is a necessity and what is over kill. I work for a small company and cost is a huge deciding factor. How do I shuffle through all the technological oohs and aahs and get to what is practicle yet functional?