Firing someone is the second hardest thing any manager has to do. The hardest is laying someone off...you have to look someone in the eye and say "You've done a good job and added value but you can't work here anymore". Avoid these situations if possible...no fun for anyone.
I'm guessing this may be your first experience firing someone, or at least the first time you've had to fire someone you personally hired and so quickly after their start date. You may be feeling guilty about that, or perhaps you're thinking you've not done your job well. Get over it.
The comments by the other posters are valuable and make sense. You have to be careful what you tell your remaining staff for a couple of reasons...legal constraints, and you want to manage the message.
I suspect this is the origin of your problem. Your best bet would have been to have a short, sweet meeting with your staff, no more than about 30 seconds, in which you could have said something along the lines of you regretfully had to report that as it turned out Joe Blow's skills were not consistent with his job responsibilities and as such you had to let Joe go. You could have gone on to say you took responsibility for this...as the hiring manager it's your job to identify the best possible candidates and that didn't turn out to be the case. Finished.
In situations such as this, less is more. These are the types of things you want to handle and move on, quickly. You want to be seen as a strong competent manager who wants to be surrounded by strong competent employees, but at the same time you're willing to admit your mistakes. Plus, most importantly, you always want to accentuate the positive rather than dwell on the negative.
You say the person you hired looked like an average performer. Why did you hire someone who you expected to only be average? This all by itself sends a bad message to staff. I'm guessing your remaining staff may have some competency issues...managers who tolerate mediocrity in some typically tolerate it in all. If so, it's no wonder they're all gossiping about this...people typically give themselves a lot more credit for competency than they deserve, but at the same time most folks also know their own limitations.
I'd advise you to address this situation simply. It would be wrong at this point to convene any meetings or have any discussions about what's already happened...it's water under the bridge, and the only thing you can do by continuing to discuss it is make things worse. Get everyone concentrating on their work. That's what they're supposed to be doing anyway, and if they're working they'll have less time for water cooler conversation and maybe their own performances will improve in the process.
This will all blow over sooner rather than later, if you handle it professionally. Allow it to simply run its course and get everyone focused on their jobs