Minor formatting question re:justification in Word 2007.

I have a small but irritating formatting problem. When formatting paragraphs to ‘justify’ sometimes the last line in the paragraph is just a couple of words. These words get spaced out so dramatically that it looks awful. How can I change this? I am new to this forum and I am not sure if this question is appropriate, so please indulge me.