Inserting images in Word Document?

Why does the file size increases when I insert a .jpeg image in a Microsoft word document? I want to be particular about the instance, I had a word file carrying 23 kb when the insert the .jpeg image to it, it became 1.03 mb but, the .jpeg file carries only 54 kb. Why does it happen so?