replacing memory

Do I have to replace both sticks or can I just put in one? I have two 128MB DIMM. Is it possible to put in one 256MB stick while leaving in one of the 128 MB sticks?
Also, does this take away from performance. (Having one 128 stick and one 256 stick.)