power supply off, cpu can still turn on?

When the switch in the back of my power supply is turned off, i click the power button and the cpu and fan attempt to turn off, then turn back off. why is that? how do i fix it?