With any ATX Power Supply there is always a 5 V DC voltage into the case to start the computer as the Power On Button acts like a contact switch to cause a ripple to the 5 V DC line and cause the Power Supply to start working. Then after a short time a signal is sent to the Power Supply to keep running by the M'Board.
Now there are 2 things that could be happening here one is that the second Signal to stay on is being sent and the Power Supply is unable to supply the necessary Power and is shutting down or the other is that the M'Board is not sending the signal and the Power Supply shuts down because it was never asked in the first place to turn on.
Either is a possibility and it really depends on the quality of the M'Board and Power Supply as to which you should look at first but because a Decent Power Supply is reasonably cheep it's easier to try another Power Supply to test with so something like an Antec 350 W will do quite nicely and be quite cheap as well. If it works with that you can fit that PS if it will fit into the case or if you have one of those Generic Cases that takes it's own brand Power Supply you'll have to contact the maker and buy a new Power Supply from them which will be more expensive than any Antec PS that you will ever buy and of a much lower quality so it is likely to fail again and in most cases damage the M'Board at the same time.
Col