And can not see any problems.
What you are doing wrong here is believing turning on the Power Supply turns on the computer and makes it run "IT DOESN"T." With ATX Power Supplies it just turns on the Power Supply and provides low voltage to the unit so things like the optical Mouse has power and the Real Time Clock BIOS or whatever you want to call it and you are not running on the battery to power the RTC Chips.
What you need to do once the you turn on the power is normally push the Power Button on the Front of the case and then the system should turn on.
Those wires include a General Power LED and HDD Activity LED a Reset Switch and the Power Switch and sometimes a Speaker. All switches are make and break switches so when they are pushed in they make the circuit and when you release them they break the circuit. ATX System require a ripple to start the computer and if you hold the switch it screwy things will happen depending on the M'Board and BIOS they may start and turn off straight away then start again or they may do nothing at all.
Also just turning off the Power Supply doesn't necessarily remove power from the M'Board so you need to not only turn it off but unplug it before changing things on the M'Board. Changing bits with power can burn things out very quickly.
As for blowing up the Power Supply that is how they run when the system is turned off so the only way you should damage it is to have a spike come in ove rthe mains you should be able to leave it on 24/7/365 with no adverse affects.
What you need to do here is either find a contact switch and leads from an old case or bridge out the 2 pins that turn on the system when Power is supplied to get it to run. Personally I wouldn't even bother having any RAM Fitted just the M'Board, CPU and as that M'Board appears to have a speaker mounted on it that should give you the BIOS Message for that BIOS Type.
Can't help you with that as I don't know the make and model of the M'Board
What you can do if you know the Boards well is short out the 2 pins with the blade of a screwdriver and then remove the driver and watch it run if it is going to but "YOU NEED TO KNOW THE BOARD VERY WELL" as if you short out the wrong pins you'll kill the board.