Apple used to have a great QuickTime movie on this. Basically, a longer pipeline doesn't necessarily mean 'better'. Hence the lack of performance on the P4's. A pipeline empties every so often based on the program it's running. While the pipeline isempty it is not processing, until it fills up again. Having more, shorter pipelines decreases this lag.
That's extremely basic but I hope you get the idea. An analogy I've heard is of a fast food restaurant. An Intel processor uses a 'drive up window' where as Apple uses a RISC processor or it's like going into the restaurant. Sure the drive up may be quicker but it can only serve one person at a time and has a longer line. Inside the restaurant there are multiple shorter lines and is often quicker. It's a weak one but hey... additionally, a process from one pipeline may depend on the result from another pipeline. Having shorter pipelines reduces the lag time between processes therefore decreasing the time one pipeline is waiting for another to finish processing.
Very difficult to sumarize pipelines in a paragraph. Hope it helped though