International Journal of Computer Science & Engineering Technology (IJCSET)
Parallel computing is a form of computation in which many calculations are carried out simultaneously. It operates on the principle that large problems can often be divided into smaller ones, which can be solved concurrently. In a distributed system, all processing elements are connected by a network. Parallel computing becomes the dominant paradigm in computer architecture, mainly in the form of multi-core processors. Data parallel programming is one which each process executes the same action concurrently, but on different parts of shared data.