The GPU (Graphics Processing Unit) has always been a processor with ample computational resources. It is a powerful graphics engine and a highly parallel programmable processor having better efficiency and high speed that overshadows CPU. It is used in high performance computing system. The implementation of GPU can be done with CUDA C. Due to its highly parallel structure it is used in a number of real time applications like image processing, computational fluid mechanics, medical imaging etc. KNN (K-th Nearest Neighbor) is the algorithm is the lazy learning method used for finding the points in the data set that are nearest to the query points.