The emerging technology in the area of Information technology is cloud computing. Cloud computing is the term associated with the virtualization, networking, software and services offered by web. The elements involved in cloud computing are clients, datacenter and distributed server. One of the main problems in cloud computing is load balancing. Balancing the load means to distribute the workload among several nodes evenly so that no single node will be overloaded. Load can be of any type that is it can be CPU load, memory capacity or network load. In this paper, the authors presented an architecture of load balancing and algorithm which will further improve the load balancing problem by minimizing the response time while maintaining SLA.