The biggest challenge for the network service providers is the day to day advancement of technologies which makes them difficult to manage the traditional networks. This day to day advancement has worked as a motivation to vendors for developing, deploying and migrating their services, installments of new hardware, trained people and up gradation of infrastructure which involves a huge cost and time. These frequent changes demand a new network architecture which supports future technologies and solves all these issues named as the proposal of networks defined by software. A large amount of data is being generated and through the internet, we interact with the world using our smart devices such as tablets, sensors, and smartphones using the concepts of Internet of Things (IoT). Along with continuous growth and development, there is a continuous heterogenous and ever-increasing demands of services. This leads to a cause of emerging challenge of load balancing of networks for meeting up with highly demanding requirements (e.g., high performance, lower latency, high throughput, and high availability) of IoT and 5G network applications. For meeting up highly increasing demands, various proposal of load balancing techniques comes forward, in which highly dedicated balancers of loads are being required for ever service in some of them, or for every new service, manual recognition of device is required. In the conventional network, on the basis of the local information in the network, load balancing is being established. However, the production of more optimized load balancers and a global view for the network is being contained by SDN controllers. So, these well-known techniques are quite time-consuming, expensive and impractical as well as service types aren’t being considered by various existing load balancing schemes. Through this paper, researchers focus on an SDN based load balancing (SBLB) service, in which minimized response time and maximized resource utilization are being considered for the user on cloud servers. The proposed scheme is being constituted by an application module which runs along with a SDN controller and server pools that connect to the controller through SDN enabled switches. The application module contains a dynamic load balancing module, a monitoring module and a service classification module. All messages are being handled in real time and host pool are being maintained by the Controller. The performance of the proposed scheme has been validated by experimental results. Through various experiments, results are being concluded that usage of SBLB results in significant decrease in average response and reply time.