Programming Your Network at Run-Time for Big Data Applications
Recent advances of software defined networking and optical switching technology make it possible to program the network stack all the way from physical topology to flow level traffic control. In this paper, the authors leverage the combination of SDN controller with optical switching to explore the tight integration of application and network control. They particularly study the run-time network configuration for big data applications to jointly optimize application performance and network utilization. They use Hadoop as an example to discuss the integrated network control architecture, job scheduling, topology and routing configuration mechanisms for Hadoop jobs.