HadoopWatch: A First Step Towards Comprehensive Traffic Forecasting in Cloud Computing

Download Now
Provided by: Hong Kong University of Science and Technology
Topic: Cloud
Format: PDF
In this paper, the authors present their effort towards comprehensive traffic forecasting for big data applications using external, light-weighted file system monitoring. Their idea is motivated by the key observations that rich traffic demand information already exists in the log and meta-data files of many big data applications, and that such information can be readily extracted through run-time file system monitoring. As the first step, they use Hadoop as a concrete example to explore their methodology and develop a system called Hadoop Watch to predict traffic demand of Hadoop applications.
Download Now

Find By Topic