Effect of Counters in Performance of Hadoop
Recent technological advancements have led to an overflow of data from distinctive domains (e.g., health care and scientific sensors, user-generated data, Internet and financial companies and supply chain systems) over the past two decades. Big data is commonly unstructured, huge in volume and require more real-time analysis. This paper discusses a big data problem from NCDC for huge volume of weather data collected from various parts of world. The authors had generated map and reduce function for solving this problem and experimental results of these applications on a Hadoop cluster are being discussed.