Scripting the Cloud With Skywriting
Source: University of Cambridge
Recent distributed computing frameworks - such as MapReduce, Hadoop and Dryad - have made it simple to exploit multiple machines in a compute cloud. However, these frameworks use coordination languages that are insufficiently expressive for many classes of computation, including iterative and recursive algorithms. To address this problem, and generalise previous approaches, the authors introduce Skywriting: a Turing-powerful, purely-functional script language for describing distributed computations. In this paper, they introduce the main features of Skywriting, and outline the novel cooperative task farming execution engine.