Condensing the cloud: running CIEL on many-core

Add to your list(s) Download to your calendar using vCal

• Malte Schwarzkopf (University of Cambridge)
• Thursday 07 April 2011, 16:00-17:00
• FW26, Computer Laboratory, William Gates Builiding.

If you have a question about this talk, please contact Eiko Yoneki.

Distributed execution engines have revolutionized data processing by making parallel programming simple. Systems such as MapReduce, Dryad and Hadoop can achieve massive throughput when running on thousands of commodity servers, yet generally only require the programmer to provide sequential code. These systems were designed to scale out across many worker machines, each of which had at most a handful of processors. As such, intra-server parallelism is either left entirely to the developer or managed centrally. In this talk, I will compare the performance of our recently-developed CIEL distributed execution engine on three quite different 48-core platforms: an AMD “Magny-Cours” ccNUMA server, an experimental Intel Single-Chip Cloud computer, and an Amazon EC2 cluster of 48 uniprocessor VMs. Our results demonstrate task creation/coordination overhead to be a problem when using fine-grained tasks, and we demonstrate a few simple improvements that mitigate these issues. We also outline a set of further challenges and opportunities.

This is a practice talk for SFMA 2011 at Eurosys.

Paper: http://www.cl.cam.ac.uk/~ms705/pub/papers/2011-ciel-sfma.pdf

SFMA : http://research.microsoft.com/en-us/um/people/rmcilroy/SFMA/index.htm

This talk is part of the Computer Laboratory Systems Research Group Seminar series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• CL's SRG seminar
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Chris Davis' list
• Computer Laboratory Systems Research Group Seminar
• Computer Laboratory talks
• FW26, Computer Laboratory, William Gates Builiding
• Interested Talks
• School of Technology
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• rp587

Note that ex-directory lists are not shown.