|COOKIES: By using this website you agree that we can place Google Analytics Cookies on your device for performance monitoring.|
Stratosphere: Massively parallel dataflow programming
If you have a question about this talk, please contact Microsoft Research Cambridge Talks Admins.
This event may be recorded and made available internally or externally via http://research.microsoft.com. Microsoft will own the copyright of any recordings made. If you do not wish to have your image/voice recorded please consider this before attending
As a reaction to the recent “Big Data” trend, a new breed of systems for scalable data processing has emerged. Our system, Stratosphere, offers an extensible query language for posing queries on complex nested data, an efficient processing engine designed to scale on very large clusters and leverage cloud elasticity, as well as a query optimizer and a runtime engine that guarantee the efficient execution of queries, including iterative queries. Stratosphere pushes the MapReduce paradigm forward by incorporating several optimizations known from parallel databases, as well as novel techniques, while retaining the flexibility of in-situ processing of data using complex user-defined functions.
In this talk, I will provide an overview of the Stratosphere system, placing emphasis on how to optimize and execute in parallel an extended dataflow programming model with user-defined functions and iterative constructs. I will then provide a research outlook for scalable data analytics that includes research topics in the intersection of programming languages, databases, and networks.
This talk is part of the Microsoft Research Cambridge, public talks series.
This talk is included in these lists:
Note that ex-directory lists are not shown.
Other listsComputer Laboratory Tech Talks DPMMS Pure Maths study groups Historical Linguistics Research Cluster
Other talksMirages, in the Spirit of JBK: Rays, Caustics, Waves and Raman's Instructive Confusion “How does melanopsin help us to see?“ The wrapped Fukaya category of a Weinstein manifold is generated by the cocores of the critical handles The Uniates and the Invention of Eastern Orthodoxy Late Byzantine and early Ukrainian Advocates of Church Union in the Crossfire between Rome, Constantinople, and Moscow Re-imagining the Boko Haram sect as a purveyor of public services in northern Nigeria Enterprise Tuesday 2017: rough diamonds pitch for your support