Program Synthesis and Understanding with Pretrained Language Models

Add to your list(s) Download to your calendar using vCal

• Ignacio Iacobacci, Huawei
• Thursday 10 November 2022, 11:00-12:00
• GR04, English Faculty Building, 9 West Road, Sidgwick Site.

If you have a question about this talk, please contact Panagiotis Fytas.

In the last few years there has been a tremendous growth in the topic of understanding and generation using NLP -grounded deep learning models. While earlier approaches were able to deal with just the simplest tasks, the recent application of Pretrained Language Models (PLMs), specifically trained with code snippets, has brought new capabilities, especially for the task of text-to-code generation or program synthesis. This talk will discuss the reasons of the recent growth of interest on this topic. We will discuss the main differences between working on natural language and programming language. We will provide an overview of the latest approaches, their intended use and limitations. Among other models we will introduce PanguCoder, our brand new Huawei in-house model for code synthesis, which constitutes the building block of the AI-assisted tool for code generation from Huawei. We will cover existing datasets and benchmarks are useful to make a fair comparison among different approaches. We will mention CodeXGlue, a benchmark that cover most common code-oriented tasks, and HumanEval which is, at this time, the de facto benchmark for text-to-code generation. Finally, we will show some applications in the real word and future perspectives in the area

This talk is part of the Language Technology Lab Seminars series.

This talk is included in these lists:

• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• GR04, English Faculty Building, 9 West Road, Sidgwick Site
• Guy Emerson's list
• Interested Talks
• Language Sciences for Graduate Students
• Language Technology Lab Seminars
• Simon Baker's List
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.