Assessing language-specific capabilities of LLMs: Lessons from Swedish NLP
- đ¤ Speaker: Felix Morger (University of Gothenburg) đ Website
- đ Date & Time: Friday 21 February 2025, 11:00 - 12:00
- đ Venue: ONLINE ONLY. Here is the Zoom link: https://cam-ac-uk.zoom.us/j/4751389294?pwd=Z2ZOSDk0eG1wZldVWG1GVVhrTzFIZz09.
Abstract
Abstract: In this talk, I discuss benchmarking and interpreting large language models in the context of Swedish. I present a selection of work from my PhD thesis, which analyze LLMs Swedish-specific capabilities in different areas: English-Swedish language transfer, multi-task benchmarking on Swedish NLU and targeted analysis of a specific case of Swedish linguistic variation. I outline some of the challenges that arise when trying to assess the language-specific capabilities of LLMs, some lessons I’ve learned throughout from my work and give a future outlook.
Bio: Felix Morger is a software engineer and computational linguist based in Gothenburg, Sweden. He recently defended his PhD thesis, titled “In the minds of stochastic parrots: Benchmarking, evaluating and interpreting large language models”. His main research interests are in benchmarking and model interpretability of large language models with a large focus on Swedish.
Series This talk is part of the NLIP Seminar Series series.
Included in Lists
- All Talks (aka the CURE list)
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge talks
- Chris Davis' list
- Computer Education Research
- Computing Education Research
- Department of Computer Science and Technology talks and seminars
- Graduate-Seminars
- Guy Emerson's list
- Interested Talks
- Language Sciences for Graduate Students
- ndk22's list
- NLIP Seminar Series
- ob366-ai4er
- ONLINE ONLY. Here is the Zoom link: https://cam-ac-uk.zoom.us/j/4751389294?pwd=Z2ZOSDk0eG1wZldVWG1GVVhrTzFIZz09.
- PMRFPS's
- rp587
- School of Technology
- Simon Baker's List
- Trust & Technology Initiative - interesting events
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)

Felix Morger (University of Gothenburg) 
Friday 21 February 2025, 11:00-12:00