GPT-SW3: An Autoregressive Language Model for the Nordic Languages

This paper details the process of developing the first native large generative language model for the Nordic languages, GPT-SW3. We cover all parts of the development process, from data collection and processing, training configuration and instruction finetuning, to evaluation and considerations for...

Fuld beskrivelse

Bibliografiske detaljer

Autores principales:	Ekgren, Ariel, Gyllensten, Amaru Cuba, Stollenwerk, Felix, Öhman, Joey, Isbister, Tim, Gogoulou, Evangelia, Carlsson, Fredrik, Heiman, Alice, Casademont, Judit, Sahlgren, Magnus
Format:	Artículo
Udgivet:	2023
Fag:	Computation and Language Artificial Intelligence
Online adgang:	https://arxiv.org/abs/2305.12987 http://arxiv.org/abs/2305.12987
Tags:	Tilføj Tag Ingen Tags, Vær først til at tagge denne postø!