Kapak Resmi

Inverse Scaling: When Bigger Isn't Better

Work on scaling laws has found that large language models (LMs) show predictable improvements to overall loss with increased scale (model size, training data, and compute). Here, we present evidence for the claim that LMs may show inverse scaling, or worse task performance with increased scale, e.g....

Ful tanımlama

Kaydedildi:
Asıl Yazarlar: McKenzie, Ian R., Lyzhov, Alexander, Pieler, Michael, Parrish, Alicia, Mueller, Aaron, Prabhu, Ameya, McLean, Euan, Kirtland, Aaron, Ross, Alexis, Liu, Alisa, Gritsevskiy, Andrew, Wurgaft, Daniel, Kauffman, Derik, Recchia, Gabriel, Liu, Jiacheng, Cavanagh, Joe, Weiss, Max, Huang, Sicong, Droid, The Floating, Tseng, Tom, Korbak, Tomasz, Shen, Xudong, Zhang, Yuhui, Zhou, Zhengping, Kim, Najoung, Bowman, Samuel R., Perez, Ethan
Materyal Türü: Makale
Baskı/Yayın Bilgisi: 2023
Konular:
Computation and Language
Artificial Intelligence
Computers and Society
Online Erişim:https://arxiv.org/abs/2306.09479
http://arxiv.org/abs/2306.09479
Etiketler: Etiketle
Etiket eklenmemiş, İlk siz ekleyin!

Internet

https://arxiv.org/abs/2306.09479
http://arxiv.org/abs/2306.09479

Benzer Materyaller