Scoring Rules! Statistical and Strategic Alignment for Text Evaluation Metrics

Reference-based text evaluation metrics, which are widely used to assess natural language generation systems, score a candidate response by comparing it with a reference response. The reliability of an evaluation metric is usually judged by its statistical correlation with human ratings. However, as...

Full description

Bibliographic Details

Main Authors:	Xu, Shengwei, Lu, Yuxuan, Wu, Yifan, Hartline, Jason, Schoenebeck, Grant
Format:	Article
Published:	2026
Subjects:	Artificial Intelligence Computer Science and Game Theory Machine Learning
Online Access:	https://arxiv.org/abs/2608.01423 http://arxiv.org/abs/2608.01423
Tags:	Add Tag No Tags, Be the first to tag this record!