Evaluating Ill-Defined Tasks in Large Language Models

Many evaluations of Large Language Models (LLMs) target tasks that are inherently ill-defined, with unclear input and output spaces and ambiguous success criteria. We analyze why existing evaluation benchmarks and metrics fail to provide reliable or diagnostic signals of model capability for such ta...

Description complète

Enregistré dans:
Détails bibliographiques
Auteurs principaux: Zhou, Yi, Shbita, Basel
Format: Article
Publié: 2026
Sujets:
Accès en ligne:https://arxiv.org/abs/2603.17067
http://arxiv.org/abs/2603.17067
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!