SwingArena: Competitive Programming Arena for Long-context GitHub Issue Solving

We present SwingArena, a competitive evaluation framework for Large Language Models (LLMs) that closely mirrors real-world software development workflows. Unlike traditional static benchmarks, SwingArena models the collaborative process of software iteration by pairing LLMs as submitters, who genera...

Description complète

Détails bibliographiques

Auteurs principaux:	Xu, Wendong, Xiong, Jing, Zhao, Chenyang, Chen, Qiujiang, Wang, Haoran, Shen, Hui, Wan, Zhongwei, Dai, Jianbo, Wu, Taiqiang, Xiao, He, Tao, Chaofan, Mao, Z. Morley, Sheng, Ying, Guo, Zhijiang, Yang, Hongxia, Yu, Bei, Kong, Lingpeng, Gu, Quanquan, Wong, Ngai
Format:	Article
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	https://arxiv.org/abs/2505.23932 http://arxiv.org/abs/2505.23932
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!