Accès ouvert
2026
preprint
OpenAlex
Nitya Nadgir, Sayash Kapoor, K. Liu, Peter Kirgis et autres
When a benchmark's accuracy saturates, it is often retired and replaced with a more challenging version. We show that this approach privileges accuracy and misses the opportunity to study six other key dimensions of agent performance: construct validity issues such as shortcuts, …
Accès ouvert
2026
preprint
OpenAlex
Nitya Nadgir, Sayash Kapoor, K. Liu, Peter Kirgis et autres
When a benchmark's accuracy saturates, it is often retired and replaced with a more challenging version. We show that this approach privileges accuracy and misses the opportunity to study six other key dimensions of agent performance: construct validity issues such as shortcuts, …
us, ru
(code pays fourni par la source)
Accès ouvert
2026
preprint
OpenAlex
Stephan Rabanser, Sayash Kapoor, Peter Kirgis, K. Liu et autres
AI agents are increasingly deployed to execute important tasks. While rising accuracy scores on standard benchmarks suggest rapid progress, many agents still continue to fail in practice. This discrepancy highlights a fundamental limitation of current evaluations: compressing agent behavior into a single …
Accès ouvert
2026
preprint
OpenAlex
Stephan Rabanser, Sayash Kapoor, Peter Kirgis, K. Liu et autres
AI agents are increasingly deployed to execute important tasks. While rising accuracy scores on standard benchmarks suggest rapid progress, many agents still continue to fail in practice. This discrepancy highlights a fundamental limitation of current evaluations: compressing agent behavior into a single …
us
(code pays fourni par la source)
Accès ouvert
2025
article
OpenAlex
Fang Zou, K. Liu, Xingwang Zhu, Xiang-Ping Ding et autres
Introduction The combination of non-invasive ventilation, particularly nasal intermittent positive pressure ventilation (NIPPV), and exogenous surfactant therapy has been shown to significantly reduce mortality and morbidity in neonates with respiratory distress syndrome (RDS). The 2022 European Consensus Guidelines on RDS recommend a …
cn
(code pays fourni par la source)
Accès ouvert
2025
preprint
OpenAlex
Sayash Kapoor, Benedikt Stroebl, Peter Kirgis, Nitya Nadgir et autres
AI agents have been developed for complex real-world tasks from coding to customer service. But AI agent evaluations suffer from many challenges that undermine our understanding of how well agents really work. We introduce the Holistic Agent Leaderboard (HAL) to address these …
Accès ouvert
2024
article
OpenAlex
K. Liu, Yukun Wang, Jianfang Sun
cn
(code pays fourni par la source)
2024
conference-abstract
OpenAlex
D. Clark Files, Kevin W. Gibbs, Michael A. Matthay, C.S. Calfee et autres
us
(code pays fourni par la source)
2024
conference-abstract
OpenAlex
Ann A. Zalucky, José Dianti, Lucile Neyton, Pratik Sinha et autres
us, ca
(code pays fourni par la source)
2024
conference-abstract
OpenAlex
Pratik Sinha, Lucile Neyton, Aartik Sarma, K. Liu et autres
us
(code pays fourni par la source)
2024
conference-abstract
OpenAlex
Andrea R. Levine, N. Wu, K. Delucchi, Michael A. Matthay et autres
us
(code pays fourni par la source)
2024
conference-abstract
OpenAlex
Pablo Sanchez, N. Wu, Emma Schmiege, Kirsten N. Kangelaris et autres
us
(code pays fourni par la source)