Yuhang Lai, Jiazhan Feng, Yee Whye Teh, Ning Miao
Large Language Models (LLMs) demonstrate strong capabilities for solving scientific and mathematical problems, yet they struggle to produce valid, challenging, and novel problems…
cs.LGcs.AIcs.CL
Yuxing Liu, Jianyu Wang, Tong Zhang
Optimizers play an important role in both pretraining and finetuning stages when training large language models (LLMs). In this paper, we present an observation that full…
cs.LGcs.AImath.OC
Sushant Gautam, Finn Schwall, Annika Willoch Olstad, Fernando Vallecillos Ruiz, Birk Torpmann-Hagen, Sunniva Maria Stordal Bjørklund, Leon Moonen, Klas Pettersen, Michael A. Riegler
Many deployments must compare candidate language models for safety before a labeled benchmark exists for the relevant language, sector, or regulatory regime. We formalize this…
cs.LGcs.AIcs.CL
Xiangyuan Xue, Yifan Zhou, Zidong Wang, Shengji Tang, Philip Torr, Wanli Ouyang, Lei Bai, Zhenfei Yin
Large language models (LLMs) are increasingly used as interactive agents, but optimizing them for long-horizon decision making remains difficult because current methods are…
cs.CLcs.AI
Jai Moondra, Ayela Chughtai, Bhargavi Lanka, Swati Gupta
Ranking LLMs via pairwise human feedback underpins current leaderboards for open-ended tasks, such as creative writing and problem-solving. We analyze ~89K comparisons in 116…
cs.LGcs.DMcs.ETmath.OC
Ryan Wang, Akshita Bhagia, Sewon Min
Large language models are typically deployed as monolithic systems, requiring the full model even when applications need only a narrow subset of capabilities, e.g., code, math, or…
cs.CL
Su Zhang, Junfeng Guo, Heng Huang
Watermark radioactivity testing type of methods can detect whether a model was trained on watermarked documents, and have become key tools for protecting data ownership in the…
cs.CRcs.LG
Murat Bilgehan Ertan, Xiaochen Zhu, Phuong Ha Nguyen, Marten van Dijk, Srinivas Devadas
We introduce PACZero, a family of PAC-private zeroth-order mechanisms for fine-tuning large language models that delivers usable utility at $I(S^*; Y_{1:T})=0$. This privacy…
cs.LGcs.AIcs.CR
Mohammad Mamun, Mohamed Gaber, Scott Buffett, Sherif Saad
Language Model Agents (LMAs) are emerging as a powerful primitive for augmenting red-team operations. They can support attack planning, adversary emulation, and the orchestration…
cs.CR
Zeyuan Chen, Yihan Ma, Xinyue Shen, Michael Backes, Yang Zhang
Large language models (LLMs) show strong performance across many applications, but their ability to memorize and potentially reveal training data raises serious privacy concerns.…
cs.CR
Amir Ivry
Large audio language models (LALMs) are increasingly used to reason over long audio clips, yet deployment often compresses audio before inference to reduce memory and latency. The…
eess.AS