Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Training

Yuchen Zhuang, Jingfeng Yang, Haoming Jiang, Xin Liu, Kewei Cheng, Sanket Lokegaonkar, Yifan Gao, Qing Ping, Tianyi Liu, Binxuan Huang, Zheng Li, Zhengyang Wang, Pei (Patrick) Chen, Ruijie Wang, Rongzhi Zhang, Nasser Zalmout, Priyanka Nigam, Bing Yin, Chao Zhang

April 2025

Type

Conference paper

Publication

Proceedings of the 2025 Conference of the North American Chapter of the Association for Computational Linguistics

Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Training

Pei (Patrick) Chen

Applied Scientist at Amazon