López López, Álvaro Jesús Portela González, José 2025-07-10T14:25:38Z 2025-07-10T14:25:38Z 2025-01-01 0924-669X https:doi.org10.1007s10489-024-05901-4 http://hdl.handle.net/11531/100591 Artículos en revistas Transformer-based language models, including ChatGPT, have demonstrated exceptional performance in various natural language generation tasks. However, there has been limited research evaluating ChatGPT’s keyphrase generation ability, which involves identifying informative phrases that accurately reflect a document’s content. This study seeks to address this gap by comparing ChatGPT’s keyphrase generation performance with state-of-the-art models, while also testing its potential as a solution for two significant challenges in the field: domain adaptation and keyphrase generation from long documents. We conducted experiments on eight publicly available datasets spanning scientific, news, and biomedical domains, analyzing performance across both short and long documents. Our results show that ChatGPT outperforms current state-of-the-art models in all tested datasets and environments, generating high-quality keyphrases that adapt well to diverse domains and document lengths. application/octet-stream en-GB Revista: Applied Intelligence, Periodo: 1, Volumen: online, Número: 1, Página inicial: 50-1, Página final: 50-25 Instituto de Investigación Tecnológica (IIT) ChatGPT vs state-of-the-art models: a benchmarking study in keyphrase generation task info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion info:eu-repo/semantics/openAccess ChatGPT · Text generation · Keyphrase generation · Natural language processing · Deep learning · Domain adaptation · Long documents · Large language models