Comparing the performance of ChatGPT and state-of-the-art climate NLP models on climate-related text classification tasks
Comparing the performance of ChatGPT and state-of-the-art climate NLP models on climate-related text classification tasks
复制标题
比较 ChatGPT 和最先进的气候 NLP 模型在气候相关文本分类任务上的性能
DOI:
10.1051/e3sconf/202343602004
复制
发表时间:
2023
影响因子:
--
通讯作者:
Vodenska, Irena
中科院分区:
文献类型:
--
作者:
Trajanov, Dimitar;Lazarev, Gorgi;Chitkushev, Ljubomir;Vodenska, Irena
Recently, there has been a surge in general-purpose language models, with ChatGPT being the most advanced model to date. These models are primarily used for generating text in response to user prompts on various topics. It needs to be validated how accurate and relevant the generated text from ChatGPT is on the specific topics, as it is designed for general conversation and not for context-specific purposes. This study explores how ChatGPT, as a general-purpose model, performs in the context of a real-world challenge such as climate change compared to ClimateBert, a state-of-the-art language model specifically trained on climate-related data from various sources, including texts, news, and papers. ClimateBert is fine-tuned on five different NLP classification tasks, making it a valuable benchmark for comparison with the ChatGPT on various NLP tasks. The main results show that for climate-specific NLP tasks, ClimateBert outperforms ChatGPT.
DOI:
--
发表时间:
2003
期刊:
Annual Review of the Philosophical Association of Western Japan No.11
影响因子:
--
作者:
高橋隆雄(編著);入不二 基義;谷 隆一郎;Irifuji Motoyoshi;高橋隆雄(編著);Irifuji Motoyoshi
通讯作者:
Irifuji Motoyoshi