Evaluating the language resources of chatbots for their potential in English as a second language
Evaluating the language resources of chatbots for their potential in English as a second language
复制标题
评估聊天机器人的语言资源作为第二语言的英语潜力
DOI：
10.1017/s0958344008000815
复制
发表时间：
2008
期刊：
影响因子：
4.5
通讯作者：
David Coniam
中科院分区：
文献类型：
--
作者：
David Coniam
摘要本文调查了当前的“聊天机器人”程序--试图用英语进行对话或互动的软件程序--的语言价值，作为它们作为ESL(英语作为第二语言)学习资源的潜力的先驱。在介绍了聊天机器人发展的一些初始背景，并讨论了Loebner奖最具人情味的聊天机器人竞赛(图灵测试)之后，本文描述了一项深入的研究，评估了一些在线聊天机器人的语言准确性。由于本研究的最终目的是关注聊天机器人对ESL学习者的潜力，因此对语言的分析不仅包括从本族语者的角度(图灵测试的重点)来考察语言的特征，而且也包括从第二语言使用者的角度来考察语言的各个方面。分析表明，虽然2005年Loebner奖的获得者在语言学上是最能干的聊天机器人，但它并不一定是最适合ESL学习者的聊天机器人。论文的结论是，虽然聊天机器人在语言处理方面已经取得了实质性的进展，但一个强大的ESL‘会话练习机器’(Atwell，1999)仍然距离成为现实还有一段路要走。
Abstract This paper investigates the linguistic worth of current ‘chatbot’ programs – software programs which attempt to hold a conversation, or interact, in English – as a precursor to their potential as an ESL (English as a second language) learning resource. After some initial background to the development of chatbots, and a discussion of the Loebner Prize Contest for the most ‘human’ chatbot (the ‘Turing Test’), the paper describes an in-depth study evaluating the linguistic accuracy of a number of chatbots available online. Since the ultimate purpose of the current study concerns chatbots' potential with ESL learners, the analysis of language embraces not only an examination of features of language from a native-speaker's perspective (the focus of the Turing Test), but also aspects of language from a second-language-user's perspective. Analyses indicate that while the winner of the 2005 Loebner Prize is the most able chatbot linguistically, it may not necessarily be the chatbot most suited to ESL learners. The paper concludes that while substantial progress has been made in terms of chatbots' language-handling, a robust ESL ‘conversation practice machine’ (Atwell, 1999) is still some way off being a reality.