Scholarly Influence of the Conference and Labs of the Evaluation Forum eHealth Initiative: Review and Bibliometric Study of the 2012 to 2017 Outcomes.
Scholarly Influence of the Conference and Labs of the Evaluation Forum eHealth Initiative: Review and Bibliometric Study of the 2012 to 2017 Outcomes.
复制标题
DOI：
10.2196/10961
复制
发表时间：
2018-07-27
影响因子：
1.7
通讯作者：
Goeuriot L
中科院分区：
文献类型：
--
作者：
Suominen H;Kelly L;Goeuriot L
自2012年以来，评估论坛会议和实验室（CLEF）的电子健康倡议旨在为从事健康文本分析的研究人员提供年度研讨会，共享发展挑战和任务，基准数据集以及处理和评估软件。2012年，它作为一个科学研讨会运行，目的是建立一个评估实验室，自2013年以来，这个年度研讨会每年都有3个或更多的先前实验室补充。评估实验室是一种活动，参与的个人或团队的目标是解决相同的问题，通常在给定的时间范围内使用相同的数据集。该计划的总体目的是支持患者，他们的近亲，临床工作人员，健康科学家和卫生保健政策制定者在多语言环境中访问，理解，使用和创作健康信息。在CLEF eHealth 2013年至2017年的安装中，目标是解决以患者为中心的文本处理。从2015年起，范围也扩大到帮助患者理解和临床医生创作各种类型的医疗内容。CLEF eHealth 2017推出了一项关于经验医学技术辅助审查（TARs）的新试点任务，以支持卫生科学家和卫生保健政策制定者的信息获取。这份原始研究报告报告了2012年至2017年CLEF电子健康的前6次安装的结果。重点是通过回顾CLEF电子健康论文及其引用来衡量和分析学术影响力。对CLEF电子健康会议记录、工作说明和作者声明的论文扩展进行了审查和文献计量研究。引文内容分析用于从Google Scholar收集的出版物及其引文。多达718个团队登记了他们对这些任务的兴趣，导致130个团队提交了15个任务。共有184篇论文使用CLEF eHealth数据产生了1299次引用，为741位合著者产生了近963，000次引用的总学术引用影响力，其中包括来自世界各地33个国家的作者。8项任务通过前3种方法中的至少1种方法在处理质量方面产生了统计学显著性改善（分别为2、3和3倍，P<0.001，P= 0.009和P= 0.04）。这些大量的参与人数，大量的引用数量和显着的性能改进鼓励继续开发这些技术，以满足患者的需求。因此，数据和工具已开放供未来研究和开发，CLEF电子保健倡议继续面临新的挑战。
The eHealth initiative of the Conference and Labs of the Evaluation Forum (CLEF) has aimed since 2012 to provide researchers working on health text analytics with annual workshops, shared development challenges and tasks, benchmark datasets, and software for processing and evaluation. In 2012, it ran as a scientific workshop with the aim of establishing an evaluation lab, and since 2013, this annual workshop has been supplemented with 3 or more preceding labs each year. An evaluation lab is an activity where the participating individuals or teams’ goal is to solve the same problem, typically using the same dataset in a given time frame. The overall purpose of this initiative is to support patients, their next of kin, clinical staff, health scientists, and health care policy makers in accessing, understanding, using, and authoring health information in a multilingual setting. In the CLEF eHealth 2013 to 2017 installations, the aim was to address patient-centric text processing. From 2015, the scope was also extended to aid both patients’ understanding and clinicians’ authoring of various types of medical content. CLEF eHealth 2017 introduced a new pilot task on technology-assisted reviews (TARs) in empirical medicine in order to support health scientists and health care policymakers’ information access. This original research paper reports on the outcomes of the first 6 installations of CLEF eHealth from 2012 to 2017. The focus is on measuring and analyzing the scholarly influence by reviewing CLEF eHealth papers and their citations. A review and bibliometric study of the CLEF eHealth proceedings, working notes, and author-declared paper extensions were conducted. Citation content analysis was used for the publications and their citations collected from Google Scholar. As many as 718 teams registered their interest in the tasks, leading to 130 teams submitting to the 15 tasks. A total of 184 papers using CLEF eHealth data generated 1299 citations, yielding a total scholarly citation influence of almost 963,000 citations for the 741 coauthors, and included authors from 33 countries across the world. Eight tasks produced statistically significant improvements (2, 3, and 3 times with P<.001, P=.009, and P=.04, respectively) in processing quality by at least 1 out of the top 3 methods. These substantial participation numbers, large citation counts, and significant performance improvements encourage continuing to develop these technologies to address patient needs. Consequently, data and tools have been opened for future research and development, and the CLEF eHealth initiative continues to run new challenges.