Evaluating computational creativity : a standardised procedure for evaluating creative systems and its application
Evaluating computational creativity : a standardised procedure for evaluating creative systems and its application
复制标题
评估计算创造力：评估创意系统及其应用的标准化程序
DOI：
--
复制
发表时间：
2013
期刊：
影响因子：
--
通讯作者：
Anna K. Jordanous
中科院分区：
文献类型：
--
作者：
Anna K. Jordanous
本论文提出了一个创新系统评估的标准化程序。
在计算创造力领域，没有一种方法被接受为评估系统创造力的标准，创造力的多方面和主观性产生了大量的定义问题。评价实践普遍缺乏严谨性和系统性，阻碍了研究进展。
SPECS是一种标准化的、系统化的计算创造力评估方法。它具有足够的灵活性，可以适用于各种不同类型的创意系统，适应不同类型创意的具体需求。在三阶段的评估过程中，研究人员需要具体了解他们所从事的领域中的创造力，以及他们测试系统创造力的标准。为了帮助研究人员，定义的问题进行了调查，并提出了一套组件代表方面的创造力，这是经验得出的计算语言学分析。这些组成部分建议在SPECS中使用，作为创造力的一般定义提供，可以定制以说明给定领域中创造力的任何特定优先级。
SPECS应用在一个案例研究中，详细比较了三个音乐即兴创作系统的创造力，确定哪些系统比其他系统更有创造力，为什么。在第二个案例研究中，SPECS被用来捕捉在2011年计算创造力研究活动中提出的系统的创造力的初步印象。五个系统执行不同的创造性任务进行了比较和对比。
这些案例研究提供了关于系统的优点和缺点的宝贵信息。SPECS为研究人员提供了重要的反馈，以提高他们的系统的创造力，为计算创造力研究的进一步进展提供信息。
This thesis proposes SPECS: a Standardised Procedure for Evaluating Creative Systems.
No methodology has been accepted as standard for evaluating the creativity of a system in the field of computational creativity and the multi-faceted and subjective nature of creativity generates substantial definitional issues. Evaluative practice has developed a general lack of rigour and systematicity, hindering research progress.
SPECS is a standardised and systematic methodology for evaluating computational creativity. It is flexible enough to be applied to a variety of different types of creative system and adaptable to specific demands in different types of creativity. In the three-stage process of evaluation, researchers are required to be specific about what creativity entails in the domain they work in and what standards they test a system’s creativity by. To assist researchers, definitional issues are investigated and a set of components representing aspects of creativity is presented, which was empirically derived using computational linguistics analysis. These components are recommended for use within SPECS, being offered as a general definition of creativity that can be customised to account for any specific priorities for creativity in a given domain.
SPECS is applied in a case study for detailed comparisons of the creativity of three musical improvisation systems, identifying which systems are more creative than others and why. In a second case study, SPECS is used to capture initial impressions on the creativity of systems presented at a 2011 computational creativity research event. Five systems performing different creative tasks are compared and contrasted.
These case studies exemplify the valuable information that can be obtained on a system’s strengths and weaknesses. SPECS gives researchers vital feedback for improving their systems’ creativity, informing further progress in computational creativity research.