Critiki: A Scaffolded Approach to Gathering Design Feedback from Paid Crowdworkers
Critiki: A Scaffolded Approach to Gathering Design Feedback from Paid Crowdworkers
复制标题
Critiki：一种收集付费众包设计反馈的脚手架方法
DOI：
10.1145/2757226.2757249
复制
发表时间：
2015
期刊：
影响因子：
--
通讯作者：
E. Gerber
中科院分区：
文献类型：
--
作者：
M. Greenberg;Matthew W. Easterday;E. Gerber
反馈对创造过程很重要，但并不是每个人都有一群人可以向他们寻求高质量的反馈。我们介绍并评估Critiki，这是一个新颖的系统，用于收集付费众筹项目页面上的设计评论。基于之前对众筹项目创建者的研究以及他们对早期设计反馈的需求，我们设计并构建了一个适合这一人群需求的工作系统：快速且廉价的反馈。为了解决评论质量的问题，我们描述了一种脚手架技术，旨在帮助群众工作者撰写高质量的评论。我们通过两个现场部署来评估Critiki：1）与450名众筹工作者进行的随机对照实验，以评估脚手架技术的有效性; 2）与31名众筹项目创建者进行的用户研究，以确定可用性和用户满意度。我们通过展示一个有效的创造力支持系统，对该系统进行经验评估，并描述如何为其他众包任务设计脚手架方法，从而为创造力和认知研究做出贡献
Feedback is important to the creative process, but not everyone has a personal crowd of individuals they can turn to for high-quality feedback. We introduce and evaluate Critiki, a novel system for gathering design critiques on crowdfunding project pages from paid crowdworkers. Stemming from previous research on crowdfunding project creators and their need for early-stage design feedback, we design and build a working system which fits the need of this population: rapid and inexpensive feedback. To solve issues with critique quality we describe a scaffolding technique designed to assist crowdworkers in writing high-quality critiques. We evaluate Critiki with two field deployments: 1) A randomized controlled experiment with 450 crowdworkers to evaluate the efficacy of the scaffolding technique and 2) A user study with 31 crowdfunding project creators to determine usability and user satisfaction. We contribute to research on Creativity and Cognition by demonstrating a working creativity support system, empirically evaluating the system, and describing how scaffolding approaches can be designed for other crowdsourced tasks