EAGER: Metrics to Evaluate Customer Preference Models for use in Engineering Design Optimization

EAGER：评估用于工程设计优化的客户偏好模型的指标

• 批准号: 1630096
• 负责人: Kate Whitefoot
• 金额: $ 23.53万
• 依托单位: Carnegie-Mellon University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-08-01 至 2019-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1630096&HistoricalAwards=false
• 关键词: EAGER; Metrics; Evaluate; Customer; Preference

Engineers have begun to use customer preference models developed in marketing, economics, and psychology to design products that better meet customer desires. While such models are adequate for marketing purposes, they often introduce significant errors when used as-is in an engineering design context. Despite the prevalent use of customer preference models by many engineering researchers, the field does not have adequate methods for evaluating the accuracy or appropriateness of demand models for use in this context. This EArly-concept Grant for Exploratory Research (EAGER) award provides support for fundamental research to develop metrics and a test procedure to evaluate various errors associated with customer preference models that can mislead engineering designers. Results will allow engineering designers to construct demand models using estimation methods that minimize errors in design selection and optimization. The metrics developed through this work will also allow practitioners to evaluate demand models and select the most appropriate model for their design problem. In addition, several education and dissemination activities will be conducted to improve student learning of model evaluation techniques and facilitate use of the evaluation methods by federal agencies that employ demand models to inform their funding and regulation of technology development in the transportation sector.The research objectives are to produce (1) engineering-design specific metrics that will evaluate the estimation biases associated with demand models, (2) a demonstration of the significance of demand-model estimation biases on optimal design variable selection, and (3) identification of one or more demand estimation methods that reduce biases affecting design selection and optimization. The research will draw upon discrete choice analysis and econometric estimation to identify metrics and estimation methods that are appropriate for engineering design. Estimation biases of two types of parameters that affect demand gradients with respect to engineering design variables -- customer preference coefficients and aggregate demand estimates -- will be examined. Multiple metrics will be tested to compare demand-model predictions with synthetic customer purchase data in which biases between the estimates and true parameters are known. Several different demand estimation methods proposed in econometrics will be evaluated using the identified metric(s). Finally, an optimization case study will be used to illustrate the influence of demand model biases on optimal design variables by comparing results using the identified estimation method that reduces parameter biases with one that does not.

工程师们已经开始使用在市场营销、经济学和心理学中开发的客户偏好模型来设计更好地满足客户需求的产品。虽然这些模型足以用于营销目的，但当在工程设计环境中按原样使用时，它们通常会引入重大错误。尽管许多工程研究人员普遍使用的客户偏好模型，该领域没有足够的方法来评估在这种情况下使用的需求模型的准确性或适当性。EARLY概念探索性研究奖（EAGER）为基础研究提供支持，以开发指标和测试程序，以评估与可能误导工程设计师的客户偏好模型相关的各种错误。结果将允许工程设计人员使用估计方法来构建需求模型，以最大限度地减少设计选择和优化中的错误。通过这项工作开发的指标也将允许从业者评估需求模型，并选择最合适的模型，为他们的设计问题。此外，为了提高学生对模型评估技术的学习，并促进使用需求模型的联邦机构对评估方法的使用，将开展一些教育和传播活动。研究目标是：（1）制定工程设计专用指标，以评估与需求模型相关的估计偏差;（2）证明需求模型估计偏差对最优设计变量选择的重要性，以及（3）识别一种或多种需求估计方法，其减少影响设计选择和优化的偏差。研究将利用离散选择分析和计量经济学估计，以确定适合工程设计的度量和估计方法。两种类型的参数，影响需求梯度相对于工程设计变量的估计偏差-客户偏好系数和总需求估计-将被检查。将测试多个指标，以比较需求模型预测与合成客户购买数据，其中估计值和真实参数之间的偏差是已知的。计量经济学中提出的几种不同的需求估计方法将使用确定的度量进行评估。最后，一个优化案例研究将被用来说明需求模型偏差对最优设计变量的影响，通过比较使用确定的估计方法，减少参数偏差与一个不。