Utilizing Elaborated Situational Judgment Tests to Improve Selection, Enhance Training, and Facilitate Workplace Understanding and Cohesion

利用精心设计的情境判断测试来改进选择、加强培训并促进工作场所的理解和凝聚力

• 批准号: 2121275
• 负责人: Peter Harms
• 金额: $ 26.44万
• 依托单位: University of Alabama Tuscaloosa
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-09-01 至 2024-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2121275&HistoricalAwards=false
• 关键词: Utilizing; Elaborated; Situational; Judgment; Tests

Situational judgment tests (SJTs) are increasingly understood as a valuable tool for predicting organizational performance. However, many researchers have noted that they largely fail to represent the reasons certain actions are judged to be effective in organizational settings than others, or why respondents selected less effective actions. This project will focus on evaluating how elaborated situational judgment tests (ESJTs) – whereby respondents additionally rate the expected effects of responding in different ways to SJT scenarios – can address this limitation. Past work has detailed that ESJTs provide avenues for representing a person’s reasons for selecting different responses to job-relevant situations in the form of graphical causal models. This project will explore how ESJTs can be used to (a) represent how diverse populations (e.g., individuals of different age groups, genders, or ethnicities) understand particular workplace scenarios, (b) represent the role of situational factors in altering the effectiveness of specific organizational behaviors, and (c) provide opportunities for teaching more effective organizational behavior. By bringing these processes to light, EJSTs can be used to not only improve the validity of personnel selection systems and inform more effective workplace training procedures, but also to advance efforts to create a fairer and more inclusive work environment.In Project 1, ratings of the expected effects of different responses to organizational situations within a validated SJT will be collected from both working adults and subject matter experts. These ratings will be used to create new indices of the degree to which employees show an expert’s understanding of the effectiveness of different responses to job situations. These indices will be explored for their ability to predict organizational outcomes such as job performance and satisfaction beyond other valid predictors. In Project 2, a novel set of scenarios will be developed to detail how specific contextual factors (e.g., deadlines, relative organizational rank) alter the reasons for preferring one response to job-relevant situations over others. In Project 3, ESJT-based instruments will be explored as pedagogical tools that can supplement case studies in MBA and other professional programs for teaching effective decision-making, and for detailing how populations with different backgrounds and levels of experience come to perceive and process organizational situations differently. These can then be used to provide more concrete points for discussing how diverse groups come to understand “the same” organizational situations differently, and for teaching employees about the factors that make different responses to organizational situations more or less effective. The project will generate publicly available tools for creating and modeling data from elaborated situational judgment tasks, and for utilizing them effectively in both selection and job training contexts.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

情境判断测试（SJT）越来越被认为是预测组织绩效的一种有价值的工具。 然而，许多研究人员指出，他们在很大程度上未能代表的原因，某些行动被认为是有效的组织设置比其他人，或者为什么受访者选择不太有效的行动。本项目将重点评估如何精心制作的情景判断测试（ESJTs）-其中受访者还率在不同的方式响应SJT场景的预期效果-可以解决这一限制。 过去的工作已经详细说明，ESJTs提供的途径，代表一个人的原因，选择不同的反应，以图形因果模型的形式与工作相关的情况。 本项目将探讨如何使用ESJT来（a）代表不同的人群（例如，不同年龄组、性别或种族的个人）了解特定的工作场所场景，（B）代表情境因素在改变特定组织行为有效性方面的作用，以及（C）提供教授更有效组织行为的机会。通过将这些过程公之于众，EJST不仅可以用于提高人员选拔系统的有效性，并为更有效的工作场所培训程序提供信息，还可以促进创造更公平和更具包容性的工作环境的努力。在项目1中，将从工作成年人和主题专家那里收集对有效的SJT内组织情况的不同反应的预期效果的评级。 这些评级将被用来创建新的指数，衡量员工在多大程度上表现出专家对工作情况不同反应的有效性的理解。这些指数将探讨其预测组织成果的能力，如工作业绩和满意度超过其他有效的预测。在项目2中，将开发一组新的场景，以详细说明特定的上下文因素（例如，最后期限、相对的组织级别）改变了对与工作有关的情况选择一种反应而不选择其他反应的原因。 在项目3中，ESJT为基础的工具将被探索作为教学工具，可以补充MBA和其他专业课程的案例研究，以教授有效的决策，并详细说明不同背景和经验水平的人群如何以不同的方式感知和处理组织情况。然后，这些可以被用来提供更具体的点，讨论不同的群体如何来理解不同的“相同”的组织情况，并教导员工的因素，使不同的反应组织情况或多或少的有效性。该项目将产生公开可用的工具，用于从详细的情景判断任务中创建和建模数据，并在选拔和工作培训环境中有效地利用它们。该奖项反映了NSF的法定使命，并被认为值得通过使用基金会的智力价值和更广泛的影响审查标准进行评估来支持。

项目成果

Using field models and elaborated situational judgment tests to represent situational effects on psychological processes and behavior

使用现场模型和详细的情境判断测试来表示情境对心理过程和行为的影响

• DOI: 10.1016/j.cresp.2022.100068
• 发表时间: 2022
• 期刊: Current Research in Ecological and Social Psychology
• 作者: Wood, Dustin;Lowman, Graham H.;Harms, P.D.
• 通讯作者: Harms, P.D.

Using retest-adjusted correlations as indicators of the semantic similarity of items.

使用重新测试调整的相关性作为项目语义相似性的指标。

• DOI: 10.1037/pspp0000441
• 发表时间: 2023
• 期刊: Journal of Personality and Social Psychology
• 影响因子: 7.6
• 作者: Wood, Dustin;Lowman, Graham H.;Armstrong, Benjamin F.;Harms, P. D.
• 通讯作者: Harms, P. D.