Complex Adaptive Systems as a Model for Network Evaluations (CASNET)

复杂自适应系统作为网络评估模型 (CASNET)

• 批准号: 1228868
• 负责人: Frances Lawrenz
• 金额: $ 79.99万
• 依托单位: University of Minnesota-Twin Cities
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2012
• 资助国家: 美国
• 起止时间: 2012-09-15 至 2016-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1228868&HistoricalAwards=false
• 关键词: Complex; Adaptive; Systems; Model; Network

Complexity theory as a theoretical framework for the evaluation of the Nanoscale Information Science Education Network (NISE Net) is the focus of this evaluation research project. The researchers include evaluation scholars at the University of Minnesota and research directors at the Science Museum of Minnesota, The Museum of Science in Boston, and the Oregon Museum of Science and Industry. The intent of the project is to study how complexity theory supports evaluation capacity building within the network of informal science organizations that makes up a national community of researchers and informal science educators whose goal is to improve public awareness of, engagement in and understanding of nanoscale science, engineering and technology. Components of complexity theory that are being studied include internal diversity and redundancy, the interactions among different individuals and organizations with the network, the extent to which the control of the network is distributed, the extent of a shared goal or identity operates throughout the system established by the network, and how the system responds to change in the external environment. This study employs a tiered case study of the way that primary actors within NISE Net are designing and implementing a new evaluation system to examine the programs that the institutions within the network are conducting. The first tier includes those individuals who are responsible for designing and implementing the resources used in the network to improve the public understanding of nanoscale science. The second tier are the individuals who use the resources developed by the network. The study utilizes a multiple case study methodology that examines individual cases that can be collected together to describe the operation of a complex network of individuals and organizations. NISE Net operates as a heterarchy whereby individuals are organized hierarchically within institutions and communicate horizontally across organizations. The case study methodology results in a framework of the evaluation efforts that will be studied iteratively using a design-based research approach to inform stakeholders and support changes in the framework as it evolves over the course of the study. Observations of the planning and implementation of evaluation efforts, document review and interviews with key stakeholders comprise the data collected and analyzed in this study.Complex evaluation efforts such as those being conducted by NISE Net require more than simple evaluation frameworks that examine inputs, activities, outputs and outcomes. Networks by their very nature are a system of stakeholders whose interactions quickly become complex and difficult to study. Complexity theory offers the conceptual organization by which complex systems can be studied and their evaluation efforts characterized. This project informs scholars in the evaluation field about models of evaluation that support examining the quality of work being conducted by complex systems such as NISE Net. The publications intended by this study have the potential to inform the evaluation community about how complexity theory can be brought to bear to study network systems in education.

复杂性理论作为纳米信息科学教育网(NISE网)评价的理论框架是本评价研究项目的重点。研究人员包括明尼苏达大学的评估学者以及明尼苏达科学博物馆、波士顿科学博物馆和俄勒冈科学与工业博物馆的研究主管。该项目的目的是研究复杂性理论如何支持非正式科学组织网络内的评价能力建设，非正式科学组织网络组成一个国家研究人员和非正式科学教育工作者社区，其目标是提高公众对纳米科学、工程和技术的认识、参与和理解。正在研究的复杂性理论的组成部分包括内部多样性和冗余性、不同个人和组织与网络之间的相互作用、网络控制的分布程度、共同目标或身份在整个网络建立的系统中运行的程度，以及系统如何对外部环境的变化做出反应。这项研究采用了一个分层次的案例研究，研究NISE网络内的主要行为者如何设计和实施一个新的评估系统，以审查该网络内的机构正在实施的方案。第一层包括负责设计和实施网络中使用的资源以提高公众对纳米科学的理解的个人。第二层是使用网络开发的资源的个人。这项研究使用了多案例研究方法，研究了可以收集在一起的个别案例，以描述由个人和组织组成的复杂网络的运作。NISE网络作为一种异类政体运作，个人在机构内按等级组织，并在各组织之间横向交流。案例研究方法形成了评价工作的框架，将使用基于设计的研究方法反复研究该框架，以便向利益攸关方通报情况，并支持框架在研究过程中的变化。本研究收集和分析的数据包括对评价工作的规划和实施情况的观察、文件审查和与关键利益攸关方的访谈。NISE网正在进行的复杂评价工作需要的不仅仅是审查投入、活动、产出和结果的简单评价框架。从本质上讲，网络是一个利益相关者系统，其相互作用很快就变得复杂和难以研究。复杂性理论提供了一种概念性的组织，通过这种组织可以研究复杂系统，并对其评估工作进行表征。该项目向评价领域的学者提供有关评价模型的信息，这些模型支持检查由NISE网等复杂系统进行的工作的质量。这项研究打算出版的出版物有可能让评估界了解如何利用复杂性理论来研究教育中的网络系统。