Scaling the Peer Review Process for National Stem Education Digital Library Collections

STEM数字图书馆以及NSDL本身的主要目标之一是使用户能够从广泛的收藏中识别潜在有用的数字学习材料和信息。STEM数字图书馆的教师、教师和学生用户经常从搜索查询中获得大量结果，然后他们面临着仅搜索那些为其教育目的服务的结果的挑战。STEM本科生教育工作者期望并需要数字图书馆为他们提供信息和工具，以评估学习材料的内容质量、潜在的教与学效果、可用性和稳定性，以及这些材料对其教育需求的适应性。如何最好地开发、实施和扩大有效、高效和可靠的同行评议系统，这是困扰着成熟和新兴的STEM数字图书馆的问题。复习的内容(期刊文章和学习材料)和材料的目的(促进知识和促进学习)的差异加剧了这种情况。影响数字图书馆同行审查进程的另一个因素来自用户。在他们看来，同行评议的最终目的是帮助他们选择学习材料。在这种情况下，他们对推进特定领域的知识或帮助作者改进文章(在线期刊同行评议的目的)不感兴趣。有效的系统需要STEM数字馆藏花费大量资源来招募、培训和支持大量评审员，这些评审员通过应用一套标准来评估材料，这些评审员需要技术与教育学、认知科学和内容相结合的专业知识。该项目与其合作伙伴、需求(工程教育数字图书馆和Hear)健康教育访问图书馆合作，正在开发一种解决方案，以解决与实施和扩展NSDL馆藏同行评审系统相关的问题，即与面对面培训、留住评审员相关的高成本，以及评审员无法跟上迅速增长的馆藏规模。这项工作建立在梅洛同行审查进程的基础上。为了鼓励其他NSDL集合的适应性，有一个可适应的在线专业开发流程，用于实施同行评审和高级评审，该流程被设计为可适应框架uPortal(由NSDL-Core集成开发团队选择创建初始NSDL主门户的软件)的渠道。这一合作项目的主要成果是培训同行评审员的专业发展模块，为NSDL收藏(和其他)设计，以有效和高效地实施和维持对其收藏的同行审查。可调整的模块、培训和指导过程为NSDL收藏者在实施有效和可靠的同行审查过程中节省了大量时间、精力和资金。

One of the primary goals of STEM digital libraries, as well as the NSDL itself, is to enable users to identify potentially useful digital learning materials and information from a wide range of collections. Faculty, instructors and student users of STEM digital libraries are often presented with numerous results from a search query where they then face the challenge of searching for only those that serve their educational purposes. STEM undergraduate educators expect and need digital libraries to provide them with the information and tools to evaluate the quality of content of learning materials, their potential efficacy in teaching and learning, their usability and stability, and the adaptability of these materials for their educational needs.How best to develop, implement and scale up effective, efficient and reliable peer review systems plagues both mature and newly developing STEM digital libraries. Differences in what is reviewed (journal articles vs. learning materials) and the purpose of the materials (advancing knowledge vs. promoting learning) help compound the situation. Another factor affecting peer review processes for digital libraries stems from users. From their standpoint, the ultimate goal of peer review is to help them select the learning materials. In this case, they are not interested in advancing knowledge in a particular field or helping authors improve their articles (the purpose of peer review for online journals). Effective systems require STEM digital collections to expend significant resources to recruit, train and support large numbers of reviewers who evaluate materials by applying a set of criteria that requires expertise in the integration of technology with pedagogy, cognitive science and content.In collaboration with its partners, NEEDS (a Digital Library for Engineering Education, and HEAL) the Health Education Access Library, this project is developing one solution to the problems associated with implementing and scaling peer review systems for NSDL collections, namely, the high costs associated with face-to-face training, retention of reviewers, and the inability of reviewers to keep pace with the rapidly increasing size of the collections. This work builds on the foundation of the MERLOT peer review process. To encourage adaptability by other NSDL collections there is an adaptable online professional development processes for implementing both peer and Premier reviews that is designed as a channel adaptable to the framework uPortal (the software selected by the NSDL-Core Integration development team to create the initial NSDL Main Portal). The main outcome of this collaborative project is a professional development module for training peer reviewers, designed for NSDL collections (and others) to effectively and efficiently implement and sustain peer review of their collections. The adaptable module, training and mentoring processes save NSDL collections significant time, effort and funds in their implementation of valid and reliable peer review processes.