NFeedback - improving online learning outcomes

NFeedback将使用人工智能，特别是自然语言处理(NLP)、计算机视觉(CV)和知识图谱(KG)为笔记Express目前的数字课堂解决方案创建实时和离线反馈。在在线教学环境中，与传统课堂教学相比，许多互动都被遗漏了，比如参与者数量、学生的面部情绪、肢体语言等。这些人工智能服务将提供关于非语言情绪和信号的有价值的信息。然后，基于每个用户的个人资料，可以为教师和学生生成自动反馈，以及建议的改进和支持。KG(有时也称为本体)是一种从结构上描述概念和概念之间关系的技术，以便人工智能系统可以发现数据模式并在数据中建立联系。这一推理过程向高校管理人员、教师和学生提供反馈。可及性是反馈的重要组成部分，以考虑学习方式的多样性。例如，如果是在线讲座，聋人学生可能需要打开隐藏字幕，而视障学生可能需要文本到语音阅读屏幕上的文本或图像描述。在更细微的层面上，我们将构建一些工作包来收集有关讲座的更多信息，并将其提供给KG，这样我们的人工智能解决方案就可以决定需要向学校管理人员、讲师和学生反馈什么。我们将与南安普顿大学(UoS)合作，从开放数据集(例如南安普顿开放数据服务)以及其他客户当前的课程管理系统(如Blackboard或Moodle.)中获取数据。由此，我们可以进一步增强NLP和CV模块，以准备自动反馈所需的数据。目前的解决方案，如Zoom和Microsoft Teams，很难在混合(在线/离线)教学环境中使用，主要是为会议设计的。Blackboard Collaboration已被广泛用于在线教学，但软件的成本以及设置和用户界面的复杂性一直是许多用户感到沮丧的原因。从根本上说，这些解决方案缺乏对不同神经的学习者的可及性，也缺乏任何形式的个性化反馈。因此，NFeedback将被设计为一种简单易用的基于云的互动软件服务，它可以安全地为所有学生捕获讲座，包括学生的反馈内容和可访问性工具。社交距离和新技术的实施很可能会大幅增加高等院校的管理费用，因为它们寻求实施新冠肺炎缓解措施。NFeedback正在寻求通过为具有不同背景和学习偏好的学生提供人工智能支持的评估和反馈系统来直接解决这一问题，并至少部分重建课堂和校园课程以负担得起的价格提供的参与和学习体验部分。

NFeedback will use AI, especially Natural Language Processing (NLP), Computer Vision (CV) and Knowledge Graphs (KG) to create both live and offline feedback for Note Taking Express's current digital classroom solution. In an online teaching environment, many interactions are missed compared with traditional classroom teaching, such as the number of attendees, students' facial emotions, body language etc. These AI services will provide valuable information on non-verbal emotions and signals. Then based on each user's profile, automatic feedback can be generated for teachers and students, together with suggested improvements and support.KG (sometimes also referred to as Ontology) is a technology which structurally describes the concepts and relations between concepts, so that AI systems can spot patterns of data and give connections within the data. This reasoning process offers feedback to HEI administrators, teachers and students. Accessibility is an important component of the feedback to consider diversity of learning styles. If it's an online lecture, for example, a deaf student may require Closed Captioning turned on whereas a visually impaired student may need text to speech to read out text on the screen or description of images.At a more granular level we will be structuring a number of work packages to collect more information about the lecture to feed into the KG, so that our AI solution can decide what needs to be feedback to school admins, lecturers and students. We will be collaborating with University of Southampton (UoS) to obtain the data from open datasets (Southampton Open Data Service, for example), and other clients current course management systems, such as BlackBoard or Moodle.Following the above, we will use lecture audio/video content recorded from our existing digital classroom solution and generate a semi-structured data store for further analysis. From this we can further enhance the NLP and CV modules to prepare data that is needed for automatic feedback.Current solutions, such as Zoom and Microsoft Teams are difficult to use in a blended (online/offline) teaching environment and designed mainly for meetings and conferences. BlackBoard Collaborate has been widely used for online teaching, however the cost of the software and the complexity of both the setup and UI have been a cause of frustration for many users. Fundamentally these solutions lack accessibility for neurodiverse learners and any form of personalised feedback. NFeedback will therefore be designed as a simple to use interactive cloud-based software service, which captures lectures securely for all students, including feedback content for students and accessibility tools.It is likely that the implementation of social distancing and new technology will increase overheads significantly for HEIs as they seek to put in place COVID-19 mitigation measures. NFeedback is seeking to solve this problem directly by providing AI supported assessment and feedback systems for students with different backgrounds and learning preferences and to recreate, at least in part, the engagement and experiential component of learning which in-class and on campus courses deliver at an affordable price point.