A framework to evaluate and establish trust in generative AI, in learning and development (L&D) applications

评估和建立对生成人工智能、学习和发展信任的框架（L

• 批准号: 10072234
• 金额: $ 6.23万
• 依托单位: AI FOR GLOBAL GOALS LTD
• 依托单位国家: 英国
• 项目类别: Grant for R&D
• 财政年份: 2023
• 资助国家: 英国
• 起止时间: 2023 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=10072234
• 关键词: framework; evaluate; establish; trust; generative

Today, large generative models can take simple instructions from their users and generate artefacts such as code, text, images and videos that until recently, could only be produced by humans. The success of products that rely on such models, however, requires their users/stakeholders to trust them. This is particularly important in domains such as education, finance, and medicine where the stakes are high.We are building Elandi, a product that uses the power of the latest developments in AI (particularly, generative AI) to bring affordable personalised L&D to everyone:1. Elandi will compare a user's profile/resume with their career goals (e.g., a job description) and identify the gaps.2. Using this gap (plus various user preferences, and more), it generates a prompt for the generative AI.3. The generative AI will then provide the user with the right L&D content.The UX areas we are currently exploring are course planning, bite-sized tutoring, assessment, and content generation.Thanks to our successful courses since 2020, we now have a unique user community (1000s of AI talents from 100+ countries) that can the source of data and advice. Furthermore, we worked with top AI professors/lecturers, and some of the world's largest corporations in real-world AI applications. All these helped us make tremendous progress towards Elandi's product-market fit (PMF); from discovery, to conceptual design and ML prototypes. Overall, the most important learning from our discovery is that fit-for-purpose content, improved UX, personalised recommendation, and expert mentoring are in high demand.While this progress continues, we realised that there is an urgent need for a comprehensive framework for AI assurance (e.g., auditing the AI, measuring users' trust in it, and quantifying its various risks) in the L&D space. Therefore, as part of our broader ambition, through this grant we would like to kickstart an explicit work stream on this topic. Our goal is to build on the latest research (including metrics and measurements) on trustworthy AI, to provide the tools and frameworks necessary for auditing AI models and products in the L&D space. While we will be focused on the L&D use cases, we expect our results to have implications beyond L&D and in other domains..An improved L&D offering will be of profound societal and commercial value; it will play a critical role in improving national and international productivity. It is aligned with strategic government initiatives such as "Levelling up", "Lifelong Learning", and "Skills for Life".

今天，大型生成模型可以从用户那里获得简单的指令，并生成代码、文本、图像和视频等人工制品，直到最近，这些都只能由人类生产。然而，依赖于这些模型的产品的成功，需要它们的用户/利益相关者信任它们。这在教育、金融和医药等领域尤其重要，因为这些领域的风险很高。我们正在打造Elandi，这款产品利用人工智能（尤其是生成式人工智能）最新发展的力量，为每个人带来负担得起的个性化学习与发展。Elandi会将用户的个人资料/简历与他们的职业目标（例如，职位描述）进行比较，并找出差距。使用这个间隙（加上各种用户偏好等），它为生成式ai生成一个提示符。生成式AI将为用户提供正确的L&D内容。我们目前正在探索的用户体验领域包括课程规划、小规模辅导、评估和内容生成。得益于我们自2020年以来的成功课程，我们现在拥有一个独特的用户社区（来自100多个国家的1000名AI人才），可以提供数据和建议。此外，我们还与顶尖的人工智能教授/讲师以及一些世界上最大的人工智能应用公司合作。所有这些都帮助我们在Elandi的产品市场契合（PMF）方面取得了巨大进展；从发现到概念设计和机器学习原型。总的来说，从我们的发现中最重要的学习是，适合目的的内容、改进的用户体验、个性化推荐和专家指导的需求很大。随着这一进展的继续，我们意识到在L&D领域迫切需要一个全面的人工智能保证框架（例如，审计人工智能，测量用户对它的信任，量化它的各种风险）。因此，作为我们更广泛目标的一部分，我们希望通过这笔赠款启动关于这一主题的明确工作流程。我们的目标是建立在可信赖的人工智能的最新研究（包括指标和测量）的基础上，为审核L&D领域的人工智能模型和产品提供必要的工具和框架。虽然我们将专注于L&D用例，但我们希望我们的结果能对L&D和其他领域产生影响。改进的L&D产品将具有深远的社会和商业价值；它将在提高国家和国际生产力方面发挥关键作用。它与政府的战略举措相一致，如“提升水平”、“终身学习”和“终身技能”。