PoseBlocks: A Toolkit for Creating (and Dancing) with AI
PoseBlocks: A Toolkit for Creating (and Dancing) with AI
复制标题
PoseBlocks：利用 AI 进行创作（和舞蹈）的工具包
DOI：
10.1609/aaai.v35i17.17831
复制
发表时间：
2021
期刊：
影响因子：
3.7
通讯作者：
C. Breazeal
中科院分区：
文献类型：
--
作者：
Brian Jordan;Nisha Devasia;Jenna Hong;Randi Williams;C. Breazeal
身体跟踪人工智能（AI）系统，如Kinect游戏，Snapchat增强现实（AR）镜头和Instagram AR滤镜是学生在日常生活中体验AI的最吸引人的方式。此外，许多学生对体育和舞蹈等体育爱好感兴趣。在本文中，我们介绍了PoseBlocks;一套基于块的编程工具，使学生能够在任何Web浏览器中构建引人注目的身体交互式AI项目，集成相机/麦克风输入和身体感知用户交互。为了实现这一目标，我们提供了一个基于开源Scratch项目的自定义块编程环境，引入了新的AI模型驱动的块，支持身体，手部和面部跟踪，情感识别，以及从在线迁移学习工具Teachable Machine集成自定义图像/姿势/音频模型的能力。我们介绍了编辑器功能，如项目录像机，预先计算的视频循环，并与课程材料的集成。我们讨论了部署这个工具包，在一系列同步在线试点与46名学生，9-14岁的伴随课程。在分析课堂项目和讨论时，我们发现学生们学会了在自己设计的项目中设计、训练和集成机器学习模型，同时探索交互式人工智能系统中的利益相关者价值观和算法偏见等道德考虑因素。
Body-tracking artificial intelligence (AI) systems like Kinect games, Snapchat Augmented Reality (AR) Lenses, and Instagram AR Filters are some of the most engaging ways students experience AI in their everyday lives. Additionally, many students have existing interests in physical hobbies like sports and dance. In this paper, we present PoseBlocks; a suite of block-based programming tools which enable students to build compelling body-interactive AI projects in any web browser, integrating camera/microphone inputs and body-sensing user interactions. To accomplish this, we provide a custom block-based programming environment building on the open source Scratch project, introducing new AI-model-powered blocks supporting body, hand, and face tracking, emotion recognition, and the ability to integrate custom image/pose/audio models from the online transfer learning tool Teachable Machine. We introduce editor functionality such as a project video recorder, pre-computed video loops, and integration with curriculum materials. We discuss deploying this toolkit with an accompanying curriculum in a series of synchronous online pilots with 46 students, aged 9-14. In analyzing class projects and discussions, we find that students learned to design, train, and integrate machine learning models in projects of their own devising while exploring ethical considerations such as stakeholder values and algorithmic bias in their interactive AI systems.
展望 K-12 的人工智能：每个孩子都应该了解哪些关于人工智能的知识？
DOI：
10.1609/aaai.v33i01.33019795
发表时间：
2019
期刊：
Proceedings of the AAAI Conference on Artificial Intelligence
影响因子：
--
作者：
Touretzky, David;Gardner-McCune, Christina;Martin, Fred;Seehorn, Deborah
通讯作者：
Seehorn, Deborah