CPS: Medium: Smart Harvesting - Enhancing automated apple harvesting through apple harvesting through collaborative

CPS：中：智能收割 - 通过协作收割苹果，增强自动化苹果收割

• 批准号: 2312125
• 负责人: Ming Luo
• 金额: $ 120万
• 依托单位: Washington State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-10-01 至 2026-09-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2312125&HistoricalAwards=false
• 关键词: CPS; Medium; Smart; Harvesting; Enhancing

Automating perennial farming operations in tree fruit crops is crucial for improving farming effectiveness, efficiency, and crop yield. However, current automation technologies lack full autonomy and are inefficient in complex farm environments. To address these challenges, our project aims to develop a cyber-physical system called Smart Harvesting. This system, integrating human intelligence and machine learning, will enhance decision-making and actuation, improving picking efficiency and system autonomy. By integrating Smart Harvesting into the crop production feedback loop, we will enrich the system's repertoire and reduce uncertainties in crop production. Additionally, the research outcomes can benefit other labor-intensive orchard operations like flower thinning and pruning, which also face labor shortage issues. This multidisciplinary research initiative will provide valuable opportunities for graduate and undergraduate students, particularly those from Hispanic and Native-serving institutions. The final product, a collaborative human-machine system for apple harvesting, will have a notable impact on rural agricultural communities. Its widespread adoption will contribute significantly to sustaining the competitiveness of the US tree fruit industry.The project consists of three main areas of research. The first area focuses on creating a virtual reality orchard environment that is updated in real-time. This environment will use a network of sensors and a system called the Robotic Operation System that connects humans with machines. This will allow the control center to receive up-to-date 3D information about the orchard remotely. The second area aims to develop a collaborative framework where humans and machines work together effectively to harvest apples. This framework will utilize the virtual reality environment created in the first area. Human operators or machine learning techniques will be able to assist the robot system from a remote location. They can help the robot address challenges in apple picking, such as finding unidentifiable apples and determining the best way to retrieve them. The third area involves creating a constantly updating repertoire that incorporates information from human expertise and its own machine learning experience. It will record valuable information from human operators and its machine learning and use it to handle similar cases in the future autonomously. This repertoire will improve the performance of the apple harvesting robot, leading to better crop yield and quality.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

果树作物的多年生农业操作自动化对于提高农业效益、效率和作物产量至关重要。然而，目前的自动化技术缺乏完全的自主性，在复杂的农场环境中效率低下。为了应对这些挑战，我们的项目旨在开发一个名为“智能收获”的网络物理系统。该系统集成了人类智能和机器学习，将增强决策和驱动，提高采摘效率和系统自主性。通过将智能收获集成到作物生产反馈回路中，我们将丰富系统的曲目并减少作物生产中的不确定性。此外，研究成果也可以为其他劳动密集型的果园作业带来好处，如疏花和修剪，这些作业也面临劳动力短缺的问题。这项多学科研究计划将为研究生和本科生提供宝贵的机会，特别是那些来自西班牙裔和土著服务机构的学生。最终的产品是一个用于苹果收获的人机协作系统，将对农村农业社区产生显著影响。它的广泛采用将大大有助于维持美国果树产业的竞争力。该项目包括三个主要研究领域。第一个领域侧重于创建一个实时更新的虚拟现实果园环境。这个环境将使用一个传感器网络和一个称为机器人操作系统的系统，将人与机器连接起来。这将使控制中心能够远程接收有关果园的最新3D信息。第二个领域的目标是开发一个协作框架，让人类和机器有效地协同工作，收获苹果。这个框架将利用在第一个区域创建的虚拟现实环境。人类操作员或机器学习技术将能够从远程位置协助机器人系统。它们可以帮助机器人解决摘苹果的挑战，比如找到无法识别的苹果，并确定取回苹果的最佳方式。第三个领域涉及创建一个不断更新的曲目，其中包含来自人类专业知识和自己的机器学习经验的信息。它将记录来自人类操作员及其机器学习的有价值信息，并在未来自主处理类似案件。这将提高苹果收获机器人的性能，从而提高作物产量和质量。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。