Expand QISE: Track 1: RLQSC: Reinforcement Learning for the Optimal Design of Programmable Quantum Sensor Circuit

非技术描述：该项目旨在创建和评估基于量子和经典强化学习的代理，用于可编程量子传感器电路的优化设计。这项研究项目所产生的技术将允许更好地测量物理世界，并具有广泛的应用，可以连接许多科学领域。该项目的成果将对精密量子增强计量测量系统产生积极影响，例如噪声中间尺度量子器件。该项目将为量子信息科学与工程（QISE）研究培训和专业发展提供丰富的机会。该项目团队将招募，激励和培训QISE研究方法的多样化和代表性不足的少数民族和女性学生。该项目将对K-16 QISE人才发展管道和克利夫兰市的劳动力发展产生积极影响，其中非洲裔美国人和西班牙裔等代表性不足的少数民族占人口的大多数。技术描述：量子传感是一项成熟的技术，在过去几十年中取得了显著的进展。未来的挑战是利用量子纠缠和叠加的潜在收益来实现下一代传感器，从而缩小当前性能与量子物理学设定的基本限制之间的差距。然而，生成纠缠量子比特的量子传感器电路的最佳设计是一项重要的任务，这促使人们考虑使用机器学习来辅助这种设计。目前的努力在很大程度上被限制在变分优化的几个参数系统对应的简单电路与几个元素。 为了推进最新技术水平，在本项目中，为可编程量子传感器开发了一种基于自学习的优化电路设计。具体目标是创建和评估基于量子和经典强化学习的代理，以设计深度电路。该方法利用动作和奖励的学习循环来生成具有最优性能的门序列，使用量子Fisher信息的度量作为量化奖励的手段。该方法涉及多个组件，如理想系统的演示，噪声和缺陷的评估，量子代理的扩展，以及对可编程量子传感器电路设计的经典和量子代理的性能评估。 用于评估研究方法成功与否的奖项包括灵敏度、动态范围、对耗散和退相干的鲁棒性以及速度。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Non-technical Description:The project aims to create and evaluate quantum and classical reinforcement learning-based agents for the optimal design of programmable quantum sensor circuit. The resulting technology from this research project will allow for better meters of the physical world with a breadth of applications that bridge many fields of science. The outcomes from this project will have a positive impact on the precision quantum-enhanced metrology measurements systems, such as the Noisy Intermediate Scale Quantum devices. The project will provide rich opportunities for Quantum Information Science and Engineering (QISE) research training and professional development. The project team will recruit, motivate, and train diverse and underrepresented minority and female students in QISE research methods. The project will have a positive impact on the K–16 QISE talent development pipeline and workforce development for the city of Cleveland, where underrepresented minorities such as African Americans and Hispanics constitute the majority of the population. Technical Description:Quantum sensing is a mature technology that has achieved remarkable progress over the past decades. The challenge going forward is to leverage potential gains from quantum entanglement and superposition to enable the next generation of sensors and thereby narrow the gap between the current performance and the fundamental limits set by quantum physics. However, the optimal design of a quantum sensor circuit that generates entangled qubits is a non-trivial task, which motivates the consideration of machine learning to assist with this design. Current efforts have in large part been limited to variational optimization of few parameter systems corresponding to simple circuits with few elements. To advance the state of the art, in this project, a reinforcement-learning-based optimal circuit design is developed for programmable quantum sensors. The specific objective is to create and evaluate quantum and classical reinforcement learning-based agents to design the deep circuit. The method utilizes a learning cycle of actions and rewards to generate the sequence of gates with optimal performance, using the measure of quantum Fisher information as a means to quantify the reward. The methodology involves multiple components such as demonstrations of the ideal system, evaluation of noise and imperfections, extensions to a quantum agent, and the performance evaluation of classical and quantum agents towards the design of the programmable quantum sensor circuit. Metrics used to evaluate the success of the research approach include sensitivity, dynamic range, robustness to dissipation and decoherence, and speed.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.