III: Medium: Collaborative Research: Frankencamera - an open-source Camera for Research and Teaching in Computational Photography

III：媒介：协作研究：Frankencamera - 用于计算摄影研究和教学的开源相机

• 批准号: 0964218
• 负责人: Marc Levoy
• 金额: $ 43.78万
• 依托单位: Stanford University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2010
• 资助国家: 美国
• 起止时间: 2010-04-01 至 2014-03-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0964218&HistoricalAwards=false
• 关键词: III; Medium; Collaborative; Research; Frankencamera

Computational photography refers broadly to sensing strategies and algorithmic techniques that enhance or extend the capabilities of digital photography. Representative techniques include high dynamic range (HDR) imaging, flash-noflash imaging, panoramic stitching, and refocusable photography. Although interest in computational photography has steadily increased among graphics and vision researchers, progress has been hampered by the lack of a portable, programmable camera platform with enough image quality and computing power to be used outside the laboratory, i.e. for everyday photography. Similarly, courses in computational photography are offered in dozens of universities nationwide. However, none of these courses provide students with a camera on which they can implement the algorithms currently being published in the literature.To address these two problems, we are building an open-source camera platform (called Frankencamera) that is portable, self-powered, connected to the Internet, and accommodates SLR-quality lenses and sensors. We also describe a software architecture based on Linux, and an API with bindings for C++, that permits control and synchronization of camera functions at the microsecond time scale. Our API includes pre-capture functions like metering and focusing, an image post-processing pipeline, a user interface toolkit for the viewfinder, and support for current and future I/O devices. Our plan is to distribute this platform at minimal cost to researchers and university instructors nationwide, using the computational photography courses they already teach as a natural distribution vehicle. Instructors will apply to us to be part of this outreach program, and a standing committee will evaluate these applications. Our long-term goal is to spur creation of a community of photographer-programmers who write plug-ins and apps for cameras.

计算摄影广义上是指增强或扩展数字摄影功能的传感策略和算法技术。 代表性技术包括高动态范围（HDR）成像、非闪光成像、全景拼接和可重调焦摄影。 尽管图形和视觉研究人员对计算摄影的兴趣稳步增长，但由于缺乏具有足够图像质量和计算能力以供实验室外（即日常摄影）使用的便携式可编程相机平台，进展受到阻碍。同样，全国数十所大学也开设了计算摄影课程。 然而，这些课程都没有为学生提供可以实现目前文献中发布的算法的相机。为了解决这两个问题，我们正在构建一个开源相机平台（称为 Frankencamera），它是便携式的、自供电的、连接到互联网的，并可容纳单反质量的镜头和传感器。 我们还描述了基于 Linux 的软件架构以及与 C++ 绑定的 API，允许在微秒时间尺度上控制和同步相机功能。 我们的 API 包括测光和对焦等预捕捉功能、图像后处理管道、取景器用户界面工具包以及对当前和未来 I/O 设备的支持。 我们的计划是以最低的成本向全国的研究人员和大学教师分发这个平台，使用他们已经教授的计算摄影课程作为自然分发工具。 讲师将向我们申请参与该外展计划，常务委员会将评估这些申请。 我们的长期目标是促进创建一个由为相机编写插件和应用程序的摄影师程序员社区。