An open source framework for metadata exploration and discovery of Polar Data

该项目将提供一个开源框架，用于元数据探索，自动文本挖掘和使用Apache Tika技术的极地数据信息检索。Apache Tika目前是事实上的？巴别鱼？帮助自动MIME检测、文本提取和超过1200种数据格式的元数据分类。PI将扩展Tika以处理极地数据和科学数据格式，使所有主要内容管理系统更容易获得，搜索和检索极地数据。拟议的活动将为自动生成的极地元数据和数据详细目录奠定框架。扩展Tika来处理极地数据也将自然地邀请技术/开源社区来处理极地用例，有助于增加对北极的了解。通过努力产生的软件将通过Apache软件基金会分发给软件和极地社区。一名计算机科学研究生和博士后将接触到冰冻圈和北极数据，帮助培养该领域的下一代跨学科数据科学家。私家侦探？南加州大学的搜索引擎（每年招收20-40名学生）和软件架构（每年招收30-50名学生）研究生课程将受益于通过课程项目和讲座材料传播的北极网络基础设施用例。PI还将与NSF资助的项目合作，这些项目侧重于极地数据的存档，发现和访问，如ACADIS和南极主目录。

This project will deliver an open source framework for metadata exploration, automatic text mining and information retrieval of polar data that uses the Apache Tika technology. Apache Tika is currently the de facto ?babel fish?, aiding in the automatic MIME detection, text extraction, and metadata classification of over 1200 data formats. The PI will expand Tika to handle polar data and scientific data formats, making Polar data more easily available, searchable, and retrievable by all major content management systems. The proposed activity will lay the framework for a thorough automatically generated inventory of polar metadata and data. Expanding Tika to handle polar data will also naturally invite the technology/open source community to deal with polar use cases, helping to increase understanding of the arctic. The resultant software produced through effort will be disseminated to the software and polar communities through the Apache Software Foundation. A computer science graduate student and postdoc will be exposed to Cryosphere and Arctic data, helping to train the next generation of cross disciplinary data scientists in the domain. The PI?s Search Engines (20-40 students annual enrollment) and Software Architecture (30-50 students annual enrollment) graduate courses at USC will benefit from the Arctic cyberinfrastructure use cases disseminated through course projects and lecture material. The PI will also work collaboratively with NSF-funded projects dealing with projects focusing on the archiving, discovery and access of polar data, such as ACADIS and the Antarctic Master Directory.