MaPLE: A MapReduce Pipeline for Lattice-based Evaluation and Its Application to SNOMED CT.
MaPLE: A MapReduce Pipeline for Lattice-based Evaluation and Its Application to SNOMED CT.
复制标题
DOI：
10.1109/bigdata.2014.7004301
复制
发表时间：
2014-10
期刊：
影响因子：
--
通讯作者：
Cui L
中科院分区：
文献类型：
--
作者：
Zhang GQ;Zhu W;Sun M;Tao S;Bodenreider O;Cui L
非晶格片段通常表示本体系统中的结构异常，因此代表后续质量保证工作的可能重点领域。然而，使用传统的顺序方法在大型本体系统中提取非晶格片段的计算成本即使不是过高，也是昂贵的。在本文中，我们提出了一种通用的 MapReduce 管道，称为 MaPLE（基于格评估的 MapReduce 管道），用于提取大型偏序集中的非格片段，并证明其在本体质量保证中的适用性。在30节点Hadoop本地云中使用MaPLE，我们系统地提取了2009年至2014年8个SNOMED CT版本（每个版本包含超过30万个概念）中的非格片段，每个版本的平均总计算时间不到3小时。通过大幅缩短时间，MaPLE 不仅可以对大型本体层次结构进行详尽的结构分析，还可以系统地跟踪版本之间的结构变化。我们的变化分析表明，非晶格对的平均变化率比背景结构（概念节点）的变化率高出 38.6 倍。这表明非晶格对周围的片段在本体进化过程中表现出显着更高的变化率。
Non-lattice fragments are often indicative of structural anomalies in ontological systems and, as such, represent possible areas of focus for subsequent quality assurance work. However, extracting the non-lattice fragments in large ontological systems is computationally expensive if not prohibitive, using a traditional sequential approach. In this paper we present a general MapReduce pipeline, called MaPLE (MapReduce Pipeline for Lattice-based Evaluation), for extracting non-lattice fragments in large partially ordered sets and demonstrate its applicability in ontology quality assurance. Using MaPLE in a 30-node Hadoop local cloud, we systematically extracted non-lattice fragments in 8 SNOMED CT versions from 2009 to 2014 (each containing over 300k concepts), with an average total computing time of less than 3 hours per version. With dramatically reduced time, MaPLE makes it feasible not only to perform exhaustive structural analysis of large ontological hierarchies, but also to systematically track structural changes between versions. Our change analysis showed that the average change rates on the non-lattice pairs are up to 38.6 times higher than the change rates of the background structure (concept nodes). This demonstrates that fragments around non-lattice pairs exhibit significantly higher rates of change in the process of ontological evolution.