Syllable-Based Burrows-Wheeler Transform
Syllable-Based Burrows-Wheeler Transform
复制标题
基于音节的 Burrows-Wheeler 变换
DOI：
--
复制
发表时间：
2007
期刊：
影响因子：
--
通讯作者：
Z. Vlckova
中科院分区：
文献类型：
--
作者：
J. Lánský;K. Chernik;Z. Vlckova
Burrows-Wheeler变换（BWT）是一种压缩方法，它将输入字符串重新排序为比另一种压缩更好的形式。通常使用Move-To-Front变换，然后对置换后的字符串进行人类编码。1994年的原始方法（3）是为字母压缩而设计的。2001年，推出了使用word和n-grams字母表的版本。最新版本处理音节字母表（7）。本文的目的是比较BWT压缩工作与字母表，音节，单词，3-gram和5-gram。文档解析的方法及其对BWT的影响，我们决定处理文本的自然单位：字母，音节和单词;并将这些方法相互比较，并将这些方法与将文本划分为非自然单位的方法-N-gram进行比较。在我们的测量中，我们发现，根据语言的不同，单词平均有5-6个字母，音节平均有2-3个字母。因此，选择3-克来符合音节长度，选择5-克来对应平均值
The Burrows-Wheeler Transform (BWT) is a compression method which reorders an input string into the form, which is prefer- able to another compression. Usually Move-To-Front transform and then Human coding is used to the permutated string. The original method (3) from 1994 was designed for an alphabet compression. In 2001, versions working with word and n-grams alphabet were presented. The newest version copes with the syllable alphabet (7). The goal of this article is to compare the BWT compression working with alphabet of letters, sylla- bles, words, 3-grams and 5-grams. ways of document parsing and their influence on BWT, we decided to deal with natural units of the text: letters, syllables and words; and compare these approaches with each other and also with the methods that divide the text into unnatural units - N-grams. In our measurements we found out that depending upon the language, words have 5-6 letters and syllables 2-3 letters in average. Therefore 3-grams were chosen to conform to the syllable length and 5-grams to correspond to average