Reinforcing pattern mining with uncertainty and connectivity

点击翻译按钮获取中文摘要

Generally, data stored in databases are considered facts and observations that took place. These records are also typically considered mutually independent. This is true for many application domains. For instance, a hospital database contains information about patients that are independent from each other. A record could state a visit at a given date for a particular diagnostic for which a given treatment is given. The observed facts are recorded as unrelated. Data mining and analysis tasks assume this independence between records and consider the recorded facts to be certain. However, in many real applications some relationships exist between observations and thus could be recorded. For example, the fact that a person is a friend, colleague or family member of another person can be recorded as a connection. In telecommunication, the fact that a phone number calls another telephone number creates a relationship between records. These are information networks. Ignoring these relationships in data analysis is a missed opportunity to get better insights about the data. Moreover, uncertainties in data exist and can come from the measurement instruments such as sensors or any confidence level attached to the source of information. For instance, the temperature measured by a sensor may not be certain but assumed within a range of values; many values recorded in different application domains may only be ascertained with some level of confidence. These are probabilistic data because the value of an attribute could be affixed with a probability level. Uncertainty can also be ascribed to relationships in data to form probabilistic information networks. Unfortunately, most existing data mining approaches assume independence and certainty of data. Very little work has been done on effectively analyzing probabilistic databases or probabilistic information networks to discover useful new knowledge or patterns in such data collections. The purpose of this proposal is to work on devising effective and efficient techniques to mine and learn from probabilistic databases and probabilistic information networks, and show the use and relevance of these techniques in real domains applications where uncertainty is germane to the data collection.****