Algorithms and Inference of Grammars and Natural Computing Models

当植物育种者创造新品种时，他们会检查数千种植物，以寻找合意或不合意的生长，以及压力或疾病的证据。这传统上是通过人工检查来完成的，这形成了一个瓶颈，可以通过自动图像分析来缓解。机器学习可用于检测各种组件及其形式；通常从具有这些属性的大量图像开始，并使用它们来训练将输入映射到输出的模型。人工神经网络经常被用于这一点，但从其中提取科学知识是出了名的困难。形式语法是一种数学形式主义，具有用于重写重复应用的字符串的规则，从初始符号开始创建新的字符串。林登迈尔系统(L系统)是一种语法系统，它的创建是为了模拟许多具有内在自相似性的生物有机体中存在的多细胞结构，例如植物。L系统已被广泛用于创建正在发育的植物的逼真视觉模拟。第一个目标是使用L系统(而不是神经网络)从显影的植物图像序列中预测植物成分和几何形状。将使用现有的L系统来捕获一系列表型(例如一个物种)。图像处理将被用作对每幅图像上的植物成分的初始预测。然后，将创建软件，以找到与最初预测最接近的L系统模拟。这种模拟将形成一个新的预测，它必须与植物的发育计划保持一致(与独立分析的图像的预测形成对比)。这将检测到某些组件，即使它们完全隐藏在图像中。该精度将与其他预测模型进行比较。虽然这一预测不需要注释数据，但它确实需要L系统，而这些系统目前也很难创建，特别是针对每一种兴趣。因此，第二个目标是构建算法和软件，从数据(图像或图像描述)中自动学习L系统。L系统可以可选地具有与重写规则相关联的概率，所述重写规则用于计算模拟发生的概率。我们将从第一个目标开始，使用L系统上的图像数据创建用于他们计算的软件。下一步，将构建软件来从数据中学习规则本身。预期的成果是创造新的方法和软件来使用和学习L系统，以加强表型鉴定和作物改良的渠道。学习的语法和概率直接描述发展，因此，科学原理可以被提取和更好地理解。在加拿大和全世界人口不断增长和环境发生巨大变化的情况下，这些都是加强粮食安全的关键。

When plant breeders create new varieties, they inspect thousands of plants looking for desirable or undesirable growth, and evidence of stress or disease. This has traditionally been done by manual inspection which forms a bottleneck that can be alleviated with automatic image analysis. Machine learning can be used to detect various components and their form; it is common to start with a large set of images with these properties already identified, and use them to train a model that maps inputs to outputs. Artificial neural networks are often used for this, but it is notoriously difficult to extract scientific knowledge from them. Formal grammars are a mathematical formalism with rules for rewriting strings that are repeatedly applied, starting from an initial symbol to create new strings. Lindenmayer systems (L systems) are a type of grammar system that were created to model multicellular structures present in many biological organisms with inherent self-similarity, such as plants. L systems have been widely used to create realistic visual simulations of developing plants. The first objective is to use L systems (and not e.g. neural networks) for predicting plant components and geometry from sequences of developing plant images. An existing L system created to capture a range of phenotypes (e.g. a species) will be used as a starting point. Image processing will be used as an initial prediction of plant components on each image. Then, software will be created to find the L system simulation that most closely matches the initial prediction. This simulation will form a new prediction that must be consistent with the developmental program of the plant (in contrast to predictions from images analyzed independently). This will detect some components even if they are completely hidden in an image. The accuracy will be compared to other predictive models. While this prediction does not require annotated data, it does require L systems which are also currently difficult to create, especially for each variety of interest. Hence, the second objective is to build algorithms and software to learn L systems automatically from data (images or descriptions of them). L systems can optionally have probabilities associated with rewriting rules which are used to calculate the probability of a simulation occurring. We will create software for their calculation using image data on top of the L system from the first objective. Next, software will be built to learn the rules themselves from data. The anticipated outcomes are the creation of new methods and software to use and learn L systems towards strengthening the pipeline for phenotyping and improving crops. Learned grammars and probabilities directly describe development and hence, scientific principles can be extracted and better understood. These are both critical towards increasing food security amidst a growing population and dramatic environmental changes within Canada and worldwide.