Recognizing piglet play, in all its forms, using machine learning on data from accelerometers and computer vision

动物行为科学家关注动物行为是如何进化和发展的，并且可以用来评估和改善动物福利。然而，研究和实际应用需要有效和自动地测量这种行为。加速度计非常适合于检测剧烈和突然的运动。计算机视觉是另一个很有前途的工具，可以在视频中跟踪动物，并可以识别某些行为。我们的目标是开发和比较加速度计和基于视频的工具，使用机器学习训练来自动检测仔猪的不同类型的游戏，并以与人类观察者相同的方式对它们进行分类。我们的第一个目标是设计定制的加速度计，佩戴在小猪的腿和耳朵上。我们的第二个目标是训练和验证机器学习算法来检测游戏。我们将收集视频和加速度计数据从成对的仔猪在一个游戏场所。计算机视觉算法将确定动物的位置和运动。数据将与人类观察者进行的行为分类同步，机器学习模型将训练用于分类游戏类型（运动，物体，社交）和其他行为（例如攻击），使用来自耳朵加速计，腿部加速计或计算机视觉动物跟踪的数据。我们的第三个目标是测试这些方法在魁省和马尼托巴省典型农场条件下的表现。它们应该能正确识别个体之间和仔猪群之间的差异，表现得和人类观察者一样好，在很短的时间内就能以同样的方式对行为进行分类。这项研究将产生宝贵的科学和社会影响。自动化工具将极大地扩展我们研究游戏的本质及其对动物福利的意义的能力。开发的工具将公开传播，其他研究人员可以随时进行调整。我们将通过直接向猪肉行业展示成果来鼓励实际应用。该项目将对一种令人着迷的动物行为进行研究，并应用于在日益可持续的粮食生产系统中改善农场动物的生活。

Play in young farm animals is of interest to animal behaviour scientists concerned with how behaviour evolves and develops, and can be used to assess and improve animal welfare. However, research and practical applications require that this behaviour be measured efficiently and automatically. Accelerometers are ideally suited to detect play, which is characterized by forceful and sudden movements. Computer vision is another promising tool that enables tracking of animals in video, and can recognize certain behaviours. We aim to develop and compare accelerometer and video-based tools, trained using machine learning to automatically detect different types of play in piglets, classifying them in the same way as human observers.Our first objective is to design custom accelerometers to be worn on piglet legs and ears. Our second objective is to train and validate machine learning algorithms to detect play. We will collect video and accelerometer data from pairs of piglets in a play arena. Computer vision algorithms will determine animal positions and movements. Data will be synchronized to behavioural categorizations made by human observers, and machine learning models trained to classify types of play (locomotor, object, social) and other behaviours (e.g. aggression) using data from ear accelerometers, leg accelerometers, or animal tracking by computer vision. Our third objective is to test how these methods perform in typical farm conditions, in Québec and Manitoba. They should correctly identify differences between individuals and between groups of piglets, and perform as well as human observers, categorizing behaviour the same way in a fraction of the time.This research will have valuable scientific and societal impacts. Automated tools will drastically expand our capacity to study the nature of play and its significance for animal welfare. Tools developed will be openly disseminated, readily adaptable by other researchers. We will encourage practical applications by presenting results directly to the pork industry. The project will enable research on a fascinating type of animal behaviour, and applications to improve the lives of farm animals in increasingly sustainable food production systems.