An Interactive Soccer Video Generation System using Scene Analysis of Multi-Camera Image

本研究旨在实现交互式广播。以足球视频为例，从任意指定的视图方向自动生成序列图像。当物体是在像足球这样的大场地上进行的运动时，用一台相机捕捉整个场景是非常困难的。无论使用多少台摄像机，专家只会选择一台摄像机进行广播。因此自动选相机系统是满足观众需求的理想系统。这就是所谓的交互式视频生成系统。研究结果如下：构建了一个多摄像机图像采集环境，在足球场周围固定多台摄像机，并对采集到的图像进行分析。摄像机对转播结果进行控制分析。利用多摄像机图像序列对球员和球进行检测和跟踪，采用模板匹配技术对一帧内的球进行检测，采用背景差分图像对球员进行检测。然后，提出并应用帧间跟踪算法。算法工作得很好，对定位玩家很有用。开发一种由遮挡球员引起的纠错算法，当一个球员被其他球员遮挡时，从一个相机的图像。遮挡不应该存在于其他摄像机的图像中，或者被估计为球员和球的位置。为了确定最佳视点方向，将球和球员的跟踪信息与特征值联系起来。对这些特征值向量进行分析，给出最佳的视角方向。识别踢球类型，检测球周围的球员，利用位置和速度信息来区分传球、射门、抢断等足球动作

In this research, to realize an interactive broadcasting is aimed. Soccer video is concerned as example, and sequential images from optionally assigned view direction, are generated automatically. When object is sports which is played in large fields like soccer, it is very much difficult to capture by one camera for whole scene. However many cameras are used, only one selected camera is selected by expert and broadcasted. So automatic camera selection systems yield to viewers demand are desired. This is called an interactive video generation systems. The results are as follows,To construct an environments of image capture from multi-camera Many cameras are fixed around the soccer field and those images are analyzed. Camera for broadcasting will be controlled by the results of analysis.Detection and tracking of players and ball using image sequence from multi-camera To detect a ball in one frame, template matching technique are applied, and to detect players, background difference images are used. After that, inter frame tracking algorithms are proposed and applied. The algorithms are well worked and useful to make loci of players.To develop an algorithm for error correction caused by occluded player When a player is occluded by other player in image from one camera. An occlusion should not exist in images from the other camera, or be estimated players and ball position.To decide the best view direction Information from tracking of ball and player are concerned to feature value. The analysis of those feature value vector, gives the best view directionTo recognize play type Players around the ball are detected, position and velocity information are used for distinguish soccer play such as pass, shot tackle and so on