Institute of Information Theory and Automation

You are here

Solving inverse problems for the analysis of fast moving objects

Agency: 
GACR
Identification Code: 
GA18-05360S
Start: 
2018-01-01
End: 
2020-12-31
Project Focus: 
teoretický
Project Type (EU): 
other
Abstract: 
Objects moving fast with respect to the camera appear blurred when observed. Surprisingly this common phenomenon has not yet been considered and analyzed by the computer vision community. It is the blur that encodes information about the object motion properties. Instead of considering blur as a nuisance, the project proposes to take it as a cue for detection and tracking of fast moving objects. We formulate accurate and tractable formation models and find solutions of corresponding inverse problems which are more complex than standard blind deconvolution, since occlusion is present and blur is space variant. The complexity of the inverse problems is addressed by deriving additional priors from tracking the objects in videos and constraining the admissible set of motion blurs with the help of convolutional neural networks and blur invariants. The resulting methodology of tracking with deblurring will allow us to implement novel video analysis algorithms such as temporal superresolution, or visualization of angular velocity and deformations that are otherwise imperceptible.
This project is conducted in collaboration with Prof. Jiří Matas (The Center of Machine Perception, FEL, CVUT).
Publications ÚTIA: 
list
2018-03-14 17:31