Multi-agent event recognition in structured scenarios

10 years 7 months ago
Multi-agent event recognition in structured scenarios
We present a framework for the automatic recognition of complex multi-agent events in settings where structure is imposed by rules that agents must follow while performing activities. Given semantic spatio-temporal descriptions of what generally happens (i.e., rules, event descriptions, physical constraints), and based on video analysis, we determine the events that occurred. Knowledge about spatiotemporal structure is encoded using first-order logic using an approach based on Allen’s Interval Logic, and robustness to low-level observation uncertainty is provided by Markov Logic Networks (MLN). Our main contribution is that we integrate interval-based temporal reasoning with probabilistic logical inference, relying on an efficient bottom-up grounding scheme to avoid combinatorial explosion. Applied to one-on-one basketball, our framework detects and tracks players, their hands and feet, and the ball, generates event observations from the resulting trajectories, and performs probab...
Vlad Morariu, Larry Davis
Added 05 Apr 2011
Updated 29 Apr 2011
Type Journal
Year 2011
Where CVPR
Authors Vlad Morariu, Larry Davis
Comments (0)