Taming Crowded Visual Scenes

Video Surveillance and Monitoring is very active area of research in Computer Vision. However, most of the current approaches assume that the observed scene is not crowded, and that reliable tracks of objects are available over longer durations. Therefore, these approaches are not extendable to more challenging surveillance videos of crowded environments like markets, subways, religious festivals, parades, concerts, football matches etc, where tracking of individual objects is very hard, if not impossible. In this talk, first I will present an approach for tracking people in crowded scenes using multiple cameras.. Next, I will present a framework for modeling scenes involving high density crowds in which Lagrangian particle dynamics are used to segment crowd flows and detect any flow instability. Finally, I will discuss an algorithm that tracks an individual within the crowd. The approach is based on the observation that a pedestrian behavior in crowds results from the collective behavioral patterns evolving from the space time interaction of large number of individuals among themselves and with the geometry of the scene. Therefore, we incorporate the influences generated by other individuals of the crowd and scene geometry into the tracking algorithm itself.
Dr. Mubarak Shah, Agere Chair Professor of Computer Science, is the founding director of the Computer Visions Lab at UCF. He is a co-author of three books (“Automated Multi-Camera Surveillance: Algorithms and Practice” (2008); Video Registration (2003); and "motion-Based Recognition (1997) ) all by Springer. Dr. Shah is a fellow of IEEE, IAPR and SPIE. In 2006, he was awarded a Pegasus Professor award, the highest award at UCF, given to a faculty member who has made a significant impact on the university, has made an extraordinary contribution to the university community, and has demonstrated excellence in teaching, research and service. He is ACM distinguished speaker. He was an IEEE Distinguished Visitor speaker for 1997-2000 and received IEEE Outstanding Engineering Educator Award in 1997. He received the Harris Corporation's Engineering Achievement Award in 1999, the TOKTEN awards from UNDP in 1995, 1997, and 2000; Teaching Incentive Program award in 1995 and 2003, Research Incentive Award in 2003, Millionaires' Club awards in 2005 and 2006, University Distinguished Researcher award in 2007, honorable mention for the ICCV 2005 Where Am I? Challenge Problem, and was nominated for the best paper award in ACM Multimedia Conference in 2005. He is an editor of international book series on Video Computing; editor in chief of Machine Vision and Applications journal, and an associate editor of ACM Computing Surveys journal. He was an associate editor of the IEEE Transactions on PAMI, and a guest editor of the special issue of International Journal of Computer Vision on Video Computing.