Smart surveillance with Sakbot - Imagelab

VIDEOSORVEGLIANZA
Profili sociologici, criminologici, culturali e giuridici nell’ottica
smart city
Milano 24 Maggio, Università Cattolica del Sacro Cuore
VIDEOSORVEGLIANZA: LA RICERCA IN
VISIONE ARTIFICIALE PER IL
RICONOSCIMENTO AUTOMATICO DI
PERSONE ED EVENTI
Prof. Rita Cucchiara,
Università di Modena e Reggio Emilia,
Direttore del centro Softech ICT
http://www.Imagelab.ing.unimore.it
WELCOME IN MODENA
The Second Short Spring School in Surveillance
is organized by
-University of Modena and Reggio Emilia
-Softech-ICT Interdip. Research Center in ICT
-Dipartimento di Ingegneria Enzo Ferrari
- ImageLab
Co-Sponsored by
- Fondazione Cassa di Risparmio di Modena
- GIRPR (Italian chapter of IAPR)
Università di Modena e Reggio Emilia, Italy
UNIMORE: WHERE WE ARE…
Università di
Modena e Reggio
Emilia
Emilia Romagna,
Italia
Dipartimento di Ingegneria
“Enzo Ferrari”
ImageLab
Università di Modena e Reggio Emilia, Italy
WHY S5?
A research School in
(computer vision and pattern recognition for)
Video Surveillance.
Mainly a school for researchers
few hot selected topics
Short (but intensive) school in Spring period
A Second edition…
Università di Modena e Reggio Emilia, Italy
S4 THE 2011 EDITION
Multicamera & applications
Tracking
Security and Forensics
Face and expression
Architecture and systems
Large Crowd
Università di Modena e Reggio Emilia, Italy
AGAIN SURVEILLANCE…
Why another (short spring) School in surveillance?
Surveillance
Surely is an industrial gold filed
… is it still an open research problem?
Università di Modena e Reggio Emilia, Italy
THE MARKET
The global Intelligent Video Surveillance (IVS) & Video Analytics (VA)
industry revenues*
• totaled $13.5 billion in 2012,
• and are estimated to reach $39 billion in 2020.
The rapid market growth is driven by the following dynamics:
• Increased use of video surveillance.
• Migration from analog to digital cameras and to IP based cameras.
• Technology maturity. Video analytics algorithms, processors, applications
and products underwent a decade of technological evolution to intelligent
video processing, based on advancements in image processing, enabling
automatic detection of signatures detection and identification.
• Cost reduction of video analytic systems. Driven by the falling prices of
image processing DSPs and communication systems. Cost-performance of
new edge-based video analytics DSP technologies (e.g., Intel, Texas
Instruments DSPs).
Università di Modena e Reggio Emilia, Italy
From the "Intelligent Video Surveillance, VCA & Video Analytics: Technologies & Global Market – 2013-2020"
THE MARKET
Human operators entail high cost & high rate of overlooked events.
Real time analysis of video images and recorded footage is a need that
can hardly be answered effectively by human operators, and manpower cost.
Furthermore, human operators fatigue and boredom cause a high rate of
overlooked events.
It takes IVS, VCA and VA to process trillions of video surveillance-hours
generated annually.
By 2011 over 165 million video surveillance cameras installed worldwide
captured 1.4 trillion video-hours.
the investing growth of 9-11% year , captured video surveillance will reach
approximately 3.3 Trillion video-hours in 2020.
A hypothetical analysis assuming that 20% of the most critical video stream
should have been reviewed by human operators, results in a (hypothetical) need
to employ (by 2011) a workforce of over 100 million operators (working 8
hours daily, 300 days a year).
Intelligent video surveillance and video analytics with mature technology have
attracted a lot of attention. ---the global market* will triple by 2020.
Università di Modena e Reggio Emilia, Italy
THE RESEARCH
1998 the first workshop on AVSS (advanced video-based
surveillance system) in Genoa
2000 The first IEEE Transaction PAMI Special issue on video
surveillance
2003 the first IEEE conference AVSS
….. FIFTTEEN YEARS OF RESEARCH
Università di Modena e Reggio Emilia, Italy
SOME STATISTICS
“Video Surveillance” : Google scholar 54000 items,
IEEEXplore 6407 items
140
from IEEEXplore papers with “video surveillance” keyword
120
100
80
conf (x 10)
journals
60
40
20
surveillance
analytics
2010
863
23
2011
867
27
2012
768
46
0
1989-1999
2000
2002
2004
2006
2008
2010
2012
Università di Modena e Reggio Emilia, Italy
STATISTICS
IEEE conference papers with video surveillance and ……
400
2004
350
2006
300
250
2008
2010
2012
200
150
100
50
0
Università di Modena e Reggio Emilia, Italy
STATISTICS
IEEE journal papers with video surveillance and ……
45
40
35
30
25
20
2004
2006
15
2008
10
2010
5
2012
0
Università di Modena e Reggio Emilia, Italy
SURVEILLANCE
1) A growing interest in PEOPLE surveillance
2010
2011
2012
traffic
117
104
86
people
83
85
93
2) From SECURITY
to SOCIAL and WELLBEING
3) A research interest in computer vision AND learning
Università di Modena e Reggio Emilia, Italy
Acquisition
Single camera
 Multiple cameras
Detection
VIDEO
SURVEILLANCE
Moving object detection
Single object/people
 Multiple targets, cluttered, occluded..
Tracking
2000
RESEARCH
Linear prediction
 Generative models
 Stocastic prediction
Understanding
Purposive
Università di Modena e Reggio Emilia, Italy
Acquisition
Detection
&
Tracking
SPATIO-TEMPORAL
REASONING
2010
RESEARCH
PEOPLE
SURVEILLANCE
IN THE NEW DECADE
Learning
&
Inferring
BIG DATA
ANALYSIS
Searching
&
Recognizing
HUMAN
FEEDBACK
Università di Modena e Reggio Emilia, Italy
PEOPLE ANALYSIS IS PERVASIVE
From Security
a) Surveillance: Real time detection, Border, Zone control,
Activity monitoring, Traffic, urban control…
b) Safety: traffic-automotive control; crowd monitoring, home,
working area control
c) Forensics: Video Mining, Identity assessment, Likelihood
ratio support
To Multimedia
Video analysis, broadcasting analysis, Digital Library
annotation, Sport action recognition, Human Interaction,
Gaming
To (Social) Wellbeing
Retail analysis, Comfort in architecture Design, Building
Automation, Healthcare, Entertainment, Graphics..
Università di Modena e Reggio Emilia, Italy
PEOPLE ANALYSIS
Many applications.. Same problem:
 detect people, their identity and behavior
Università di Modena e Reggio Emilia, Italy
PEOPLE SURVEILLANCE:
WHAT AT IMAGELAB
Detection &Tracking
People (and crowd) Detection and Tracking
With multisensory data
Learning& inferring
People Identification and (Ri-)Identification
Search & Recognition
People Search by similarity
A-priori
Models
Visual
Learning
Università di Modena e Reggio Emilia, Italy
SURVEILLANCE AT S5
The topics:
Ci penso io quando avro’ gli abstract
Università di Modena e Reggio Emilia, Italy
SURVEILLANCE AT S5
The lecturers:
•Arnold Smeulders
CWI Amsterdam, the Netherlands
•Bernhard Rinner
Alpen-Adria-Universität Klagenfurt, Austria
•Francois Bremond
INRIA, France
•Greg Mori
Simon Fraser University, Canada
Università di Modena e Reggio Emilia, Italy
SURVEILLANCE AT S5
The lecturers:
•Horst Bischof
Institute for Computer Graphics and Vision,
Inffeldgasse Graz, Austria
•Larry Davis
Institute for Advanced Computer Studies,
Univ. of Maryland, USA
•Shmuel Peleg
The Hebrew University of Jerusalem, Israel
Università di Modena e Reggio Emilia, Italy
SURVEILLANCE AT S5
The attendees
Participant Affiliation
24%
Company
Research Center
58%
18%
Participant Nation
University
3%
14%4%
3%
14%
Attendees type
Austria
Denmark
Israel
Italy
62%
Spain
Sweden
17% 13%
27%
43%
Company
Msc Student
Phd Student
Researcher
Università di Modena e Reggio Emilia, Italy
THANKS..
Prof. Rita Cucchiara
Dipartimento di Ingegneria Enzo Ferrari
Res. Center SOFTECH-ICT
Università degli Studi di Modena e Reggio Emilia
[email protected]
Imagelab
Andrea Prati [IUAV-Venezia]
Costantino Grana
Roberto Vezzani
Simone Calderara
http://imagelab.ing.unimo.it
Giovanni Gualdi , Paolo Piccinini, Daniele Borghesani, Adnan Rashid, Paolo Santinelli
Davide Baltieri , Dalia Coppi, Michele Fornaciari ,Marco Manfredi
VISION-E srl
Rudy Melli, Giuliano Pistoni, Emanuele Perini