here - franzsetti.info

VIPS Lab:
SEEING, UNDERSTANDING & SHOWING
THE WORLD
Francesco Setti
GIRPR 2016 – Grado (GO)
GIRPR 2016 – Grado (GO)
Associate Professor
Assistant Professor
Full
People
Topics
3D vision
Computer
graphics
Social Signal
Processing
GIRPR 2016 – Grado (GO)
Neuroimaging
Bio-informatics
Diffusion MRI
GIRPR 2016 – Grado (GO)
Multimodal MRI
GIRPR 2016 – Grado (GO)
Human Body Modelling
GIRPR 2016 – Grado (GO)
Cultural Heritage Modelling
Multimodal acquisition
for cultural heritage
http://scan4reco.eu
GIRPR 2016 – Grado (GO)
3D local feature description
GIRPR 2016 – Grado (GO)
Counting grids
GIRPR 2016 – Grado (GO)
Biclustering
«Simultaneous clustering of both rows and columns of a given data matrix»
GIRPR 2016 – Grado (GO)
Social Signal Processing
Scene
Spectator crowd
Crowd
Behaviour
Human Behaviour
F-formations
Understanding
GIRPR 2016 – Grado (GO)
F-formation
«An F-formation arises whenever two or more people sustain a spatial and
orientational relationship in which the space between them is one to which
they have equal, direct, and exclusive access.»
[Kendon 1990]
GIRPR 2016 – Grado (GO)
F-formation detection
The common idea is to design a minimization problem that can embed the
sociological constraints.
• Hough Voting [Cristani 2011, Setti WIAMIS 2013, Setti ICIP 2013]
• Dominant Sets [Hung 2011, Setti WIAMIS 2013]
• Game Theory [Vascon 2014]
• Graph Cuts [Setti PLOS 2015]
Please visit: http://vips.sci.univr.it/research/fformation/
GIRPR 2016 – Grado (GO)
GROup DEtection metrics (GRODE)
GIRPR 2016 – Grado (GO)
Experiments & Results
GIRPR 2016 – Grado (GO)
Experiments & Results
GIRPR 2016 – Grado (GO)
Spectator Crowd
Particular kind of crowd in which
people is interested in watching
something specific that they came
to see.
[Berlonghi]
GIRPR 2016 – Grado (GO)
Spectator Crowd
Attentional prior:
people orient their focus of
attention on the event
GIRPR 2016 – Grado (GO)
Territoriality prior:
people are assumed to stay near a
fixed location for most of the time
S-HOCK dataset
Please visit: http://vips.sci.univr.it/dataset/shock/
GIRPR 2016 – Grado (GO)
S-HOCK dataset
People Detection
GIRPR 2016 – Grado (GO)
Head orientation
S-HOCK dataset
Spectator categorization
GIRPR 2016 – Grado (GO)
Salient event detection
SceneUnderLight
GIRPR 2016 – Grado (GO)
SceneUnderLight
Leveraging on the view frustum to:
• Improve people tracking
• Detect and track groups of
interacting people
• Semantically map the scene
• Activity forecasting
• …
GIRPR 2016 – Grado (GO)
Master in Game Development
Master ‘‘seminariale’’
•
•
•
•
320 ore di didattica frontale
72 ore di laboratorio guidato
250 di stage
teachers both from Academia
and Companies
GIRPR 2016 – Grado (GO)
Computer Science Park
GIRPR 2016 – Grado (GO)
Thanks!
GIRPR 2016 – Grado (GO)