CINEMA Project

Numerous studies were focusing on the modelling of humans and their behaviour in 3D environments. The CINEMA project had similar goals but differentiated itself by aiming at enhanced interactions, the creation of mixed reality, and the creation on interactive and reactive acoustical environments. Part of the project consisted in gesture recognition of a user, who is given the real-time control of auralization and audio spatialization processes.

The CINEMA project was a collaborative effort between teams at four Belgian universities, working towards the development of a real-time system that included 3D user and environment modelling, extraction of motion parameters, gesture recognition, computation of depth maps, creation of virtual spaces, and auralization and spatialization.
The goals of the imaging laboratory of the ULg for the CINEMA project were:
  • Extraction of depth maps robust to light changes.
  • Extraction of motion parameters.
  • Automatic extraction of three-dimensional data about the user.


Related Publications:

  • R. Dardenne, J.-J. Embrechts, M. Van Droogenbroeck, and N. Werner. A video-based human-computer interaction system for audio-visual immersion. In Proceedings of SPS-DARTS 2006, Antwerp, Belgium, pages 23-26, March 2006. IEEE Benelux. (Details can be founded here)
  • M. Van Droogenbroeck and O. Barnich. Design of Statistical Measures for the Assessment of Image Segmentation Schemes. International Conference on Computer Analysis of Images and Patterns (CAIP2005) of Lecture Notes on Computer Science (LNCS 3691), pages 280-287. Springer Verlag, Paris, September 2005. (Details can be founded here)
  • R. Dardenne, J.-J. Embrechts, M. Van Droogenbroeck, and N. Werner. The CINEMA Project: A Video-Based Human-Computer Interaction System for Audio-Visual Immersion. ERCIM News, (62):45-46, July 2005. (Details can be founded here)
  • R. Dardenne and M. Van Droogenbroeck. Acquisition vidéo au moyen d'une caméra IEEE 1394. Linux Magazine France, (69):54-59, F&eacutre;vrier 2005. (Details can be founded here)


Some Results:

  • Average Distance Computation
  • Simple Gesture Recognition
  • Visual and Acoustic Immersion
Cinema Example


Demonstration:

These videos have been shot at the SPS DARTS 2006 conference:

SPS DARTS 2006 Demo
[6 Mb]
SPS DARTS 2006 Demo
[4,4 Mb]

ULg      Institut Montefiore