Logo TU Vienna  Logo IFS Information & Software Engineering Group
Vienna University of Technology
Institute of Software Technology and Interactive Systems
Information & Software Engineering Group

Music Information Retrieval

Logo Music Information 
Retrieval at TU Vienna IFS
  [Topics] [Projects] [Downloads] [People] [Publications] [Press] [Events]  

Music Showroom

Image/Video Showroom

Scientific Results Showroom

 

The MediaSquare

The MediaSquare has been realized in a collaboration with EC3 (the e-Commerce Competence Center). Together, we developed a 3D Multimedia Environment where users are impersonated as avatars enabling them to browse and experience multimedia content by literally walking through it. Users may engage in conversations with other members of the community, exchange experiences or simply enjoy the featured content.

The MediaSquare

 

The MediaSquare processes a range of content to be published in the 3D Multimedia Environment: audio content (mp3 music files), images & videos, as well as scientific publications in the form of papers, paper abstract and (Powerpoint) presentations.

showcase

The following three scenarios are available in The MediaSquare, represented by different areas (or rooms) in the 3D environment.

MediaSquare bird's eye view

MediaSquare bird's eye view

 

Music Showroom

A 3D Music Showroom that enables users to browse and listen to songs by literally walking through them. To this end, acoustic characteristics extracted from music tracks act as features for the training of a Self-Organizing Map. The resulting 2-dimensional map arranges similar music tracks in spatially adjacent regions. This 2-dimensional map defines the final position of each particular music track within the 3D Music Showroom.

MediaSquare audio lounge entrance

MediaSquare music showroom

MediaSquare music room detail

Image/Video Showroom

A 3D Image/Video Showroom that enables users to browse and experience visual content such as images and videos. To this end, characteristic features are extracted from images/videos which are used for the training of a Self-Organizing Map. This 2-dimensional map defines the final position of each particular image/video within the 3D Image/Video Showroom.

Scientific Results Showroom

The 3D Scientific Results Showroom that enables users to explore the scientific results (i.e. documents such as Posters, paper abstracts, etc...) in an immersive 3D environment. In this case, characteristic text features are extracted from and are used for the training of a self-organizing map. The resulting 2-dimensional map arranges similar posters, papers, etc... in spatially adjacent regions and, in turn, defines the final position of each documents within the 3D Scientific Results Showroom. In the current demonstrational version of the MediaSquare, the Scientific Results Showroom contains scientific results of the research project MUSCLE.

 
 

The MediaSquare presents an impressive showcase for combining state-of-the-art multimedia feature extraction approaches and unsupervised neural networks assembled an immersive 3D multimedia content presentation environment.
This allows geographically separated individuals to immerse into a collaborative virtual environment, interact with each other and collectively experience the featured content.

 

 

 
 
top
last edited 15.07.2009 by Thomas Lidy