MUSCLE Showcase: Content Analysis Showcase and Evaluation Web Portal

(MUSCLE NoE | All e-teams)


The goal of this showcase is to bring together and demonstrate the wide range of semantic analysis and annotation capabilities that are present within MUSCLE. Based on contributions from the participants, a video data base was compiled from TV short recordings of different genres (e.g. news reports, music clips, commercials, etc.). These were integrated and shared by all team members as well as provided in the evaluation web portal. Showcase participants will perform whatever semantic extraction and analysis (single or multimodal) they can apply to the videos, such as all kinds of low-level feature extraction, face detection, moving objects, fire and smoke detection, logo detection, music genre analysis, music segment clustering, speech recognition, text detection and recognition, etc. To achieve this, partners are allowed to use all kind of algorithms, additional external information, as well as additional data they may have and use within their own labs to enhance the information extracted from the video. The CASEWP web portal is particularly meant to evaluate results of temporal segmentation tools. The web portal will provide all the necessary environment resources (e.g. free data sets and annotations) and will enable evaluations of state-of-the-art methods outside the constrained timelines of scientific evaluation campaigns. The goal here is to propose an online evaluation tool to the research community, which objectively measure various temporal segmentation results “on demand”, and which indirectly promote the best technology. Results of the showcase will demonstrate the wide range of current semantic analysis algorithms developed within MUSCLE on a single common database.

The results will be: The result of this e-team in the first stage would thus provide a kind of practical state-of-the-art showcase of the capabilities and competences on feature extraction and semantic annotation witin MUSCLE.

Collaboration and Vision

The ambitious goal of this e-Team is to integrate all the activities and competencies of all partners active in extracting information from multimedia data in single and multiple modalities. To this end we have started to collaboratively build a joint dataset including recordings from different national TV stations and private holdings.
These are now to be distributed amongst the participating partners, with each partner first starting to apply their own analysis techniques individually. From this stage on, collaboration will happen in two levels: Overall, this e-Team shall foster the overall integration and understanding of each others algorithms and approaches by jointly working on a common real world data source, sharing data, algorithms and results.


Contribution of partners

Tentative Work Plan

Current status of Work

Further Infos


Andreas Rauber
Dept. of Software Technology and Interactive Systems
Vienna Univ. of Technology
Favoritenstr. 9 - 11 / 188
A - 1040 Wien
AUSTRIA e-mail: