ImageCLEF 2005 - Automatic Annotation Task

ImageCLEF 2005 Automatic Annotation Task is part of the Cross Language Evaluation Forum (CLEF), a benchmarking event for multilingual information retrieval held annually since 2000. CLEF first began as a track in the Text Retrieval Conference (TREC,

Retrieval tasks

In ImageCLEFmed 2005, there are two medical image retrieval tasks. Both tasks will likely require the use of image retrieval techniques for best results. The automatic image annotation task will not contain any text as input for the task and is aimed at image analysis research groups. An image retrieval system (GIFT) is available for the participants who do not have access to one themselves. This page is concerned with the Automatic Annotation Task

Automatic image annotation

Automatic image annotation or image classification can be an important step when searching for images from a database. Base on the IRMA project a database of 9,000 fully classified radiographs taken randomly from medical routine is made available and can be used to train a classification system. 1,000 radiographis for which classification labels are not available to the participants have to be classified. The aim is to find out how well current techniques can identify image modality, body orientation, body region, and biological system examined based on the images. The results of the classification step can be used for multilingual image annotations as well as for DICOM header corrections.

Although only 57 simple class numbers will be provided for ImageCLEFmed 2005. The images are annotated with complete IRMA code, a multi-axial code for image annotation. The code is currently available in English and German. It is planned to use the results of such automatic image annotation tasks for further, textual image retrieval tasks in the future.

Database & Download

Using the access code provided by CLEF, three files can be downloaded from the IRMA server Unzipping the database results in a set of 57 directories (Train01, Train02, ... Train57). As pointed out in the CLEF copyright agreement, the images downloaded by the CLEF access are allowed to be used only for the CLEF competition. If you would like to use the imagery for any other proposes, you have to fill the IRMA transfer agreement.

Submission of Results

For submission of results, the following file format has to be used:

Questions & Comments

If you have any questions or comments on these information, feel free to contact us:
Thomas Deselaers
Last modified: Fri May 20 18:13:10 CEST 2005

Valid HTML 4.01! xemacs logo debian logo ;