ImageCLEF 2015

Motivation

ImageCLEF 2015 is an evaluation campaign which is being organized as part of The CLEF Initiative labs. The results of this campaign, including selected works among the participants, will be presented in the Conference and Labs of the Evaluation Forum (CLEF) 2015 which will be held in the city of Toulouse in France, 8-11 September 2015. For the 2015 edition, ImageCLEF will organize four main tasks with a global objective of benchmarking automatic annotation and indexing of images. The tasks tackle different aspects of the annotation problem and are aimed at supporting and promoting cutting-edge research addressing the key challenges in the field. A wide range of source images and annotation objectives are considered, such as general multi-domain images for object or concept detection, as well as domain-specific tasks such as labelling and separation of compound figures from biomedical literature and volumetric medical images for automated structured reporting.

Schedule

Each of the tasks sets its own schedule, so please check the corresponding task webpage for specific dates. A (tentative) global schedule can be found below:

• 12.11.2014: registration opens for all ImageCLEF tasks (until 30.04.2015)
• 15.11.2014: development data release starts (depends on the task)
• 15.03.2015: test data release starts (depends on the task)
• 01.05.2015: deadline for submission of runs by the participants (depends on the task)
• 15.05.2015: release of processed results by the task organizers (depends on the task)
• 07.06.2015: deadline for submission of working notes papers by the participants
• 30.06.2015: notification of acceptance of the working notes papers
• 15.07.2015: camera ready working notes papers
• 08.-11.09.2015: CLEF 2015, Toulouse, France

Registration

Registration for ImageCLEF 2015 is now open and will stay open until April 30, 2015. To register please download and complete the end user agreement. Then scan and send it by email to the following address: Alba García <alba.garcia@essex.ac.uk>.

You also need to register in the following system in order to access the evaluation data and submit the runs.

• If you have not registered in the past or have changed affiliation you can register for 2015 here.
• For people already registered in the past, you can transfer your registration details to CLEF 2015 here.

Once registered and the signature validated, data access details can be found at the ImageCLEF system -> Collections .

The CLEF Conference

ImageCLEF lab and all its tasks are part of the Conference and Labs of the Evaluation Forum: CLEF 2015. CLEF 2015 consists of an independent peer-reviewed conference on a broad range of issues in the fields of multilingual and multimodal information access evaluation, and a set of benchmarking activities carried in various Tracks designed to test different aspects of mono and cross-language Information retrieval systems. More details about the conference can be found here. Also there is more information about the Clef Initiative.

ImageCLEF 2015 workshop programme (part of CLEF 2015 programme)

Click here for the full programme of CLEF
Tuesday September 8
10:30 → 12:30 - Labs overview session 1

• 10:30-10:55 General Overview of ImageCLEF 2015 - Mauricio Villegas
  [paper] [slides]

Wednesday September 9
8:30 → 10:30 - Tasks overview session - Chair: Mauricio Villegas

• 8:30-9:00 Overview of the Scalable Concept Image Annotation Task - Luca Piras and Emmanuel Dellandrea
  [paper] [slides]
• 9:00-9:30 Overview of the Medical Classification Task - Alba García Seco de Herrera
  [paper] [slides]
• 9:30-10:00 Overview of the Medical Clustering Task - M Ashraful Amin
  [paper] [slides]
• 10:00-10:30 Overview of the Liver CT Image Annotation Task - Alba García Seco de Herrera
  [paper] [slides]

11:00 → 13:00 - Participants oral session 1 - Chair: Luca Liras

• 11:00-11:20 "Modelling Approaches and Results of the FHDO Biomedical Computer Science Group at ImageCLEF Medical Classification", Biomedical Computer Science Group, FHDO - Obioma Pelka
  (Medical classification task) [paper] [slides]
• 11:20-11:40 "X-ray image body part clustering using deep convolutional neural network", SNUMedInfo, Seoul National University - Sungbin Choi
  (Medical clustering task) [paper] [slides]
• 11:40-12:00 CREDOM Group, Tlemcen University - Imane Nedjar
  (Liver CT annotation task) [paper]
• 12:00-12:20 "Hybrid Learning Framework for Large-Scale Web Image Annotation and Localization", IVA Group, Chinese Academy of Sciences - Yong Li
  (Image annotation task) [paper] [slides]
• 12:20-12:40 "Automatic Image Annotation using Weakly Labelled Web Data", Social Media and Internet Vision Analytics Lab (SMIVA), Singapore -
  (Image annotation task) [paper]
• 12:40-13:00 "Concept Detection with Blind Localization Proposals", CNRS TELECOM - Hichem Sahbi
  (Image annotation task) [paper] [slides]

16:00 → 16:30 - Participants poster session

• "Biomedical Multipanel Figure Separation", US National Library of Medicine (NLM) -
  (Medical classification task) [paper]
• "Medical Image Classification via 2D color feature based Covariance Descriptors", CMTECH (UPF), Universitat Pompeu Fabra - Pol Cirujeda
  (Medical classification task) [paper]
• "AAUITEC at ImageCLEF 2015: Compound Figure Separation", AAUITEC - Mario Taschwer
  (Medical classification task) [paper]
• "Modelling Approaches and Results of the FHDO Biomedical Computer Science Group at ImageCLEF Medical Classification", Biomedical Computer Science Group, FHDO - Obioma Pelka
  (Medical classification task) [paper]
• "Image representation through Tensor decomposition", Intelligent and Interactive Systems (IIS), University of Innsbruck - Sabrina Fontanella
  (Medical classification task) [paper]
• "CIS UDEL Working Notes on ImageCLEF 2015: Compound figure detection task", CIS UDEL, University of Delaware -
  (Medical classification task) [paper]
• IBM Research, Australia - Mani Abedini
  (Medical clustering task) [paper]
• "Convolutional Neutral Networks for Medical Clustering and Classification" - Ashnil Kumar
  (Medical clustering and classification tasks) [paper1] [paper2]
• "Hybrid Learning Framework for Large-Scale Web Image Annotation and Localization", IVA Group, Chinese Academy of Sciences -
  (Image annotation task) [paper]
• "INAOE-UNAL at ImageCLEF 2015: Scalable Concept Image Annotation", INAOE-UNAL - Luis Pellegrin
  (Image annotation task) [paper]
• "Concept Detection with Blind Localization Proposals", CNRS TELECOM - Hichem Sahbi
  (Image annotation task) [paper]
• "Regimvid at ImageCLEF 2015 Scalable Concept Image Annotation Task: Ontology based Hierarchical Image Annotation" - Mohamed Zarka
  (Image annotation task) [paper]

Thursday September 10
13:30 → 14:30 - Joint ImageCLEF / eHealth / BioASQ session

• 13:30 → 14:30 - Panel session "Challenges and synergies in the evaluation of health IR/IE"

14:30 → 15:00 - Participants oral session 2 - Chair: M Ashraful Amin

• 14:30-14:50 "Image representation through Tensor decomposition", Intelligent and Interactive Systems (IIS), University of Innsbruck - Sabrina Fontanella
  (Medical classification task) [paper]
• 14:50-15:10 IBM Research, Australia - Mani Abedini
  (Medical clustering task) [paper]

15:10 → 15:30 - Closing session

• 15:10-15:30 Participant feedback and discussion on the future of ImageCLEF

The Tasks

There are 4 main tasks

• Image Annotation A task aimed at the development of systems for automatic multi-concept image annotation, localization and subsequent sentence description generation.
• Medical Classification Addresses the problem of labelling and separation of compound figures from biomedical literature.
• Medical Clustering Addresses the problem of clustering body parts x-rays.
• Liver CT Annotation A study towards automated structured reporting, the task is computer aided automatic annotation of liver CT volumes by filling in a pre-prepared form.

The Organising Committee

Overall coordination

• Mauricio Villegas, Universidad Politécnica de Valencia, Spain, mauvilsa(replace-by-an-at)upv.es
• Henning Müller, University of Applied Sciences Western Switzerland in Sierre, Switzerland, henning.mueller(replace-by-an-at)hevs.ch

Technical support

• Ivan Eggel, University of Applied Sciences Western Switzerland, Sierre, Switzerland, ivan.eggel(replace-by-an-arrobe)hevs.ch

Image Annotation Task

• Andrew Gilbert, University of Surrey, UK, a.gilbert(replace-by-an-at)surrey.ac.uk
• Luca Piras, University of Cagliari, Cagliari, Italy, luca.piras(replace-by-an-at)diee.unica.it
• The ViSen consortium, main contact Krystian MIkolajczyk, k.mikolajczyk(replace-by-an-at)surrey.ac.uk
• Mauricio Villegas, Universidad Politécnica de Valencia, Spain, mauvilsa(replace-by-an-at)upv.es

Medical Classification Task

• Alba García Seco de Herrera, University of Applied Sciences Western Switzerland in Sierre, Switzerland, alba.garcia(replace-by-an-at)hevs.ch
• Stefano Bromuri, University of Applied Sciences Western Switzerland in Sierre, Switzerland, stefano.bromuri(replace-by-an-at)hevs.ch

Medical Clustering Task

• M. Ashraful Amin , PhD , Independent University, Bangladesh, aminmdashraful(replace-by-an-at)gmail.com
• Mahmood Kazi Mohammed , Sir Salimullah Medical College, Dhaka, Bangladesh

Liver CT Annotation Task

• Burak Acar, PhD, Bogazici University, EE Dept., Istanbul, Turkey, acarbu(replace-by-an-at)boun.edu.tr
• Suzan Uskudarli, PhD, Bogazici University, CmpE Dept., Istanbul, Turkey, suzan.uskudarli(replace-by-an-at)boun.edu.tr
• Neda B. Marvasti, PhD student, Bogazici University, EE Dept., Istanbul, Turkey. neda.marvasti(replace-by-an-at)boun.edu.tr
• Jose F. Aldana, University of Malaga, Malaga, Spain, jfam(replace-by-an-at)lcc.uma.es
• Maria del Mar Roldan Garcia, University of Malaga, Malaga, Spain, mmar(replace-by-an-at)lcc.uma.es