ImageCLEF 2021

Motivation

ImageCLEF 2021 is an evaluation campaign that is being organized as part of the CLEF initiative labs. The campaign offers several research tasks that welcome participation from teams around the world. The results of the campaign appear in the working notes proceedings, published by CEUR Workshop Proceedings (CEUR-WS.org). Selected contributions among the participants, will be invited for publication in the following year in the Springer Lecture Notes in Computer Science (LNCS) together with the annual lab overviews.

For the 2021 edition, ImageCLEF organizes 4 main tasks with a global objective of promoting the evaluation of technologies for annotation, indexing and retrieval of visual data with the aim of providing information access to large collections of images in various usage scenarios and application domains: medical, nature, Internet and social media.

Target communities involve (but are not limited to): information retrieval (e.g., text, vision, audio, multimedia, social media, sensor data), machine learning, deep learning, data mining, natural language processing, image and video processing; with special emphasis on the challenges of multi-modality, multi-linguality, and interactive search.

#imageclef, and Facebook @ImageClef.

ImageCLEF schedule

Each of the tasks sets its own schedule, so please check the corresponding task webpage for specific dates. A (tentative) global schedule can be found below:

• 16.11.2020: registration opens for all ImageCLEF tasks
• 18.01.2021: development data release starts (depends on the task)
• 15.03.2021: test data release starts (depends on the task)
• 07.05.2021: deadline for submitting the participants runs (depends on the task)
• 14.05.2021: release of the processed results by the task organizers (depends on the task)
• 28.05.2021: deadline for submission of working notes papers by the participants
• 11.06.2021: notification of acceptance of the working notes papers
• 02.07.2021: camera ready working notes papers
• 21-24.09.2021: CLEF 2021, Bucharest, Romania

The CLEF Conference

ImageCLEF lab and all its tasks are part of the Conference and Labs of the Evaluation Forum: CLEF 2021. CLEF 2021 consists of an independent peer-reviewed workshops on a broad range of challenges in the fields of multilingual and multimodal information access evaluation, and a set of benchmarking activities carried in various labs designed to test different aspects of mono and cross-language information retrieval systems. More details about the conference can be found here. Also there is more information about the Clef Initiative.

Programme of ImageCLEF at the CLEF 2021 Conference

(near final - small changes may still occur)


Plenary Overviews - Tuesday 21 September”
10:00-11:30 (GMT+3)
Chair CLEF: Henning Müller, henning.mueller@hevs.ch
“Overview of the ImageCLEF 2021 Lab”


S1 - Tuesday 21 September
11:30-13:00 (GMT+3) ImageCLEF Overview of Tasks (6 x 15 minutes)
Chair Lab: Henning Müller, Renaud Péteri

1. “Overview of the ImageCLEFmed 2021 Concept & Caption Prediction Task”,
   Christoph M. Friedrich, University of Applied Sciences and Arts Dortmund, Germany
2. “Overview of the VQA-Med Task at ImageCLEF 2021 on Visual Question Answering and Generation in the Medical Domain”,
   Asma Ben Abacha, National Institutes of Health (NIH), USA
3. “Overview of ImageCLEFtuberculosis 2021 --- CT-based Tuberculosis Type Classification”,
   Serge Kozlovski, Belarussian Academy of Sciences, Minsk, Belarus
4. “Overview of ImageCLEFcoral 2021: Coral Reef Image Annotation of a 3D Environment”,
   Jon Chamberlain, University of Essex, UK
5. “Overview of the 2021 ImageCLEFdrawnUI Task: Detection and Recognition of Hand Drawn and Digital Website UIs”,
   Dimitri Fichou, teleportHQ, Romania
6. “Overview of the 2021 ImageCLEFaware Task”,
   Adrian Popescu, CEA LIST, France

S2 - Tuesday 21 September
15:30-17:00 (GMT+3) ImageCLEF VQA (3) & Coral (3) (6 x 15 minutes)
Chair Lab: Asma Ben Abacha

1. “TeamS at VQA-Med 2021: BBN-Orchestra for Long-tailed Medical Visual Question Answering”,
   Sedigheh Eslami, D4L data4life, Germany
2. “SYSU-HCP at VQA-Med 2021: A Data-centric Model with Efficient Training Methodology for Medical Visual Question Answering”,
   Haifan Gong, Sun Yat-sen University, China
3. “SSN MLRG at VQA-MED 2021: An Approach for VQA to Solve Abnormality Related Queries using Improved Datasets”,
   Sheerin Sitara Noor Mohamed>, Sri Sivasubramaniya Nadar College of Engineering, India
4. “A Convolutional Neural Networks based Coral Reef Annotation and Localization”,
   Rohit Raj Gunti, University at Albany, USA
5. “Pixelwise annotation of coral reef substrates”,
   Ioana-Lia Palosanu/Jess Wright, University of Essex, UK
6. “Automatic Coral Reef Annotation, Localization and Pixel-wise Parsing Using Mask R-CNN”,
   Lukáš Soukup>, University of West Bohemia, Czech Republic

S3 - Tuesday 21 September
17:30-19:00 ImageCLEF Caption(4) & DrawnUI (2) (6 x 15 minutes)
Chair Lab: Christoph M. Friedrich, Dimitri Fichou

1. “AUEB NLP Group at ImageCLEFmed Caption Tasks 2021”,
   Foivos Charalampakos and Vasilis Karatzas, Athens University of Economics and Business, Greece
2. “NLIP-Essex-ITESM at ImageCLEFcaption 2021 task : Deep Learning-based Information Retrieval and Multi-label Classification towards improving Medical Image Understanding”,
   Janadhip Jacutprakart, University of Essex, UK
3. "PUC Chile team at Caption Prediction: ResNet visual encoding and caption classification with Parametric ReLU",
   Vicente Castro, Pontificia Universidad de Chile, Chile
4. “AEHRC CSIRO at ImageCLEFmed Caption 2021”,
   Aaron Nicolson, Australian e-Health Research Centre, Australia
5. "UI element detection from wireframe drawings of websites",
   Prasang Gupta, PwC US Advisory, Mumbai, India
6. “Improving web user interface element detection using Faster R-CNN”,
   Jiří Vyskočil, Department of Cybernetics, Faculty of Applied Sciences, University of West Bohemia, Czech Republic

S4 - Wednesday 22 September
11:30-13:00 (GMT+3) ImageCLEF Tuberculosis (2) & feedback (2 x 15 + 60 minutes)
Chair Lab: Bogdan Ionescu, Henning Müller, Renaud Péteri

1. “Identifying tuberculosis type in CTs”,
   Cosmin Moisii, SenticLab, Iasi, Romania, Faculty of Computer Science, "Alexandru Ioan Cuza" University of Iasi, Romania
2. “Classification of Tuberculosis Type on CT Scans of Lungs using a fusion of 2D and 3D Deep Convolutional Neural Networks”,
   Emad Aghajanzadeh and Behzad Shomali, Computer Engineering Department, Ferdowsi University of Mashhad, Mashhad, Iran
3. “ImageCLEF feedback session. Everybody is invited to join“,
   Moderator: Bogdan Ionescu, University Politehnica of Bucharest, Romania

Participant registration

1. Each participant has to register on (https://www.aicrowd.com) with username, email and password. A representative team name should be used
   as username.
2. In order to be compliant with the CLEF requirements, participants also have to fill in the following additional fields on their profile:
   • First name
   • Last name
   • Affiliation
   • Address
   • City
   • Country

3. Participants now have to access the 'Resources tab' on the challenge page, where they find a download link to the task's End User Agreement (EUA). At the same place they will also be able to upload a filled in and signed EUA.

   Participants have to fill in and submit one EUA for each ImageCLEF task they want to participate in. An ImageCLEF participant is considered as registered for a task as soon as he/she has uploaded a valid EUA that was approved by an ImageCLEF organizer (examples of how the EUAs for the medical task should be filled in can be found here: Caption 2019 EUA example, Tuberculosis 2019 EUA example and VQA 2019 EUA example).

   Registrations are handled on a per-task basis. This means if a task has multiple challenges (subtasks), a participant can automatically access the data of all challenges in that task because there is one common dataset per task. We do not separate datasets on a per-challenge basis.

PS: You do not have to remember all of the steps mentioned above as you will be given instructions on what to do as soon as you try to access a challenge's 'Resouces' tab.

The Tasks

ImageCLEF 2021 proposes 4 main tasks:

• ImageCLEFcoral: The increasing use of structure-from-motion photogrammetry for modelling large-scale environments from action cameras has driven the next generation of visualization techniques. The task addresses the problem of automatically segmenting and labeling a collection of images that can be used in combination to create 3D models for the monitoring of coral reefs.
• ImageCLEFmedical: Medical images can be used in a variety of scenarios and this task will combine the most popular medical tasks of ImageCLEF and continue the last year idea of combining various applications, namely: automatic image captioning and scene understanding, medical visual question answering and decision support on tuberculosis. This allows to explore synergies between the tasks.
• ImageCLEFdrawnUI: Enabling people to create websites by drawing them on a piece of paper can make the webpage building process more accessible. The task addresses the problem of automatically recognizing hand drawn objects representing website UIs, that will be further translated into automatic website code.
• ImageCLEFaware: The images available on social networks can be exploited in ways users are unaware of when initially shared, including situations that have serious consequences for the users’ real lives. The task addresses the development of algorithms which raise the users’ awareness about real-life impact of online image sharing.

Overview Paper

[] Bogdan Ionescu, Henning Müller, Renaud Péteri, Asma Ben Abacha, Mourad Sarrouti, Dina Demner-Fushman, Sadid A. Hasan, Serge Kozlovski, Vitali Liauchuk, Yashin Dicente, Vassili Kovalev, Obioma Pelka, Alba García Seco de Herrera, Janadhip Jacutprakart, Christoph M. Friedrich, Raul Berari, Andrei Tauteanu, Dimitri Fichou, Paul Brie, Mihai Dogariu, Liviu Daniel Ştefan, Mihai Gabriel Constantin, Jon Chamberlain, Antonio Campello, Adrian Clark, Thomas A. Oliver, Hassan Moustahfid, Adrian Popescu, Jérôme Deshayes-Chossart, Overview of the ImageCLEF 2021: Multimedia Retrieval in Medical, Nature, Internet and Social Media Applications, in Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the 12th International Conference of the CLEF Association (CLEF 2021), Bucharest, Romania, Springer Lecture Notes in Computer Science LNCS, September 21-24, 2021.

@inproceedings{ImageCLEF2021,<\br>
author = {Bogdan Ionescu and Henning M\"uller and Renaud P\’{e}teri and Asma {Ben Abacha} and Mourad Sarrouti and Dina Demner-Fushman and Sadid A. Hasan and Serge Kozlovski and Vitali Liauchuk and Yashin Dicente and Vassili Kovalev and Obioma Pelka and Alba Garc\’{\i}a Seco de Herrera and Janadhip Jacutprakart and Christoph M. Friedrich and Raul Berari and Andrei Tauteanu and Dimitri Fichou and Paul Brie and Mihai Dogariu and Liviu Daniel \c{S}tefan and Mihai Gabriel Constantin and Jon Chamberlain and Antonio Campello and Adrian Clark and Thomas A. Oliver and Hassan Moustahfid and Adrian Popescu and J\’{e}r\^{o}me Deshayes-Chossart},<\br>
title = {{Overview of the ImageCLEF 2021}: Multimedia Retrieval in Medical, Nature, Internet and Social Media Applications},<\br>
booktitle = {Experimental IR Meets Multilinguality, Multimodality, and Interaction},<\br>
series = {Proceedings of the 12th International Conference of the CLEF Association (CLEF 2021)},<\br>
year = 2021,<\br>
volume = {},<\br>
publisher = {{LNCS} Lecture Notes in Computer Science, Springer},<\br>
pages = {},<\br>
month = {September 21-24},<\br>
address = {Bucharest, Romania}<\br>
}<\br>

The Organising Committee

Overall coordination

• Bogdan Ionescu <bogdan.ionescu(at)upb.ro>, University Politehnica of Bucharest, Romania
• Henning Müller <henning.mueller(at)hevs.ch>, University of Applied Sciences Western Switzerland, Sierre, Switzerland
• Renaud Péteri <renaud.peteri(at)univ-lr.fr>, University of La Rochelle, France

Technical support

• Ivan Eggel <ivan.eggel(at)hevs.ch>, University of Applied Sciences Western Switzerland, Sierre, Switzerland
• Mihai Dogariu <dogariu_mihai8(at)yahoo.com>, University Politehnica of Bucharest, Romania