The New Lab of CLEF Dedicated To Life Media

Results Publication

The overview paper (Springer) summarizing the results of all LifeCLEF 2014 tasks is available here:

or here (PDF)

Individual working notes of tasks organizers and participants can be found within CLEF 2015 CEUR-WS proceedings.

LifeCLEF 2014 Workshop Agenda

Monday 15/09/2014

15:30 - 18:00 CLEF labs overview session with one slot for LifeCLEF
18:30 - 19:30 poster session for all CLEF labs and welcome reception

Wednesday 17/09/2014

10:00 - 10:30 Posters session (main conference break)

13:30 → 15:30 LifeCLEF session 1 (Chair: Alexis Joly)

13:30 - 14:00 Opening / Keynote - Interactive Plant identification and Collaborative Information System - Daniel Barthelemy
14:00 - 14:30 Bird Task Overview - Hervé Glotin
14:30 - 15:00 Plant Task Overview - Pierre Bonnet
15:00 - 15:30 Fish Task Overview - Concetto Spampinatto

15:30 - 16:00 Posters session (main conference break)

16:00 → 18:00 LifeCLEF participants session (Chair: Concetto Spampinatto)

16:00 - 16:20 Bird Task Participant 1 - QMUL (Dan Stowell)
16:20 - 16:40 Plant Task Participant 1 - IBM AU (Qiang Shen)
17:00 - 17:20 Fish & Plant participant - I3S (Katy Blanc)
16:40 - 17:00 Bird Participant 2 - MNB TSA (Mario Lasseck, to be confirmed)
17:20 - 17:40 Plant & Bird participant - INRIA (Alexis Joly)

Thursday 18/09/2014

10:30 → 12:00 - LifeCLEF session 2 (Chair: Hervé Glotin)

10:00 - 10:25 Xeno-canto presentation (Sander Pieterse)
10:25 - 11:25 LifeCLEF 2014 participants feedbacks (animated by Alexis Joly)
- problems / suggestions on the overall organisation
- problems / suggestions task by task
- suggestions for next years (new tasks, etc.)
11:25 - 12:00 - Towards participatory sensing ecological surveillance (introduced and animated by Pierre Bonnet)

Registration

Registration for LifeCLEF 2014 is open. To do so, please register to the following system that you will be used to access the evaluation data and to collect the runs:

• For people already registered to ImageCLEF (this year or in the past), you can transfer your registration details to CLEF 2014 here.
• If you have not registered in the past or you do not want to transfer your details, you can register for CLEF 2014 here.

01.12.2013: registration opens
15.11.2013: data samples and task objectives available
15.01.2014: training data and task details release (depends on the task)
15.03.2014: test data release (depends on the task)
01.05.2014: deadline for submission of runs (depends on the task)
15.05.2014: release of results (depends on the task)
07.06.2014: deadline for submission of working notes
15-19.09.2014: CLEF 2014 Conference (UK, Sheffield)

Motivation

Building accurate knowledge of the identity, the geographic distribution and the evolution of living species is essential for a sustainable development of humanity as well as for biodiversity conservation. Unfortunately, such basic information is often only partially available for professional stakeholders, teachers, scientists and citizens, and often incomplete for ecosystems that possess the highest diversity. A noticeable cause and consequence of this sparse knowledge is that identifying living plants or animals is usually impossible for the general public, and often a difficult task for professionals, such as farmers, fish farmer or foresters and even also for the naturalists and specialists themselves. This taxonomic gap was actually identified as one of the main ecological challenges to be solved during the Rio’s United Nations Conference in 1992.

In this context, using multimedia identification tools is considered as one of the most promising solution to help bridging the taxonomic gap and also being language independent. With the recent advances in digital devices/equipment, network bandwidth and information storage capacities, the production of multimedia data has indeed become an easy task. In parallel, the emergence of citizen sciences and social networking tools has fostered the creation of large and structured communities of nature observers (e.g. e-bird, xeno-canto, Tela Botanica, etc.) who started to produce outstanding collections of multimedia records. Unfortunately, the performance of the state-of-the-art multimedia analysis techniques on such data is still not well understood and are is far from reaching the real world’s requirements in terms of identification tools. Most existing studies or available tools typically identify a few hundreds of species with moderate accuracy whereas they should be scaled-up to take one or two orders of magnitude more, in terms of number of species (the total number of living species on earth is estimated to be around 10K for birds, 32K for fishes, 300K for plants and more than 1.5M for insects).

The LifeCLEF lab proposes to evaluate these challenges in the continuity of the image-based plant identification task that was run within ImageCLEF lab during the last three years with an increasing number of participants. It will however radically enlarge the evaluated challenge towards multimodal data by (i) considering birds and fish in addition to plants (ii) considering audio and video contents in addition to images (iii) scaling-up the evaluation data to hundreds of thousands of life media records and thousands of living species.

More concretely, the lab is organized around three tasks:

• BirdCLEF: an audio record-based bird identification task
• PlantCLEF: an image-based plant identification task
• FishCLEF: a video-based fish identification task

As described in more details above, each task will be based on large and real-world data and the measured challenges will be defined in collaboration with biologists and environmental stakeholders so as to reflect realistic usage scenarios.

Taxonomic names are the primary key to organize life species and to access all available information about them either on the web, or in herbariums, in scientific literature, books or magazines, etc. Identifying the taxon observed in a given multimedia record and aligning its name with a taxonomic reference is therefore a key step before any other indexing or information retrieval tasks. The year following the launch of the lab could involve more complex information search challenges in the data (for instance species duplicate discovery or ambiguous species detection).

The content-based approach to life species identification is intrinsically language independent and might solve many of the multi-lingual issues related to the use of classical text-based morphological keys that are strongly language dependent and that are understandable only by few experts in the world.

Each task of the the lab is inherently cross-modal through the presence of contextual and social data associated to the multimedia content, including geo-tags or location names, time information, author names, collaborative ratings or comments, vernacular names, organ or picture type tags, individual specimen identifier, etc.

Thanks to the multimodality of the three tasks of the lab, we hope bridging the barriers between the different information retrieval communities (text, image, music, etc.) and foster the emergence of a new trans-disciplinary community focused on life media retrieval.

lifeclef@inria.fr

Overall coordination

• Alexis Joly, INRIA Sophia-Antipolis - ZENITH team, Montpellier, France, alexis.joly(replace-by-an-arrobe)inria.fr
• Henning Müller, University of Applied Sciences Western Switzerland in Sierre, Switzerland, henning.mueller(replace-by-an-arrobe)hevs.ch

BirdCLEF

• Hervé Glotin, University of Toulon, France, glotin(replace-by-an-arrobe)univ-tln.fr
• Hervé Goëau, Inria, France, herve.goeau(replace-by-an-arrobe)inria.fr
• Andreas Rauber, TU Wien, Austria, rauber(replace-by-an-arrobe)ifs.tuwien.ac.at
• Willem-Pier Vellinga, Xeno-Canto foundation for nature sounds, The Netherlands, wp(replace-by-an-arrobe)xeno-canto.org

PlantCLEF

• Hervé Goëau, Inria, France, herve.goeau(replace-by-an-arrobe)inria.fr
• Alexis Joly, Inria ZENITH Team, Paris, France: alexis.joly(replace-by-an-arrobe)inria.fr
• Pierre Bonnet, Cirad – AMAP, Montpellier, France, pierre.bonnet(replace-by-an-arrobe)cirad.fr

FishCLEF

• Concetto Spampinato, University of Catania, Italy, cspampin(replace-by-an-arrobe)dieei.unict.it
• Robert Fisher, University of Edinburgh, UK, rbf(replace-by-an-arrobe)inf.ed.ac.uk
• Bastian Boom, University of Edinburgh, UK, bboom(replace-by-an-arrobe)inf.ed.ac.uk

Technical support

• Ivan Eggel, University of Applied Sciences Western Switzerland, Sierre, Switzerland, ivan.eggel(replace-by-an-arrobe)hevs.ch