News

BRAINTEASER Open Evaluation Challenges launch

Published on: 16/12/2021

BRAINTEASER Open Evaluation Challenges launch
Horizon 2020

The Intelligent Disease Progression Prediction (iDPP) challenge aims at designing and developing an evaluation infrastructure for AI algorithms able to:

●      better describe disease mechanisms;

●      stratify patients according to their phenotype assessed all over the disease evolution;

●      predict disease progression in a probabilistic, time dependent fashion.

By “evaluation infrastructure” we mean experimental collections, evaluation protocols, evaluation measures, ground-truth creation protocols to develop shared approaches, promote the use of common benchmarks, foster the comparability and replicability of the experiments

iDPP will be organized under the umbrella of CLEF (Conference and Labs of the Evaluation Forum), the European initiative for the experimental evaluation of multilingual and multimodal AI algorithms.

iDPP features the following tasks:

●      Pilot Task 1 – Ranking Risk of Impairment: it focuses on ranking of patients based on the risk of impairment in specific domains. More in detail, we will use the ALSFRS-R scale to monitor speech, swallowing, handwriting, dressing/hygiene, walking and respiratory ability in time and it asks participants to rank patients based on time to event risk of experiencing impairment in each specific domain.

●      Pilot Task 2 – Predicting Time of Impairment: it refines Task 1 asking participants to predict when specific impairments will occur (i.e. in the correct time-window). In this regard, we assess model calibration in terms of the ability of the proposed algorithms to estimate a probability of an event close to the true probability within a specified time-window.

●      Position Paper Task 3 – Explainability of AI algorithms: We evaluate proposals of different visualization frameworks able to show the multivariate nature of the data and the model predictions in an explainable, possibly interactive, way.

The final iDPP event will be co-located with CLEF 2022 which will be held in Bologna, Italy, from 5 to 8 September 2022.

Registrations for participating in iDPP@CLEF 2022 are open. 

NEWS​

Related News

HLTH Brought the Energy to Amsterdam. Now It’s Vegas’ Turn.

26 Jun 2025
Next up: HLTH USA, October 19–22 in Las Vegas.

From Abandonment to Belonging: Hands 4Life’s Vision for Generational Healing

26 Jun 2025
Hands 4Life is a nonprofit organization addressing the global aging crisis by empowering communities in economically developing nations—beginning with...

Strengthening Elderly Care Innovation Across Europe: ECHAlliance at the NOTRE Project Meeting in Lille

26 Jun 2025
ECHAlliance participated in the latest partner meeting of the NOTRE Project, hosted in Lille, France by our Hauts-de-France ecosystem led by Eurasanté...

Africa Health Business Co-founder Dr Amit Thakker Honoured with Top Civilian Award

26 Jun 2025
Dr. Amit N. Thakker, Co-founder of our partner Africa Health Business, receives one of the highest civilian awards from the President of Kenya.

Highlights from the Global Health Connector Partners Programme at HLTH Europe 2025

25 Jun 2025
Our Global Health Connector Partners Programme returned to HLTH Europe this June with an energising series of sessions, conversations and connections ...

That’s a Wrap from HIMSS Europe 2025!

24 Jun 2025
From Paris with purpose: Gnomon Informatics SA returned to HIMSS Europe for a third year of bold ideas, smart tech, and stronger-than-ever momentum in...

Become a member

Join ECHAlliance to amplify your organisation’s message, grow your networks, connect with innovators and collaborate globally.
 
First name *
Last Name *
Email Address *
Country *
Position *
First name *
Last Name *
Email Address *
Country *
Position *