News

BRAINTEASER Open Evaluation Challenges launch

Published on: 16/12/2021

BRAINTEASER Open Evaluation Challenges launch
Horizon 2020

The Intelligent Disease Progression Prediction (iDPP) challenge aims at designing and developing an evaluation infrastructure for AI algorithms able to:

●      better describe disease mechanisms;

●      stratify patients according to their phenotype assessed all over the disease evolution;

●      predict disease progression in a probabilistic, time dependent fashion.

By “evaluation infrastructure” we mean experimental collections, evaluation protocols, evaluation measures, ground-truth creation protocols to develop shared approaches, promote the use of common benchmarks, foster the comparability and replicability of the experiments

iDPP will be organized under the umbrella of CLEF (Conference and Labs of the Evaluation Forum), the European initiative for the experimental evaluation of multilingual and multimodal AI algorithms.

iDPP features the following tasks:

●      Pilot Task 1 – Ranking Risk of Impairment: it focuses on ranking of patients based on the risk of impairment in specific domains. More in detail, we will use the ALSFRS-R scale to monitor speech, swallowing, handwriting, dressing/hygiene, walking and respiratory ability in time and it asks participants to rank patients based on time to event risk of experiencing impairment in each specific domain.

●      Pilot Task 2 – Predicting Time of Impairment: it refines Task 1 asking participants to predict when specific impairments will occur (i.e. in the correct time-window). In this regard, we assess model calibration in terms of the ability of the proposed algorithms to estimate a probability of an event close to the true probability within a specified time-window.

●      Position Paper Task 3 – Explainability of AI algorithms: We evaluate proposals of different visualization frameworks able to show the multivariate nature of the data and the model predictions in an explainable, possibly interactive, way.

The final iDPP event will be co-located with CLEF 2022 which will be held in Bologna, Italy, from 5 to 8 September 2022.

Registrations for participating in iDPP@CLEF 2022 are open. 

NEWS​

Related News

InnoHSupport Open Calls

1 Jul 2025
Welcome to the InnoHSupport Open Calls!

Transformative Health Instrument Call 2025

1 Jul 2025
Apply to the Transformative Health Instrument (THI) Call 2025 if you are a growing and innovative healthcare start-up working on solutions that have s...

Longitude Prize on ALS

1 Jul 2025
The £7.5 million (~$10 million) Longitude Prize on ALS incentivises the use of AI-based approaches to transform drug discovery for amyotrophic lateral...

Applications Now Open: Spread & Scale Academy

1 Jul 2025
Do you have an innovation or solution that’s working well in one place and could make a difference elsewhere?

Securing funding for your innovation: The bid lifecycle

1 Jul 2025
This blog is the second instalment in our Bid Lifecycle series, where we explore the key stages involved in securing funding for innovative healthcare...

HLTH Brought the Energy to Amsterdam. Now It’s Vegas’ Turn.

26 Jun 2025
Next up: HLTH USA, October 19–22 in Las Vegas.

Become a member

Join ECHAlliance to amplify your organisation’s message, grow your networks, connect with innovators and collaborate globally.
 
First name *
Last Name *
Email Address *
Country *
Position *
First name *
Last Name *
Email Address *
Country *
Position *