News

BRAINTEASER Press Release – Unleashing the IDPP@CLEF Potential: Assessing Predictive Algorithms and Enabling Data Sharing for Enhanced Research

BRAINTEASER Press Release – Unleashing the IDPP@CLEF Potential: Assessing Predictive Algorithms and Enabling Data Sharing for Enhanced Research
Projects

Every year, the BRAINTEASER project organizes an open evaluation challenge, called iDPP@CLEF (Intelligent Disease Progression Prediction), to involve research groups from academia and industry in the assessment of the performance of their AI algorithms to predict the progression of ALS and MS.

These challenges are open to anyone wishing to participate and they are built around real clinical and sensor data (properly anonymized), provided by the clinical partners in our consortium.

The challenges represent a unique opportunity for researchers to access highly curated data and discuss their own approaches with other researchers interested in the same topics. Indeed, since all the groups participating in a challenge operate on the same datasets, it is possible to directly contrast the performance of all the proposed approaches and solutions, in order to comparatively understand what works best and what does not work.

Every year we organize a workshop at the end of the challenge, where participants can meet and discuss together face-to-face what they did, what worked and why. Moreover, peer-reviewed papers by participants, describing their approaches, and overview papers by organizers, summarizing the main findings of each edition, are published online in the CEUR-WS proceedings series, which grants free and open access to all of them. In this way, we accelerate knowledge transfer and impact both inside and outside the project, because the best-of-breed approaches are quickly shared with everyone interested in the research community, but also industry, policy makers, and even general public, if concerned. Least, but not last, the challenge helps in building a cohesive research community, allowing them to network and learn from each other, and lays the foundations for a durable impact in the field, also after the end of the project.

This year, in the iDPP@CLEF 2023 challenge, we organized three tasks: two of them were focused on the progression of MS and one of them on the progression of ALS. The first task dealt with the prediction of MS worsening, according to clinical standards formulated on the EDSS (Expanded Disability Status Scale) score.

The second task built on the first one and investigated the probability of MS worsening in a time window, say 2, 4, 6 or 8 years. The third task explored the impact of pollutants on the worsening of ALS and whether they were useful to predict time to PEG (Percutaneous Endoscopic Gastrostomy), NIV (Non-Invasive Ventilation), or death.

Data and their quality are key concerns for BRAINTEASER, since both the predictive AI algorithms developed by the consortium and the open evaluation challenges revolve around them. To this end, BRAINTEASER fully embraces the Open Science and FAIR (Findable, Accessible, Interoperable, Reusable) principles and puts lots of effort in curating the developed datasets. This happens through various means: we designed an ontology to semantically model the clinical and sensor data we work with and to ensure their correctness; when ingesting clinical and sensor data into the knowledge base informed by our ontology, we adopt strict cleaning and filtering procedures to ensure the correctness of the ingested instances; the training and test data we use internally and in the challenges are then derived from such highly curated knowledge base; and, finally, the challenges themselves represent a further validation of our datasets, since external research groups access the datasets and can verify that they are appropriate for developing AI algorithms.

Since data are the fuel of research, after all the above quality checks and curation steps, we release our datasets for free to anyone wishing to conduct further research by sharing and integrating them in the European Open Science Cloud (EOSC) via Zenodo. However, we do not simply put our datasets out there in the wide but we share them in a responsible way. Indeed, we ask requesters to submit a project describing which use and what kind of inferences they plan to do with our data and a committee of experts (both medical doctors and computer scientists) verifies that the intended use of the data is up to high ethical, clinical, and scientific standards.

Listen to Nicola Ferro, Challenge organiser and full-time computer science professor (University of Padua – IT) to have more precious insights about this BRAINTEASER initiative!


BRAINTEASER is a project, funded by the European Horizon 2020 program, which intends to exploit the value of clinical data, completely anonymized and integrated with personal and environmental data collected through smartwatches and low-cost environmental sensors. BRAINTEASER uses this data to develop clinical software and mobile applications to support patients with amyotrophic lateral sclerosis (ALS) and multiple sclerosis (MS), their clinicians and families.

NEWS​

Related News

4C Accelerator – Apply for the free qualification program for MedTech startups

12 Dec 2024
Until January 17, 2025 founders in the MedTech sector can apply for the free & funded “4C Accelerator”. The programm enables founders in the MedTe...

Future4care International Call4Applications 2025 – Now Open!

10 Dec 2024
Are you a digital health startup looking to expand into France and Germany? Don’t miss the opportunity to join Future4care’s one-year, equity-free acc...

AGE-WELL, Canada’s technology and aging network, releases its 2023-2024 Annual Report

10 Dec 2024
Hot off the digital press, the latest AGE-WELL annual report, AgeTech for Aging Well, showcases recent activities and accomplishments from across the ...

Kuopio Health’s member is a pioneer in sustained-release delivery technology for the treatment of eye diseases

9 Dec 2024
ReBio Technologies is a biotechnology company established in 2015 with a focus on sustained-release delivery technology, especially in the treatment o...

From Portugal to the World: 2024 in review, 2025 horizon

9 Dec 2024
Health Portugal has united the Portuguese health value chain, nearly doubling exports between 2020 and 2023. The brand’s 2024 milestones include globa...

Have your say: Online Public Consultation for the development of a future Skills Strategy for the healthcare sector

4 Dec 2024

Become a member

Join ECHAlliance to amplify your organisation’s message, grow your networks, connect with innovators and collaborate globally.
 
First name *
Last Name *
Email Address *
Country *
Position *
First name *
Last Name *
Email Address *
Country *
Position *