Delphi hackathon – a new approach to develop Core Outcome Sets for blood cancers

Background: The Delphi technique is a well-known and accepted method to reach consensus. However, major challenges in Delphi studies include recruiting suitable participants and avoiding a loss of participants between survey rounds. To mitigate these challenges, we present the Delphi hackathon as a new method to conduct Delphi studies. We have used this new approach to develop Core Outcome Sets for hematologic malignancies within the scope of the HARMONY Plus project - as part of the HARMONY Alliance. The HARMONY Alliance is a public-private European Network established in 2017, which currently includes 53 partners and 140 associated members from 19 countries. Amongst many other goals of the HARMONY Alliance, Work Package 2 focuses on defining outcomes that are relevant to each hematological malignancy.MethodsIn the style of a classic hackathon, known from software development, we organized two virtual meetings where all participants simultaneously filled out the online Delphi surveys, followed by a third virtual meeting to reach final consensus. The recruitment was done by advertising and providing information via the HARMONY communication team and patient umbrella organizations.DiscussionBig challenges shown in previous Delphi surveys such as recruitment of the various stakeholders and their continued participation in the various Delphi rounds could be addressed by the new Delphi hackathon approach.

Contributors

E. d. W. Katharina M Lang1 , Tamás Bereczky 3 , Katy Harrison 4 , Jan Geissler 3 , Natacha Bolanos 5 , Guillermo Sanz 6 , Yann Guillevic7 , Jesus Maria Hernandez Rivas8 , Martje Barbus9 Renate Schulze-Rath11 and Lars Bullinger

Publication

Journal: HARMONY Alliance
Volume:
Issue:
Pages: -
Year: 2023
DOI:

Further Study Information

Current Stage: Completed
Date:
Funding source(s): The HARMONY Alliance - HARMONY and HARMONY PLUS - are funded through the Innovative Medicines Initiative (IMI) – per 2022 called Innovative Health Initiative (IHI). Funding is received from the IMI 2 Joint Undertaking and is listed under grant agreement for HARMONY No. 116026 and grant agreement for HARMONY PLUS No. 945406. This Joint Undertaking receives support from the European Union’s Horizon 2020 Research and Innovation Programme and the European Federation of Pharmaceutical Industries and Associations (EFPIA). An additional cash grant has been obtained from Bayer AG for conducting the Delphi survey development. The manuscript was written and reviewed from different EFPIA members and members of the HARMONY Alliance, who were also involved in study design.


Health Area

Disease Category: Blood disorders

Disease Name:

Target Population

Age Range: Unknown

Sex:

Nature of Intervention:

Stakeholders Involved

- Clinical experts
- Consumers (patients)
- Pharmaceutical industry representatives
- Regulatory agency representatives

Study Type

- COS methods research

Method(s)

- Consensus meeting
- Delphi process
- Literature review
- Survey

In the style of a classic hackathon, known from software development, we organized two virtual meetings where all participants simultaneously filled out the online Delphi surveys, followed by a third virtual meeting to reach final consensus. The recruitment was done by advertising and providing information via the HARMONY communication team and patient umbrella organizations