Full text
Vol.:(0123456789) Journal of Healthcare Informatics Research https://doi.org/10.1007/s41666-025-00199-4 RESEARCH ARTICLE Key Components ofParticipatory Design Workshops forDigital Health Solutions: Nominal Group Technique andFeasibility Study KerstinDenecke1· OctavioRivera‑Romero2,3· GuidoGiunti4,5· KarinVanHolten6· EliaGabarron7 Received: 6 February 2025 / Revised: 19 April 2025 / Accepted: 5 May 2025 © The Author(s) 2025 Abstract Participatory design (PD) is an essential method in the development of digital health solutions since it promises to increase acceptance, usability, and trust in the developed solution. Although careful planning and preparation is crucial for the success of PD workshops, a framework of key components to consider is still missing. The objective of this work is to develop such framework enriched with examples for aspects to be considered when planning and conducting PD workshops for designing and developing digital interventions in healthcare. We applied the nominal group technique with four participants with backgrounds in computer science, health informatics, psychology, and social anthropology to identify key components of PD workshops. The resulting framework was applied by an expert in PD to a case of a digital health solution for fatigue self-management for multiple sclerosis. The feasibility and applicability of the framework and its shortcomings were assessed. As a result, a framework consisting of five main categories and a total of 36 factors were assigned and defined in relation to the categories. The categories are participatory process, involved persons and their roles, workshop definition, setting, privacy and ethics, including regulations. The application of the framework to the test case demonstrated the feasibility and applicability of the suggested framework as well as the shortcomings of the analyzed PD process. This framework provides practical guidance while highlighting the complexity of PD workshops, encouraging their broad adoption, critical reflection, and continuous refinement. It has potential to improve the conduct of PD workshops and, in this way, potential to improve usability, acceptance, and usefulness of digital health solutions. In future work, the user perspective could be used to extend the framework. Keywords Participatory design· Workshop· Digital health· Framework· Co-design· Co-production Extended author information available on the last page of the article
Journal of Healthcare Informatics Research Abbreviations MS Multiple sclerosis PD Participatory design PPI Patient and public involvement 1 Introduction The use of digital tools such as apps, social media, websites, and chatbots is becoming increasingly common in healthcare, particularly in mental health, but also in other areas of healthcare dealing with a wide range of health challenges [1–3]. This trend is driven by the potential of digital health solutions to enhance patient care [4], improve health outcomes, and reduce healthcare costs [5]. However, there is a recognized risk that digital health solutions could actually exacerbate inequalities in the population, for example in terms of access, digital literacy, or language barriers [6]. Participatory design (PD) and co-design practices are critical to addressing these risks already in the development of digital health solutions [7, 8]. PD is a broad methodology that involves representatives of future user groups and experts to ensure that the solutions are easy to use, useful, and aligned with the needs and preferences of the target users. This approach is essential for gathering insights, generating ideas, and co-creating solutions that are contextually appropriate and usercentered [9]. It is based on the conviction that the specific expertise that users bring is a “valid form of knowledge” that adds valuable information to professional knowledge [10]. Workshops are not separate from PD, but rather one of its core mechanisms, providing a structured and collaborative environment where various stakeholders, including end-users, designers, and experts, can actively participate in the design process [11]. In PD, the goal is to involve all relevant parties in shaping the final product or intervention [8]. Participatory workshops offer a structured platform for gathering insights, generating ideas, and co-creating solutions [11]. They use a range of mechanisms to facilitate communication, foster creativity, and enable stakeholders to share their perspectives, preferences, and needs directly [11]. By engaging participants in workshops, designers can ensure that the resulting designs are more useful, user-centered, contextually appropriate, and aligned with the needs and preferences of the target users. Therefore, workshops are highly relevant in PD, as they enable meaningful collaboration and co-design efforts [11]. When it comes to digital health, PD becomes even more critical to ensure that these interventions are effective, culturally sensitive, and accessible [8, 12]. By embedding the unique perspectives and needs of end-users, researchers and stakeholders from an early stage of the design process, PD promotes solutions that resonate deeply with users’ experiences and needs [8, 12]. This increases both reach, uptake, and engagement, potentially leading to greater intervention effectiveness [13, 14]. A review on digital approaches for the participatory development of healthrelated interventions presented by Doerwald etal. [15] only focuses on digitally conducted workshops. Our work goes beyond and considers any PD workshop aimed at designing or developing digital health solutions, conducted in person or digital. We
Journal of Healthcare Informatics Research are not reviewing approaches, but identifying key components for their successful conduct and developing a guideline as a practical tool for considering these components in PD workshops. Despite the growing use of PD in healthcare, there is a lack of comprehensive guidelines for planning and delivering PD workshops. Existing studies often report on specific methodologies and logistical aspects but do not provide a standardized framework for the design and delivery of PD workshops. For example, research on digital mental health interventions have proposed various frameworks or guidelines for integrating evidence-based approaches for co-designing mental health interventions. Examples of these frameworks include the one proposed by the “A Young and Well Cooperative Research Centre” for codesigning online youth mental health interventions [8]. This proposed framework includes six components: identify (e.g., identify the problem from the perspective of young people and the evidence base); define (e.g., identify the beneficiaries and define the problem space and objectives with them); position (e.g., understand how the intervention needs to be positioned and framed in order to have an impact for young people and relevance to young people); concept (e.g., identify, generate and evaluate potential concepts that represent what the intervention needs to be and do to engage young people and deliver appropriate mental health and wellbeing outcomes), create (e.g., evolve, build and refine an intervention that is useful and usable by young people and safe and effective from mental health and wellbeing perspective); and use (e.g., deliver, use, evaluate and iterate the intervention based on how young people experience and use the intervention and its impact) [8]. A review listed a series of best practices and recommendations for undertaking PD of digital mental health interventions specifically with indigenous young people [16]. Suggested best practices are structured along four pillars: governance (i.e., address a need identified by the community); engagement (i.e., engage young people in an iterative process design, development and review); partnerships (i.e., create an environment of mutual learning to ensure capacity strengthening); and knowledge translation (i.e., demonstrate beneficial outcomes for individuals and community) [16]. The IDEAS (integrate, design, assess, share) framework guides a researcher through the full life cycle of an mHealth project [17]. Farao et al. combined the Information Systems Research framework with design thinking principles as a framework for mHealth application design [18]. Another study referred to the use of Design and Evaluation of Digital Health Interventions (DEDHI) framework [19] for planning workshops aimed at adapting a group-based intervention for trauma [20]. These existing frameworks are relevant for PD of digital health solutions; however, they do not provide specific guidance on how to conduct PD workshops in the area of digital health. To our knowledge, there is a lack of structured guidelines for effectively planning and conducting PD workshops in this sensitive and complex area. Several studies that have used participatory workshops for designing digital health solutions report on the methods used, focusing on the activities that they planned, the stakeholder engagement, or logistical aspects without offering a comprehensive framework or standardized guidelines [18, 21–25]. Since some relevant aspects of the PD process are not reported in these frameworks, researchers seeking to use PD in digital health solutions face significant challenges in replicating and
Journal of Healthcare Informatics Research adapting these approaches. In addition, effective planning and facilitation of a PD workshop are critical to ensure that participation meaningfully informs the design process rather than becoming a superficial exercise. In this context, the framework presented here provides a structured method for designing participatory activities within the implementation process. A framework for conducting PD workshops in digital health is essential for several reasons. While PD methodology provides the overarching approach, workshops are the main medium for stakeholder involvement and co-creation. In addition to the challenges that any PD workshop can present, working with vulnerable populations presents unique challenges. Ethical and privacy considerations must be paramount, and participatory workshops must be conducted with compassion, fostering a safe and supportive environment. This study aims to develop a framework enriched with practical examples of the key components of PD workshops that lead to successful digital health solutions. In doing so, it aims to provide a guide that supports the implementation of PD workshops where participation is truly at the forefront and where, as a result, PD improves the effectiveness and user acceptance of digital health solutions, ultimately contributing to better health outcomes and user satisfaction. 2 Methods 2.1 Framework Development Methodology To achieve our goal, we conducted a two-steps approach: First, we identified key components of PD workshops using the nominal group technique [26, 27] (see Fig.1). Second, we defined and specified the identified key components by group discussion. The nominal group technique is a structured approach that fosters consensus among participants, commonly employed for priority setting in healthcare and research [26]. For our in-person meeting, we involved one social anthropologist, one psychologist, and two computer scientists. All persons are experienced in designing digital health solutions and in using participatory methods for this purpose. In a first round, these four participants applied silent generation [27] and collected individually key factors of PD workshops based on their experience in designing, conducting, or participating in PD workshops (time frame 10 min). The group conducted the round-robin sharing to collect and display all factors. Then, they elaborated and clarified the collected factors (sharing phase), with new components added as needed during this process. Specifically, each participant explained their factors, while the other participants listened carefully. All factors were collected at a Miro board [28]. In the following discussions, all factors were categorized, new factors were included, and redundant factors were removed (group discussion). The individual factors and categories were specified in detail with the aim of reaching a common understanding in order to finally formulate definitions. Therefore, the four researchers went through all the factors again together, agreed on the labels, and
Journal of Healthcare Informatics Research checked the assignments to categories. A voting was conducted to assess consensus. All voted factors were included in the final version. 2.2 Framework Test Case The feasibility and applicability of the framework were assessed by an expert in PD who was not involved in the process of defining the framework. This expert is a medical doctor, an expert in digital health, and has strong experience in PD. First, this researcher reviewed the framework and provided feedback on understandability of the categories and key components defined, missing components and relevance. Then, this researcher was asked to reflect on how the PD process followed in the test case might have changed based on the knowledge generated and lessons learned in each participatory workshop developed in the project if this framework had been employed. The framework was explored by applying it to the case of a digital health solution for fatigue self-management for multiple sclerosis (MS) called more stamina [29–31]. More stamina is a gamified fatigue self-management solution developed through an iterative user-centered design that followed an evidence-driven approach [30, 32] guided by patient and public involvement (PPI) process [33]. Qualitative studies with healthcare professionals and people with MS were used to identify Fig. 1 The nominal group technique was applied to collect factors relevant for PD workshops and categorize the factors
Journal of Healthcare Informatics Research needs for digital health [34]; systematic reviews explored the mHealth landscape [35, 36]; early health technology assessment informed development [37]; and the value for healthcare professionals was explored [38]. Finally, its feasibility and usability were tested through real world use with people with MS [39]. While more stamina is primarily a tool for managing physical symptoms of MS, it addresses fatigue, a common symptom in both MS and many mental health conditions, showing the framework’s potential to be applied to other health contexts. Its impact in reducing fatigue, stress, and improving quality of life all contribute to better mental health outcomes for its users. The design and development process of more stamina is presented chronologically to provide context, followed by an analysis of how the different elements of the framework might have modified its design and development. 3 Results 3.1 Key Components ofPD Workshops The silent generation and round-robin phases led to ten categories which are environmental factors, planning, setting, data collection and analysis, recruitment and selection, participatory process, regulations, participant, workshop conductors, and responsible person. In the clarification phase, we did some changes to these initial categories to remove redundancies and ensure clarity and consistency of the categories: • The category “planning” was changed to “workshop definition.” • “Environmental factors” was removed as category and added as factor to “setting.” • “Data collection and analysis” was moved to the category “workshop definition.” All factors were considered relevant to be included in the framework in the voting activity. The suggested final framework for PD consists of five categories that are listed and defined in Table1. In the following subsections, we are describing the factors per category. 3.2 Participatory Process The category “participatory process” consists of 13 factors to be addressed: plurality of opinions, plurality of expertise, justification of the approach, ownership, joint rules, joint terminology, confidence in participants, privacy protection, participation barriers, social fields of power, impact of status and roles, expectation management, and joint goals. Plurality of opinions refers to the inclusion and respectful consideration of a wide range of perspectives, ideas, and viewpoints from all participants within a PD workshop. This means that all opinions are given equal weight. To realize this, an
Journal of Healthcare Informatics Research Table 1 The main categories of the framework for PD consist of five categories Participatory process This category comprises factors that might impact the participation of participants, including participation barriers, plurality of opinions, and kind of expertise (diversity) • Plurality of opinion • Plurality of expertise • Justification of the approach • Ownership • Joint rules • Joint terminology • Joint goals • Confidence in participants • Privacy protection • Participation barriers • Social fields of power • Impact of status and roles • Expectation management Involved persons and their roles This category includes the different persons involved in a PD workshop including their roles, characteristics, motivation, and literacy • Participant characteristics • Participant motivation • Literacy (health literacy, digital literacy) • Empowerment of participant Workshop definition This category includes all organizational aspects related to the PD workshop. For example, the purpose and goals to be achieved, structure of the workshop, budgeting, or selection of suitable methods • Purpose • Goals • Participatory planning • Role definition and tasks • Specific needs • Inclusion/exclusion criteria • Validation of inclusion/exclusion criteria • Workshop structure • Selection of suitable methods • Selection and preparation of material • Specification of the setting • Agenda • Budgeting, first check • Budgeting, second check
Journal of Healthcare Informatics Research Each category comprises several factors Table 1 (continued) Setting This category describes the environment of the PD workshop, including the appropriate material, expectation management, and environmental factors • Availability of appropriate material • Environmental factors Privacy and ethics including regulations This category includes aspects related to ethics, ethics approval, and reflection on possible ethical issues as well as regulatory compliance of the workshop • Ethical considerations • Ethics approval • Regulation compliance
Journal of Healthcare Informatics Research environment has to be created where diverse opinions are welcomed and valued and facilitate open discussions to ensure all voices are heard. Plurality of expertise refers to the inclusion and integration of diverse types of knowledge, skills, and perspectives from a wide range of participants. This concept is crucial for fostering a holistic and comprehensive approach to the PD process. It also points to the goal of diversity, i.e., we might include users with the same chronic condition but with different socioeconomic status or other diversity criteria that might be relevant. When plurality of expertise (i.e., diversity) is not achieved, this must be reflected and justified. Justification of the approach comprises an explanation why applying a PD process is required for achieving the given aim or answering a given research question. It also includes to ensure that participants understand the benefits and goals of the approach. Ownership is a factor that should be achieved in the participants of PD workshops as it is a sense of responsibility, engagement, and interest that participants feel toward the process and outcomes of the workshop. This is essential to achieve relevant outcomes and engagement of the participants. Participants should be encouraged to take ownership of the process and outcomes and be involved in decision-making. Joint rules are a set of agreed-upon guidelines and principles that govern the behavior, interactions, and processes within the PD workshop. These rules are, at best, collaboratively developed and, at minimum, accepted by all participants to ensure a respectful, productive, and inclusive environment. All participants should follow joint goals. These are shared objectives and desired outcomes that are collectively established and agreed upon by all participants. These goals guide the collaborative efforts and ensure that everyone is working toward common purposes. A joint terminology is essential for ensuring understanding. It comprises a shared set of terms and definitions that are understood and used by all participants. This common language helps ensure clear and effective communication, reduces misunderstandings, and promotes a cohesive understanding of key concepts and processes. The factor confidence in participants refers to the trust and belief in the abilities, insights, and contributions of all individuals involved. This could be fostered by providing support and encouragement to boost participant’s confidence. Privacy protection consists of measures and practices implemented to safeguard the personal and sensitive information of all participants. All sensitive information should be handled with care and confidentiality. Inclusion of all participants is essential. This is reflected by the factor participation barriers. These include any obstacles or challenges that prevent or hinder individuals from fully engaging in the workshop activities. These barriers can affect the inclusivity, effectiveness, and overall success of the workshop. Additionally, social fields of power, i.e., social relations and their impact on the dynamics between participants, need to be considered collectively, i.e., by all participants. Impact of status and roles refers to factors that are related to role and status models and how they influence the participants’ interaction in the workshop (e.g., hierarchies in hospital staff). The impact of status and roles should be acknowledged,
Journal of Healthcare Informatics Research 5 Discussion 5.1 Principal Results This paper introduces a comprehensive framework that outlines essential components for designing a PD workshop aimed at creating and developing digital health solutions. The framework encompasses five categories and 36 key components, addressing the participatory process, the roles and contributions of involved individuals, workshop planning and structure, contextual setting, and considerations for privacy and ethics. A checklist is provided as practical tool for considering these key components in the PD workshop planning and conduct (see Appendix 1). 5.2 Application oftheFramework totheDigital Solution More Stamina The evaluation of the framework in the test case demonstrated its feasibility and practical applicability. In this context, the lead researcher identified several challenges that arose during the design process of more stamina that could have been anticipated and addressed if the proposed framework had been implemented. Specifically, these challenges relate to aspects that are crucial for fostering a common understanding between the research or development team, users and domain experts. Although the more stamina team aimed to include the perspectives of users and experts in their development process, their early involvement in the workshop planning was lacking. This omission limited the opportunities for participants to articulate their needs, thereby undermining the participatory nature of the process. 5.3 Comparison withPrior Work A multitude of studies have reported the importance of involving stakeholders in the design process of digital health solutions and interventions [33, 40–42]. The benefits of using these PD methods have led many studies focusing on the design of these types of solutions or interventions to use these types of participatory methods. Although there are several design frameworks that are frequently used in the design of digital health solutions or interventions [17, 18, 25, 43–46], most of these establish high-level aspects, such as the stages of the design process or concrete methods of participation in specific domains. The proposed framework goes a step further by identifying key components for the design of a specific participatory activity in the design of digital health solutions or interventions. These considerations are in line with recommendations from other studies [42, 47–49]. In this regard, Vial etal. recommend explaining the rationale behind adopting a human-centered design approach, which is aligning with the “justification of the approach” component in our framework [42, 49]. Voorheis etal. addressed participant characteristics, joint terminology, plurality of expertise, and ethics in their work [48]. Lastly, Yrttiaho etal. shared insights from involving patients in digital health research, focusing on participant characteristics, plurality of expertise, joint terminology, role definitions,
Journal of Healthcare Informatics Research and participation barriers [47]. The framework presented here integrates these factors and puts them in a systematic order to give guidance to those planning and leading a PD workshop. 5.4 Implications forResearch andPractice The proposed framework supports researchers in planning and conducting PD workshops aimed at developing digital health solutions, ensuring that all relevant aspects are thoroughly addressed. The practical implications of the PD framework for developing digital health solutions center on creating an inclusive, ethical, and structured environment that actively supports and values participant engagement. Practitioners are encouraged to foster a culture of openness and mutual respect, embracing diverse opinions and expertise and ensuring that all voices are heard and valued. Clear communication of the workshop’s purpose, goals and participatory approach helps to build trust and alignment, while jointly developed terminology, goals, and rules promote shared understanding and commitment. By involving participants in planning and decision making, the process fosters ownership and empowerment, which increases both engagement and motivation. Attention to participants’ characteristics—such as literacy levels, backgrounds, motivations, and specific needs—ensures accessibility and relevance, while a thoughtful approach to managing power dynamics and role expectations promotes equitable participation. Practical aspects such as defining roles and inclusion criteria, choosing appropriate methods and materials, structuring the workshop, and maintaining a conducive environment all contribute to smooth and effective implementation. Ethical and legal considerations, including privacy, ethics approval, and regulatory compliance, need to be prioritized throughout. Ultimately, this framework emphasizes the importance of adaptability, preparation, and participant-centered design to achieve meaningful and impactful outcomes in digital health innovation. These recommendations are provided as checklist in the Appendix 1. By adopting the framework and practical guidance, PD workshops can facilitate meaningful participation, enabling the participatory process to produce practical, well-accepted digital solutions. To be effective, the workshop design process itself must be participatory from the outset, actively involving users and experts. However, this approach can be challenging, particularly in research projects, as it requires additional resources and time to align potentially conflicting individual goals. In addition, the findings of this study can inform the creation of reporting guidelines for studies using PD methods in the development of digital health solutions or interventions, promoting transparency and consistency in the application of these methods. 5.5 Limitations This study has some limitations that are reported below. First, the number of experts involved in the definition of the framework is small and has a limited expertise
Journal of Healthcare Informatics Research representation, which may have limited the diversity of perspectives and generalizability of the key components. The inclusion of further experts with different experiences in the PD process in digital health and, in particular, of user experts could lead to the identification of other factors that have not been included in the current version of the framework yet. Furthermore, the framework was developed without direct involvement of the target population (i.e., users of digital health solutions) and therefore potentially not capturing real-world needs and preferences of the intended users. On the other hand, a validation has been performed based on the experience of a single expert and only one project. It is clear that this cannot ensure the understandability and completeness of the definitions and the framework. More extensive validation is needed to ensure completeness. As the relevance of PD of digital health solutions is increasingly recognized, we believe it is important to provide guidance as the proposed framework does, and to expand and improve it continuously by incorporating real-world experiences from its application. 6 Conclusions PD workshops are a powerful approach to creating digital health solutions that are both needs-driven and user-centered. By drawing on the collective expertise of professionals experienced in PD workshops, this framework aims to provide practical guidance for others in the field. Its ultimate purpose is to ensure that PD workshops are more closely aligned with participatory principles and avoid the pitfalls of tokenism. With its five main categories and numerous factors, the framework not only offers concrete tools and guidance but also highlights the inherent complexity of PD workshops—their processes, components, and impact. Importantly, the framework is intended to be a living tool that will evolve through widespread use, critical reflection, and collective refinement. Such ongoing development would signal its success as a catalyst for participatory co-production and inclusive design, embodying the very principles it seeks to promote. Supplementary Information The online version contains supplementary material available at https:// doi. org/ 10. 1007/ s4166602500199-4. Acknowledgements The study was conducted within a research project financed by the Bern University of Applied Sciences. This study was also carried out as part of the MyFatigue project that received funding from the Spanish Ministry of Science, Innovation and Universities (Project Grant PID2021-125528OB-I00 funded by MICIU/AEI/https:// doi. org/ 10. 13039/ 50110 00110 33 and by FEDER, UE). In addition, the study was partly funded by the European Union’s Horizon 2020 Research and Innovation Programme under the Marie Skłodowska-Curie grant agreement No. 101034252. The publication has also emanated from research supported (in part) by a research grant from Science Foundation Ireland (SFI) under Grant Number 16/RC/3948. Author Contribution Conceptualization: KD, EG, ORR, KVH Data curation: KD Funding acquisition: KD, ORR, KVH Investigation: KD, EG, ORR, GG, KVH Methodology: ORR Validation: GG Writing – original draft: KD, EG, ORR, GG Writing – review & editing: KVH, KD, EG, ORR, GG.
Journal of Healthcare Informatics Research Funding Open access funding provided by Bern University of Applied Sciences. The study was conducted within a research project financed by the Bern University of Applied Sciences. This study was also carried out as part of the MyFatigue project that received funding from the Spanish Ministry of Science, Innovation and Universities (project grant PID-2021-125528OB-I00 funded by MICIU/AEI/https:// doi.org/10.13039/501100011033and by FEDER, UE). In addition, the study was partly funded by the European Union’s Horizon 2020 Research and Innovation Programme under the Marie Skłodowska-Curie grant agreement no. 101034252. The publication has also emanated from research supported (in part) by a research grant from Science Foundation Ireland (SFI) under grant number 16/RC/3948. Data Availability No datasets were generated or analysed during the current study. Declarations Competing Interests The authors declare no competing interests. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. References 1. Sorkin DH etal (2021) Rise in use of digital mental health tools and technologies in the United States during the COVID-19 pandemic: survey Study. J Med Internet Res 23:e26994 2. Gabarron E, Reichenpfader D, Denecke K (2023) Exploring the evolution of social media in mental health interventions: a mapping review. Yearb Med Inform 32:152–157 3. Naslund JA, Aschbrenner KA (2021) Technology use and interest in digital apps for mental health promotion and lifestyle intervention among young adults with serious mental illness. J Affect Disord Rep 6:100227 4. Lehtimaki S, Martic J, Wahl B, Foster KT, Schwalbe N (2021) Evidence on digital mental health interventions for adolescents and young people: systematic overview. JMIR Ment Health 8:e25847 5. Gega L etal (2022) Digital interventions in mental health: evidence syntheses and economic modelling. Health Technol Assess 26:1–182 6. Badr J, Motulsky A, Denis J-L (2024) Digital health technologies and inequalities: a scoping review of potential impacts and policy recommendations. Health Policy 146:105122 7. Bødker S, Kyng M (2018) Participatory design that matters—facing the big issues. ACM Trans Comput Hum Interact 25:1–31 8. Hagen P etal (2012) Participatory design of evidence-based online youth mental health promotion, intervention and treatment. (Young and Well Cooperative Research Centre, Abbotsford, Vic.) 9. Denecke K etal (2023) How to design successful participatory design workshops for digital health solutions? Stud Health Technol Inform 302:641–645 10. Dumez V, L’Espérance A (2024) Beyond experiential knowledge: a classification of patient knowledge. Soc Theory Health 22:173–186 11. Hansen NB etal (2020) How participatory design works: mechanisms and effects. In: Proceedings of the 31st Australian Conference on Human-Computer-Interaction 30–41 (Association for Computing Machinery, New York). https:// doi. org/ 10. 1145/ 33694 57. 33694 60 12. Bevan Jones R etal (2020) Practitioner review: co-design of digital mental health technologies with children and young people. Child Psychol Psychiatry 61:928–940 13. Gan DZQ, McGillivray L, Larsen ME, Bloomfield T, Torok M (2023) Promoting engagement with smartphone apps for suicidal ideation in young people: development of an adjunctive strategy using a lived experience participatory design approach. JMIR Form Res 7:e45234
Journal of Healthcare Informatics Research 14. Chen E, Leos C, Kowitt SD, Moracco KE (2020) Enhancing community-based participatory research through human-centered design strategies. Health Promot Pract 21:37–48 15. Doerwald F etal (2024) A rapid review of digital approaches for the participatory development of health-related interventions. Front Public Health 12:1461422 16. Povey J etal (2023) An emerging framework for digital mental health design with Indigenous young people: a scoping review of the involvement of Indigenous young people in the design and evaluation of digital mental health interventions. Syst Rev 12:108 17. Fedele DA, McConville A, Moon J, Thomas JG (2019) Topical review: design considerations when creating pediatric mobile health interventions: applying the IDEAS framework. J Pediatr Psychol 44:343–348 18. Farao J etal (2020) A user-centred design framework for mHealth. PLoS ONE 15:e0237910 19. Kowatsch T, Otto L, Harperink S, Cotti A, Schlieter H (2019) A design and evaluation framework for digital health interventions. IT-Inf Technol 61:253–263 20. Pérez-Aronsson A et al (2022) Adaptation of the trauma group intervention ‘Teaching recovery techniques’ for online delivery: a participatory design and usability study. Internet Interv 30:100589 21. Schmidt T etal (2021) Development of an internet-delivered program and platform for the treatment of depression and anxiety in patients with ischemic heart disease in eMindYourHeart. Inform Health Soc Care 46:178–191 22. Ben-Yehuda O, Dreazen E, Koren D, Peleg M (2022) Participatory design of a mobile app to safeguard mental resilience in the context of drug use in young adults: multi-method study. JMIR Form Res 6:e34477 23. McKay S etal (2024) Participatory design in suicide prevention: a qualitative study of international students’ experiences of adapting the livingworks safeTALK programme. Health Expect 27:e14164 24. Milton AC etal (2021) Technology-enabled reform in a nontraditional mental health service for eating disorders: participatory design study. J Med Internet Res 23:e19532 25. Mummah SA, Robinson TN, King AC, Gardner CD, Sutton S (2016) IDEAS (integrate, design, assess, and share): a framework and toolkit of strategies for the development of more effective digital interventions to change health behavior. J Med Internet Res 18:e317 26. McMillan SS et al (2014) Using the nominal group technique: how to analyse across multiple groups. Health Serv Outcomes Res Method 14:92–108 27. McMillan SS, King M, Tully MP (2016) How to use the nominal group and Delphi techniques. Int J Clin Pharm 38:655–662 28. Miro. https:// miro. com/ de/ login/.Accessed 14 October 2024 29. Giunti G. More stamina - an evidence-based fatigue management solution for persons with multiple sclerosis. More Stamina. https:// www. mores tamin aapp. com/.Accessed 27 Oct 2024 30. Giunti G, Mylonopoulou V, Rivera Romero O (2018) More stamina, a gamified mHealth solution for persons with multiple sclerosis: research through design. JMIR Mhealth Uhealth 6:e51 31. Giunti G etal (2020) Evaluation of more stamina, a mobile app for fatigue management in persons with multiple sclerosis: Protocol for a Feasibility, Acceptability, and Usability Study. JMIR Res Protoc 9:e18196 32. Giunti G (2016) Gamified design for health workshop. Stud Health Technol Inform 225:605–606 33. Yrttiaho T, Giunti G, Isomursu M (2024) Challenges implementing patient and public involvement in a digital health agile project which includes research, business and software development. Stud Health Technol Inform 316:310–314 34. Giunti G, Kool J, Rivera Romero O, Dorronzoro Zubiete E (2018) Exploring the specific needs of persons with multiple sclerosis for mhealth solutions for physical activity: mixed-methods study. JMIR Mhealth Uhealth 6:e37 35. Giunti G, Guisado-Fernandez E, Caulfield B (2017) Connected health in multiple sclerosis: a mobile applications review. In: 2017 IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS). IEEE, Thessaloniki, pp 660–665. https:// doi. org/ 10. 1109/ CBMS. 2017. 27. 36. Giunti G, Guisado Fernández E, Dorronzoro Zubiete E, Rivera Romero O (2018) Supply and demand in mhealth apps for persons with multiple sclerosis: systematic search in app stores and scoping literature review. JMIR Mhealth Uhealth 6:e10512 37. Giunti G, Haverinen J, Reponen J (2022) Informing the product development of an mHealth solution for people with multiple sclerosis through early health technology assessment. In:Otero P, Scott P, Martin SZ, Huesing E (eds) Studies in Health Technology and Informatics. IOS Press. https:// doi. org/ 10. 3233/ SHTI2 20258
Journal of Healthcare Informatics Research 38. Guardado S, Isomursu M, Giunti G (2022) Health care professionals’ perspectives on the uses of patient-generated health data. In: Séroussi B etal. (eds) Studies in Health Technology and Informatics. IOS Press. https:// doi. org/ 10. 3233/ SHTI2 20577 39. Giunti G etal (2025) Feasibility and usability evaluation of a gamified fatigue management mobile application for persons with multiple sclerosis in everyday life. Multiple Sclerosis and Related Disorders 97:106379 40. Baines R etal (2022) Meaningful patient and public involvement in digital health innovation, implementation and evaluation: a systematic review. Health Expect 25:1232–1245 41. Osmanlliu E etal (2022) Fantastic perspectives and where to find them: involving patients and citizens in digital health research. Res Involv Engagem 8:37 42. Marent B, Henwood F, Darking M, EmERGE Consortium (2023) Participation through the lens of care: situated accountabilities in the codesign of a digital health platform for HIV care. Soc Sci Med 337:116307 43. Guay M etal (2021) Adapting a person’s home in 3D using a mobile app (MapIt): participatory design framework investigating the app’s acceptability. JMIR Rehabil Assist Technol 8:e24669 44. Good A, Omisade O (2019) Linking activity theory with user centred design: a human computer interaction framework for the design and evaluation of mHealth interventions. Stud Health Technol Inform 263:49–63 45. Esser PE, Goossens RHM (2009) A framework for the design of user-centred teleconsulting systems. J Telemed Telecare 15:32–39 46. Veggiotti N, Sacchi L, Peleg M (2021) Enhancing the IDEAS framework with ontology: designing digital interventions for improving cancer patients’ wellbeing. AMIA Annu Symp Proc 2021:1186–1195 47. Yrttiaho T, Isomursu M, Giunti G (2022) Experiences using patient and public involvement in digital health research for multiple sclerosis. In: Séroussi B etal. (eds) Studies in Health Technology and Informatics. IOS Press. https:// doi. org/ 10. 3233/ SHTI2 20574 48. Voorheis P, Petch J, Pham Q, Kuluski K (2023) Maximizing the value of patient and public involvement in the digital health co-design process: a qualitative descriptive study with design leaders and patient-public partners. PLOS Digit Health 2:e0000213 49. Vial S, Boudhraâ S, Dumont M (2022) Human-centered design approaches in digital mental health interventions: exploratory mapping review. JMIR Ment Health 9:e35591 Publisher’s Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. Authors and Affiliations KerstinDenecke1· OctavioRivera‑Romero2,3· GuidoGiunti4,5· KarinVanHolten6· EliaGabarron7 * Kerstin Denecke kerstin.deneck[email protected] 1 Department ofEngineering andComputer Science, Institute Patient-Centered Digital Health, Bern University ofApplied Sciences, Quellgasse 21, Biel2502, Switzerland 2 Electronic Technology Department, Universidad de Sevilla, Seville, Spain 3 Instituto de Ingeniería Informática (I3US), Universidad de Sevilla, Seville, Spain 4 School ofMedicine, Trinity College Dublin, Dublin, Ireland 5 Faculty ofMedicine, University ofOulu, Oulu, Finland 6 School ofHealth Professions, Competence Centre Participatory Health Care, Bern University ofApplied Sciences, Bern, Switzerland 7 Department ofEducation, ICT andLearning, Østfold University College, Halden, Norway