Full text
Original Paper User Experience of and Adherence to a Smartphone App to Maintain Behavior Change and Self-Management in Patients With Work-Related Skin Diseases: Multistep, Single-Arm Feasibility Study Nele Ristow1,2, MEd; Annika Wilke1,2, PD Dr; Christoph Skudlik1,2, Prof Dr Med; Swen Malte John1,2, Prof Dr Med; Michaela Ludewig3, Prof Dr 1Department of Dermatology, Environmental Medicine and Health Theory, Institute for Health Research and Education, Osnabrück University, Osnabrück, Germany 2Institute for Interdisciplinary Dermatological Prevention and Rehabilitation (iDerm) at the Osnabrück University, Osnabrück, Germany 3Department Health Sciences, Hochschule Bochum, Bochum, Germany Corresponding Author: Nele Ristow, MEd Department of Dermatology, Environmental Medicine and Health Theory Institute for Health Research and Education Osnabrück University Am Finkenhügel 7a Osnabrück, 49076 Germany Phone: 49 541 969 7410 Fax: 49 541 969 2445 Email: neristo[email protected] Abstract Background: Smartphone apps are a growing field supporting the prevention of chronic diseases. The user experience (UX) is an important predictor of app use and should be considered in mobile health research. Long-term skin protection behavior is important for those with work-related skin diseases. However, altering health behavior is complex and requires a high level of self-management. We developed a maintenance program consisting of the Mein Hautschutz im Alltag (MiA; “My skin protection in everyday life”) app combined with an individual face-to-face goal-setting interview to support patients in the implementation of skin protection behavior after inpatient rehabilitation. Objective: The objectives of this paper are to (1) describe the intervention in a standardized manner; (2) evaluate the UX, subjective quality, and perceived impact of the MiA app; and (3) evaluate the adherence to the MiA app. Methods: We followed a user-centered and multistage iterative process in 2 steps that combined qualitative and quantitative data. The maintenance program was tested over 12 weeks after discharge from rehabilitation. The UX, subjective quality, and perceived impact were evaluated formatively based on the user version of the Mobile Application Rating Scale after 12 weeks (T2). Adherence was measured using the frequency of interactions with the app. Results: In total, 42 patients took part (with a dropout rate of n=18, 43% at T2). The average age was 49.5 (SD 13.1) years, and 57% (24/42) were male. We found high ratings for the UX, with an average score of 80.18 (SD 8.94) out of a theoretical maximum of 100, but there were a few exceptions in the usability and interaction with the app. The app was most frequently rated with 4 out of 5 stars (15/24, 65%), which indicates a high subjective quality. Furthermore, the app seemed to influence important determinants to implement skin protection behavior. Adherence to skin protection tracking was higher over the study period than adherence to skin documentation and goal assessment. The number of adherent participants to skin protection tracking was higher in the skin care and skin cleansing categories (28/42, 67% each) compared to the skin protection category (13/42, 31%) on day 1 and decreased until day 84 in all dimensions (12/42, 29% each for skin care and skin cleansing; 9/42, 21% for skin protection). Conclusions: The results in terms of adherence met the expectations and were consistent with those of other studies evaluating the use of apps for chronic diseases. Interaction with the app could be increased using artificial intelligence to determine eczema severity via photos. It should be investigated which subgroups have difficulties with usability to individualize the support to a JMIR Form Res 2025 | vol. 9 | e66791 | p. 1https://formative.jmir.org/2025/1/e66791 (page number not for citation purposes) Ristow et alJMIR FORMATIVE RESEARCH XSL • FO RenderX
greater degree during onboarding. There is a need for further research regarding the effectiveness of the MiA app on skin protection behavior, quality of life, and eczema severity. (JMIR Form Res 2025;9:e66791) doi: 10.2196/66791 KEYWORDS user experience; mobile health; mHealth; app; smartphone; complex intervention; Template for Intervention Description and Replication; behavior change techniques; behavior change; skin diseases; occupational dermatology; artificial intelligence Introduction Background Smartphone apps have recently become a growing field in the health care sector, garnering increasing attention and importance in health research. The use of such technologies can help optimize broad and location-independent health care in real time and support the prevention of chronic diseases and health promotion to improve adherence to therapy, quality of life, and clinical outcomes in the long term [1,2]. Smartphone apps not only help monitor health data [3,4] but also help change health behavior and develop new habits. For this purpose, health behavior apps offer the potential to technically integrate a variety of behavior change techniques (BCTs) [1,5,6]. BCTs are based on health psychology knowledge about the mechanisms of behavior change processes [7]. The most common BCTs in behavior change apps are, for example, self-monitoring by tracking the duration and frequency of a behavior and feedback on the behavior or outcomes by visualizing the progress graphically [1,5,6,8]. Feedback and the visualization of success also increase motivation in the users, which plays an important role in the long-term success of behavior change [5]. Behavior change apps can also be used to set goals and monitor their achievement. Automatic reminders provide prompts and support the development of routines in everyday life. Written, visual, and audio information can show users how to perform the behavior [1,5,6,8]. Relevance of User Experience A known and widely discussed problem in research on behavior change apps is a low adherence and engagement when using these technologies [2,9-11]. To address these problems, user experience (UX) is becoming increasingly important in mobile health research [12-15]. UX is an overarching holistic concept and covers all emotional, cognitive, and physical experiences that users undergo when interacting with software products such as apps [12,16-18]. As shown in Figure 1, a high UX when using an app for the first time is associated with the willingness to continue using it and recommend it to others in the short term. A high UX leads to increased adherence and app use in the long term and, thus, can also improve clinical outcomes and the effectiveness of health-related interventions [14,19-21]. Therefore, the investigation of UX in the context of digital technologies in patient care is of great importance and should be considered early during the development process [14,15,22]. Thus, a thorough formative evaluation of the UX should precede a summative evaluation to optimize the app from the end user’s perspective [14]. Figure 1. Theoretical model to explain the influence of user experience (UX) and its 5 dimensions—content, usability, aesthetic, trust, and feelings and emotions—on the intention and recommendation to use the app (proximal) results, as well as the revisiting the app and long-term use of the app (distal) results as the basis for this study. As a multidimensional construct, UX comprises various dimensions that can differ depending on the underlying model, understanding, and context [15,17,19]. According to Thielsch and Salaschek [21], the dimensions content, usability, and aesthetics are particularly important in a research-related context. In addition, feelings and emotions that arise through interaction with the technical medium are described as an important aspect of UX [15,16]. As personal data are collected, passed on, and stored in digital care structures, trust in the technology is another predictor of future app use [21]. Behavior Change and Self-Management Apps for Patients With Chronic Skin Diseases Apps to support behavior change and disease-specific self-management have also been developed and evaluated in the context of chronic skin diseases. These are usually aimed at specific groups, such as parents of children with atopic dermatitis (AD) [23,24]; patients with AD [25,26]; or people with specific areas of the skin affected, such as hand and foot eczema [27]. Weigandt et al [27] developed the first smartphone app in Germany specifically for hand and foot eczema, with JMIR Form Res 2025 | vol. 9 | e66791 | p. 2https://formative.jmir.org/2025/1/e66791 (page number not for citation purposes) Ristow et alJMIR FORMATIVE RESEARCH XSL • FO RenderX
which patients can monitor and manage their disease following a patient educational intervention by photographing their skin, tracking their quality of life and symptoms, and chatting with their dermatologist. However, thus far, such technology does not exist for work-related skin diseases (WRSDs) even though they have been among the most common work-related diseases in Germany for decades [28]. Up to 90% of all diagnosed cases affect the hands in the form of irritant or allergic contact eczema, which often occurs in combination with a genetic predisposition to AD [29-32]. Work-related hand eczema is usually caused by hazardous activities in the workplace (eg, skin contact with allergens and irritants, wet work, high handwashing frequencies, and mechanical stress). Workers in the health care, metalworking, hairdressing, and construction sectors are at a particularly high risk, which results in high prevalence rates [30,31]. Due to the high relevance of WRSDs, the German Social Accident Insurance has developed a complex and hierarchical multistep procedure for patients with WRSDs, with different outpatient and inpatient prevention measures depending on the severity of the skin disease. In the case of severe or recurrent skin diseases, patients are offered to participate in an inpatient interprofessional rehabilitation program with a duration of 3 weeks. In German occupational dermatology, this program is also known as tertiary individual prevention (TIP) [29,33]. An important element of TIP are health educational interventions [34] with the aim of gaining disease-specific knowledge and increasing the motivation to implement and optimize individual skin protection behavior. In addition, individual strategies for skin protection behavior are developed with occupational therapists and practiced as part of a workplace simulation in occupational therapy. To restore the skin barrier and reduce the risk of recurrence of hand eczema, it is important to implement skin protection behavior (eg, regular use of skin protection and skin care products as well as reducing the frequency of handwashing by using mild detergents) in the long term [34-36]. However, changing skin protection behavior is complex and requires a high level of self-management after participating in the TIP as the new behavior must be successfully transferred to and implemented in the professional and private contexts. A structured maintenance program that supports patients in this subsequent implementation of skin protection behavior does not yet exist [34]. To fill this gap, we developed the Mein Hautschutz im Alltag (MiA) app (MiA translates to “My skin protection in everyday life”) to support the self-management of patients with WRSDs after the TIP [37]. Objectives of This Study The aim of this study was to evaluate the UX of and adherence to the MiA app and pilot the feasibility of an app-based maintenance program in our clinical setting. In this publication, we report the following results: (1) description of the intervention in a standardized manner; (2) UX, subjective quality, and perceived impact of the MiA app; and (3) adherence to the MiA app. Methods Overview The occupational dermatology maintenance program is a complex intervention consisting of several interacting components (Multimedia Appendix 1). According to the Medical Research Council’s framework, the development of complex interventions is based on a 4-stage process consisting of development [37], feasibility, evaluation, and implementation [38]. This study focuses on feasibility (phase 2). Intervention The maintenance program is offered by the Institute for Interdisciplinary Dermatological Prevention and Rehabilitation (iDerm), Osnabrück, Germany, which is a specialized center in Germany for inpatient and outpatient interprofessional treatment of patients with WRSDs. The maintenance program consists of 2 main elements: individual goal-setting interview and the MiA app. The systematic development of these elements is described in detail elsewhere [37]. The individual goal-setting interview is conducted during the inpatient stay by a health educator face-to-face 5 or 6 days before discharge. The goals, which are defined by the patients, are entered into the app on the coaching platform by the health educator and can be viewed by patients via the app. During the subsequent onboarding, patients receive an introduction and explanations of the various app functions. Patients are also given access to a video via a QR code that shows the app with screenshots and explains the app’s functions. MiA is a fully automated app with free access for study participants and consists of 6 components focusing either on interaction or information. The smartphone-based components with interactive nature are named My Skin Protection Goals (German: Meine Hautschutz-Ziele), My Skin Protection Behavior (German: Mein Hautschutz-Verhalten), and My Skin Documentation (German: Meine Hautdokumentation). The smartphone-based components To Listen (German: Hörenswert), Skin Protection 101 (German: Das Hautschutz 1x1), and My Accountabilities (German: Meine Zuständigkeiten) provide different information about the skin disease in different modes of delivery (podcasts, textboxes, and videos; Figure 2). In addition, users automatically receive a reminder message if no information has been entered into the app for a period of 14 days. JMIR Form Res 2025 | vol. 9 | e66791 | p. 3https://formative.jmir.org/2025/1/e66791 (page number not for citation purposes) Ristow et alJMIR FORMATIVE RESEARCH XSL • FO RenderX
Figure 2. (A) Overview of the menu; (B) overview of the My Skin Protection Behavior component with the option to enter the frequencies of skin cleansing (green line) and applications of skin care cream (red line) and skin protection cream (blue line); (C) overview of the My Skin Documentation component, which allows for taking pictures of the front and back side of the right and left hand that can be enlarged and to which personal notes can be added; (D) overview of the My Skin Protection Goals component with the overview of the goal achievement; (E) To Listen component and 4 podcast episodes; (F) overview of the Skin Protection 101 component with different questions and an example unfolded answer; (G) overview of the My Accountabilities component with different questions and an exemplary unfolded answer; and (H) presentation of the research questionnaire with the 6 categories, whereby categories 1 to 3 (sociodemographic data, skin protection behavior, and questions about the organization) can be completed immediately and categories 4 to 6 (skin protection behavior, app evaluation, and impact of the app) are activated after 12 weeks of use. Multimedia Appendix 1 provides a more detailed description of each component according to the Template for Intervention Description and Replication checklist [39,40], including what, why, how often, and when components are unlocked during the maintenance program and where and which tailoring options are available. Table 1 describes the contents of the active components of the intervention in a standardized manner using the Behavior Change Technique Taxonomy version 1 [7,41]. JMIR Form Res 2025 | vol. 9 | e66791 | p. 4https://formative.jmir.org/2025/1/e66791 (page number not for citation purposes) Ristow et alJMIR FORMATIVE RESEARCH XSL • FO RenderX
Table 1. Behavior change techniques (BCTs) in the 12-week occupational dermatology maintenance program for improving health behavior change in patients with work-related skin diseases based on the BCT Taxonomy version 1 [7,41]. BCTsDescriptionComponent Face-to-face intervention Formulation of individual skin protection goals Individual goal-setting interview •1.1: goal setting (behavior) MiAaapp Monitoring of individual skin protection goals and assessment of their achievement My Skin Protection Goals •1.5: review behavior goals Visualization of goal achievement over time using arrows My Skin Protection Goals •1.6: discrepancy between current behavior and goal Motivating feedback messages depending on the evaluation of the goal My Skin Protection Goals •3.1: social support (unspecified) Tracking of skin protection behavior and monitoring the progress My Skin Protection Behavior •2.3: self-monitoring of behavior Recording and observing the skin condition My Skin Documentation •2.5: monitoring of outcomes of behavior without feedback Information about the skin disease, associated difficulties, and strategies To Listen •Episode 1: 4.1—instruction on how to perform the behavior and 15.1—verbal persuasion about capability •Episode 2: 5.1—information about health consequences, 5.2—salience of consequences, 8.2—behavior substitution, 12.4—distraction, and 15.1—verbal persuasion about capability •Episode 3: 8.2—behavior substitution, 5.1—information about health consequences, 5.2—salience of consequences, 4.2—information about antecedents, and 15.1—verbal persuasion about capability •Episode 4: 3.1—social support (unspecified), 3.3—social support (emotional), and 15.1—verbal persuasion about capability Information about seminar content on skin protection, itching, and stress Skin Protection 101 •4.1: instruction on how to perform the behavior •5.1: information about health consequences Information about organizational issues related to care and responsibilities My Accountabilities •5.3: inform about social and environmental consequences aMiA: Mein Hautschutz im Alltag (My skin protection in everyday life). Ethical Considerations This study was approved by the Ethics Committee of Osnabrück University (Ethics-50/2022 and Ethics-15/2023). All patients assessed for eligibility were informed verbally and in writing about the study and its voluntary nature. All participants had to sign a declaration of consent to take part in the study. The participants were informed that data collection would be pseudonymized and that the evaluation and publication of the results would be anonymous. They received no compensation for their participation. Inclusion Criteria and Study Design Recruitment took place at iDerm in Osnabrück on the fourth day during the TIP. Study information was provided in patient groups as 7 to 9 new patients are usually admitted to the TIP each week. After all patients had been fully informed about the study, they were given sufficient time to decide whether to participate. Subsequently, interested patients received the written study information and declaration of consent. The inclusion criteria were (1) signed declaration of consent for study participation; (2) legal age (>18 years); (3) sufficient German language skills to understand the app content, participate in focus groups, and complete questionnaires; and (4) access to an internet-enabled smartphone (for step 2). This study followed a user-centered and multistage iterative approach, which is a well-known and widespread procedure in the development of technologies in health care and UX research [42,43]. This approach allows for the consideration of the opinions and feedback of the target group as future users of the app in a participatory manner [23,44-46]. As illustrated in Figure 3, the entire process consisted of 2 steps with both qualitative and quantitative data collection. JMIR Form Res 2025 | vol. 9 | e66791 | p. 5https://formative.jmir.org/2025/1/e66791 (page number not for citation purposes) Ristow et alJMIR FORMATIVE RESEARCH XSL • FO RenderX
Figure 3. Study process of multistage iterative testing of the app-based maintenance program for patients with work-related skin diseases consisting of (1) iterative development and testing and (2) 12-week testing and piloting. MiA: Mein Hautschutz im Alltag (My skin protection in everyday life); TIP: tertiary individual prevention; UX: user experience. Instrument Various instruments have been developed to assess the UX of mobile health apps. Among them, the user version of the Mobile Application Rating Scale (uMARS) is a well-known and reliable instrument that measures the UX of health apps from the user’s perspective [47]. The uMARS is based on the Mobile Application Rating Scale, which is used to assess the quality of apps by clinical or technical experts [48,49]. The uMARS is made up of 16 items and comprises the UX dimensions of engagement, functionality, aesthetics, and information quality. The scales of subjective quality and perceived impact assess additional information about recommendation; willingness to use and pay for the app; and information regarding awareness and knowledge of and intention for behavior change. For this study, an instrument for step 1 and step 2 was developed based on the uMARS and the model shown in Figure 1. Statistical analyses of the quantitative data were carried out using SPSS (version 28; IBM Corp). We calculated a score for all 5 UX dimensions as well as a score for all UX items. Adherence to the My Skin Protection Behavior, My Skin Documentation, and My Goal Achievement functions was determined based on the adherence values in Multimedia Appendix 1 and by dichotomizing the data into adherent and nonadherent. For continuous data (eg, age and UX), we calculated the mean, median, IQR, and SD. We present categorical data (eg, gender, subjective quality, and perceived impact) in frequencies and percentages. Step 1: Iterative Development and Testing of Intervention Components Overview In the first step, the maintenance program was tested by 4 different patient groups during participation in the TIP at the iDerm in Osnabrück between November 2022 and November 2023. Patients were recruited on the fourth day of the TIP with a subsequent test phase of 2 weeks. During the test phase, patients were asked to document their overall impression as well as positive aspects and aspects requiring improvement of the tested component in a standardized documentation form. The documentation forms were not evaluated by the researchers as they merely served as preparation for the patients themselves for the focus group discussions. Each group tested and evaluated specific maintenance components as follows: group 1 evaluated To listen, group 2 evaluated the face-to-face goal setting interview, group 3 evaluated My Skin Protection Behavior and My Accountabilities on the app, and group 4 evaluated Skin Protection 101 and My Skin Documentation on the app. Methods of Data Collection in Step 1 After the test phase, the patients completed a short quantitative questionnaire that assessed their overall impression of the maintenance components tested using selected items from the uMARS. The focus of step 1 was qualitative data collected via 4 subsequent focus group discussions. The aim of the focus group discussions was to record positive and negative aspects of the tested components, identify problems and challenges regarding their use, and jointly develop opportunities for improvements. The focus group discussions were conducted by 2 moderators (NR and ML) based on guiding questions regarding content-related, methodological, and technical aspects. The guiding questions served as orientation. Additions to or deepening of the questions and topics that arose in the course of the discussions were permitted. The interviews were recorded using an audio recorder (Olympus LS-P4 linear pulse-code modulation recorder). Knowledge mapping was chosen for data analysis as it allows for the combination of data collection and data processing [50]. The results were written down in keywords on moderation cards and clustered on a metaplan board. The participants validated the results for completeness and correctness for each topic. In addition, experiences from the test phase and key results were documented by a research JMIR Form Res 2025 | vol. 9 | e66791 | p. 6https://formative.jmir.org/2025/1/e66791 (page number not for citation purposes) Ristow et alJMIR FORMATIVE RESEARCH XSL • FO RenderX
assistant in a protocol. Aspects of the components that needed to be improved were then revised in the next iteration. Step 2: Pilot-Testing and Assessing the UX Overview In the second step, the entire maintenance program, consisting of the face-to-face goal-setting interview and the MiA app with all its components, was tested by patients and formatively evaluated. Recruitment took place over a period of 10 weeks from January 2024 to March 2024. Patients who voluntarily agreed to participate were then given an appointment for the goal-setting interview as a one-to-one meeting and the subsequent onboarding to the app in the third week. The app was tested over a period of 12 weeks after discharge from the TIP, with 2 additional weeks to fill out the second questionnaire. Patients who did not complete the questionnaire within these 2 weeks received a reminder in the form of a paper questionnaire with a prepaid return envelope by post. Methods of Data Collection in Step 2 Overview The evaluation was carried out using a quantitative questionnaire consisting of 6 blocks. Blocks 1 to 3 were available immediately after registration, and blocks 4 to 6 were activated after the maintenance period of 12 weeks after discharge. In total, the instrument consisted of 85 questions about sociodemographic data; skin protection behavior before and after the rehabilitation program; and evaluation of the UX, subjective quality, and perceived effects, as well as questions about the structural, process, and outcome quality of the intervention. In addition to closed-ended questions, the questionnaire also included open-ended questions to allow the participants to provide further details about the individual functions beyond the closed-ended questions [15]. The comprehensibility of the questions and the time required for completion were determined in a pretest with 16 patients before the study. In this publication, we report the results on sociodemographic data, UX evaluation, subjective quality, and perceived impact of the intervention. UX Evaluation To assess the UX, the relevant items of the uMARS were assigned to the UX dimensions shown in Figure 1 and supplemented with additional aspects as required. We measured feelings and emotions using 5 items (eg, “I find the app entertaining” or “The app offers me enough options to customise it to my personal requirements and needs”), content using 4 items (eg, “Is the content of the app relevant to you?” or “Are the texts understandable?”), usability using 6 items (eg, “How well and quickly do the app’s applications [buttons, menus] respond?” or “How easy was it for you to learn how to use the app?”), aesthetic using 2 items (“How high are the quality and resolution of the images and texts?” and “How would you rate the overall appearance of the app?”), and trust using 3 items (eg, “The information in the app appears to come from a credible source” and “Are you concerned that data you have entered into the app could be uploaded to third parties?”). All questions were answered on 5-point Likert scales that differed in their content depending on the dimension and item. Subjective Quality and Perceived Impact Both aspects were assessed using the uMARS [47]. Subjective quality was measured using the items related to recommendation, willingness to use in the following 12 months, and willingness to pay and overall rating by stars. The perceived impact scale comprised 5 closed-ended questions on awareness and knowledge of and motivation for skin protection behavior; encouragement to seek for support; and enabling skin protection behavior on a 5-point Likert scale and a supplementary open-ended question on which functions were particularly helpful for implementing skin protection behavior. Adherence An important result for this study was the analysis of the frequency of use of individual components as this represented a central criterion for adherence to the intervention. We used a simple definition according to Donkin et al [51] and understood adherence as “the degree to which the user followed the programme as it was designed” [51]. This definition has already been applied in the context of other digital health interventions [45]. In this study, adherence was determined by the frequency with which the skin protection behavior was entered, how often photos were taken, and how often the goals were assessed. Adherence was high if the component My Skin Protection Behavior was used daily and the functions My Skin Documentation and My Skin Protection Goals were used weekly. Results Step 1 Study Participants A total of 23 patients took part in the testing of the intervention components in step 1, of whom 10 (43%) were female and 13 (57%) were male. The average age of the participants was 51 (SD 11; range 27-62) years. The patients worked in health care (8/23, 35%), the metalwork industry (4/23, 17%), hairdressing (3/23, 13%), construction (2/23, 9%), or other professions (6/23, 26%). Main Results The results of step 1 were used for iterative development to further optimize the intervention for phase 2. For example, in the My Skin Protection Behavior function, the scale of the days and frequencies in the diagram was too small. This was adjusted and enlarged in the revision. In the My Skin Documentation function, every entry was automatically saved in the comment function. This always hindered further input for a few seconds. A button was added so that users could save their comments at the end by themselves. Patients also highlighted that the app had a simple structure and reminded them of apps they already knew, had a good usability and visual presentation, and was factual without playful elements. A more detailed presentation of the results of step 1 and the associated modifications for step 2 can be found in Multimedia Appendix 2. JMIR Form Res 2025 | vol. 9 | e66791 | p. 7https://formative.jmir.org/2025/1/e66791 (page number not for citation purposes) Ristow et alJMIR FORMATIVE RESEARCH XSL • FO RenderX
Step 2 Study Participants Over 10 weeks (study period for step 2), a total of 79 patients participated in the TIP program, of whom 42 (53%) agreed to take part in the intervention and gave informed consent for study participation. The main reasons for nonparticipation were no interest or no subjectively felt need for the intervention (Figure 4). All 42 patients took part in the individual goal-setting interview and received access to the MiA app for the 12-week testing phase. At T1, all participants completed the questionnaires (42/42, 100% response rate), and at T2, the response rate was 57% (24/42). Table 2 summarizes the sociodemographic data of the patients enrolled in this study. Figure 4. Flowchart of the study population in step 2, including assessment for eligibility, participation, and follow-up at T1 and T2. MiA: Mein Hautschutz im Alltag (My skin protection in everyday life); TIP: tertiary individual prevention. JMIR Form Res 2025 | vol. 9 | e66791 | p. 8https://formative.jmir.org/2025/1/e66791 (page number not for citation purposes) Ristow et alJMIR FORMATIVE RESEARCH XSL • FO RenderX
Table 2. Sociodemographic data of the study participants at T1 (N=42). ValuesSociodemographics Sex, n (%) 24 (57)Male 18 (43)Female Age (y) 49.5 (13.1)Values, mean (SD) 55.0 (18.6)Values, median (IQR) Occupational categories, n (%) 17 (40)Health care professions 9 (21)Metalwork industry 5 (12)Construction 1 (2)Hairdressing 2 (5)Food processing 5 (12)Other 1 (2)Pensioner 2 (5)Currently unemployed Highest educational level, n (%) 9 (21)Secondary school or elementary school–leaving certificate 15 (36)Intermediate school–leaving certificate or secondary school–leaving certificate 3 (7) “Meister”a 5 (12)College certificate 7 (17)General higher education entrance qualification or A-levels 1 (2)Bachelor’s degree 2 (5)Master’s degree or diploma Employment status, n (%) 4 (10)Self-employed 35 (83)Employed 3 (7)Unemployed Partnership, n (%) 32 (76)Yes 10 (24)No aPerson with a higher vocational qualification in a craft, also known as “master craftsman” or “master craftswoman.” UX Results The average UX score, with a theoretical minimum of 20 and a theoretical maximum of 100, was 80.18 (SD 8.94). Figure 5 shows the results for the assessment of the UX from the trust, content, aesthetic, usability, and feelings and emotions dimensions. The raw data for these items can be found in Multimedia Appendix 3. The results show overall positive ratings (scores of 4 and 5). The feelings and emotions dimension stood out, with comparatively frequent medium ratings and no ratings of 5 on 60% (3/5) of the items. Furthermore, the item “How easy was it for you to learn how to use the app?” in the usability dimension was the only item with a score of 1 by 2% (1/42) of the participants. JMIR Form Res 2025 | vol. 9 | e66791 | p. 9https://formative.jmir.org/2025/1/e66791 (page number not for citation purposes) Ristow et alJMIR FORMATIVE RESEARCH XSL • FO RenderX
2. Meyerowitz-Katz G, Ravi S, Arnolda L, Feng X, Maberly G, Astell-Burt T. Rates of attrition and dropout in app-based interventions for chronic disease: systematic review and meta-analysis. J Med Internet Res. Sep 29, 2020;22(9):e20283. [FREE Full text] [doi: 10.2196/20283] [Medline: 32990635] 3. Kitazawa M, Takeda Y, Hatta M, Horikawa C, Sato T, Osawa T, et al. Lifestyle intervention with smartphone app and isCGM for people at high risk of type 2 diabetes: randomized trial. J Clin Endocrinol Metab. Mar 15, 2024;109(4):1060-1070. [FREE Full text] [doi: 10.1210/clinem/dgad639] [Medline: 37931069] 4. Guo M, Meng F, Guo Q, Bai T, Hong Y, Song F, et al. Effectiveness of mHealth management with an implantable glucose sensor and a mobile application among Chinese adults with type 2 diabetes. J Telemed Telecare. Sep 2023;29(8):632-640. [doi: 10.1177/1357633X211020261] [Medline: 34152238] 5. Stawarz K, Cox AL, Blandford A. Beyond self-tracking and reminders: designing smartphone apps that support habit formation. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2015. Presented at: CHI '15; April 18-23, 2015; Seoul, Republic of Korea. [doi: 10.1145/2702123.2702230] 6. McKay FH, Wright A, Shill J, Stephens H, Uccellini M. Using health and well-being apps for behavior change: a systematic search and rating of apps. JMIR Mhealth Uhealth. Jul 04, 2019;7(7):e11926. [FREE Full text] [doi: 10.2196/11926] [Medline: 31274112] 7. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. Aug 2013;46(1):81-95. [FREE Full text] [doi: 10.1007/s12160-013-9486-6] [Medline: 23512568] 8. Payne HE, Lister C, West JH, Bernhardt JM. Behavioral functionality of mobile apps in health interventions: a systematic review of the literature. JMIR Mhealth Uhealth. Feb 26, 2015;3(1):e20. [FREE Full text] [doi: 10.2196/mhealth.3335] [Medline: 25803705] 9. Birrell L, Furneaux-Bate A, Chapman C, Newton NC. A mobile peer intervention for preventing mental health and substance use problems in adolescents: protocol for a randomized controlled trial (The Mind Your Mate Study). JMIR Res Protoc. Jul 30, 2021;10(7):e26796. [FREE Full text] [doi: 10.2196/26796] [Medline: 34328426] 10. Rismawan W, Marchira CR, Rahmat I. Usability, acceptability, and adherence rates of mobile application interventions for prevention or treatment of depression: a systematic review. J Psychosoc Nurs Ment Health Serv. Feb 01, 2021;59(2):41-47. [doi: 10.3928/02793695-20201104-02] [Medline: 33180949] 11. Jakob R, Harperink S, Rudolf AM, Fleisch E, Haug S, Mair JL, et al. Factors influencing adherence to mHealth apps for prevention or management of noncommunicable diseases: systematic review. J Med Internet Res. May 25, 2022;24(5):e35371. [FREE Full text] [doi: 10.2196/35371] [Medline: 35612886] 12. Lubis M, Sutoyo E, Azuddin M, Handayani D. User experience in mobile application design: utility defined context of use. J Phys Conf Ser. 2019;1361:12043. [doi: 10.1088/1742-6596/1361/1/012043] 13. Kaveladze BT, Wasil AR, Bunyi JB, Ramirez V, Schueller SM. User Experience, Engagement, and Popularity in Mental Health Apps: Secondary Analysis of App Analytics and Expert App Reviews. JMIR Hum Factors. Jan 31, 2022;9(1):e30766. [FREE Full text] [doi: 10.2196/30766] [Medline: 35099398] 14. Bitkina OV, Kim HK, Park J. Usability and user experience of medical devices: an overview of the current state, analysis methodologies, and future challenges. Int J Ind Ergon. Mar 2020;76:102932. [doi: 10.1016/j.ergon.2020.102932] 15. Biduski D, Bellei EA, Rodriguez JP, Zaina LA, De Marchi AC. Assessing long-term user experience on a mobile health application through an in-app embedded conversation-based questionnaire. Comput Hum Behav. Mar 2020;104:106169. [doi: 10.1016/j.chb.2019.106169] 16. Kim A, Kim KJ. User experience and the multi-stage adoption of mobile apps. J Inf Technol Appl Manag. 2014;21(2):49-79. [doi: 10.21219/jitam.2014.21.2.049] 17. Schrepp M, Hinderks A, Thomaschewski J. Construction of a benchmark for the User Experience Questionnaire (UEQ). Int J Interact Multim Artif Intell. 2017;4(4):40-44. [doi: 10.9781/ijimai.2017.445] 18. Schrepp M, Hinderks A, Thomaschewski J. Applying the User Experience Questionnaire (UEQ) in different evaluation scenarios. In: Marcus A, editor. Design, User Experience, and Usability. Cham, Switzerland. Springer; 2014. 19. Lemon C, Huckvale K, Carswell K, Torous J. A narrative review of methods for applying user experience in the design and assessment of mental health smartphone interventions. Int J Technol Assess Health Care. 2020;36(1):64-70. [doi: 10.1017/S0266462319003507] [Medline: 31973787] 20. Blanchard M, Backhaus L, Ming Azevedo P, Hügle T. An mHealth app for fibromyalgia-like post-COVID-19 syndrome: protocol for the analysis of user experience and clinical data. JMIR Res Protoc. Feb 04, 2022;11(2):e32193. [FREE Full text] [doi: 10.2196/32193] [Medline: 34982039] 21. Thielsch MT, Salaschek M. [Toolbox for user-experience evaluation of online health information]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. Jun 2020;63(6):721-728. [doi: 10.1007/s00103-020-03142-7] [Medline: 32367206] 22. Truong MT, Nwosu OB, Gaytan Torres ME, Segura Vargas MP, Seifer AK, Nitschke M, et al. A yoga exercise app designed for patients with axial spondylarthritis: development and user experience study. JMIR Form Res. Jun 03, 2022;6(6):e34566. [FREE Full text] [doi: 10.2196/34566] [Medline: 35657655] JMIR Form Res 2025 | vol. 9 | e66791 | p. 16https://formative.jmir.org/2025/1/e66791 (page number not for citation purposes) Ristow et alJMIR FORMATIVE RESEARCH XSL • FO RenderX
23. Xu X, Griva K, Koh M, Lum E, Tan WS, Thng S, et al. Creating a smartphone app for caregivers of children with atopic dermatitis with caregivers, health care professionals, and digital health experts: participatory co-design. JMIR Mhealth Uhealth. Oct 29, 2020;8(10):e16898. [FREE Full text] [doi: 10.2196/16898] [Medline: 33118949] 24. Zvulunov A, Lenevich S, Migacheva N. A mobile health app for facilitating disease management in children with atopic dermatitis: feasibility and impact study. JMIR Dermatol. Dec 13, 2023;6:e49278. [FREE Full text] [doi: 10.2196/49278] [Medline: 38090787] 25. Gudmundsdóttir SL, Ballarini T, Ámundadóttir ML, Mészáros J, Eysteinsdottir JH, Thorleifsdottir RH, et al. Engagement, retention, and acceptability in a digital health program for atopic dermatitis: prospective interventional study. JMIR Form Res. Jun 14, 2023;7:e41227. [FREE Full text] [doi: 10.2196/41227] [Medline: 36975050] 26. Shah S, Kemp JM, Kvedar JC, Gracey LE. A feasibility study of the burden of disease of atopic dermatitis using a smartphone research application, myEczema. Int J Womens Dermatol. Dec 2020;6(5):424-428. [FREE Full text] [doi: 10.1016/j.ijwd.2020.08.001] [Medline: 33898712] 27. Weigandt WA, Schardt Y, Bruch A, Herr R, Goebeler M, Benecke J, et al. Impact of an eHealth smartphone app on quality of life and clinical outcome of patients with hand and foot eczema: prospective randomized controlled intervention study. JMIR Mhealth Uhealth. Mar 07, 2023;11:e38506. [FREE Full text] [doi: 10.2196/38506] [Medline: 36881465] 28. DGUV-Statistiken für die Praxis 2023. DGUV. Oct 2024. URL: https://publikationen.dguv.de/statistiken/zahlen-und-fakten/ 4994/dguv-statistiken-fuer-die-praxis-2023 [accessed 2025-04-10] 29. Brans R, Schröder-Kraft C, Skudlik C, John SM, Geier J. Tertiary prevention of occupational skin diseases: prevalence of allergic contact dermatitis and pattern of patch test results. Contact Dermatitis. Jan 2019;80(1):35-44. [doi: 10.1111/cod.13098] [Medline: 30506828] 30. Skudlik C, Weisshaar E, Scheidt R, Elsner P, Wulfhorst B, Schönfeld M, et al. First results from the multicentre study rehabilitation of occupational skin diseases--optimization and quality assurance of inpatient management (ROQ). Contact Dermatitis. Mar 2012;66(3):140-147. [doi: 10.1111/j.1600-0536.2011.01991.x] [Medline: 22070197] 31. Brans R, John SM. Clinical patterns and associated factors in patients with hand eczema of primarily occupational origin. J Eur Acad Dermatol Venereol. May 2016;30(5):798-805. [doi: 10.1111/jdv.13515] [Medline: 26660508] 32. Elsner P, Schliemann S. Prävention der BK 5101. Trauma Berufskrankh. Dec 1, 2015;17(4):227-232. [doi: 10.1007/s10039-015-0103-8] 33. Brans R, Skudlik C. [Prevention of hand eczema]. Hautarzt. Oct 2019;70(10):797-803. [doi: 10.1007/s00105-019-4463-z] [Medline: 31410496] 34. Ristow N, Rocholl M, Wilke A, John SM, Ludewig M. Using behaviour change techniques to characterize patient educational interventions in tertiary individual prevention of work-related skin diseases. Transl Behav Med. May 24, 2024;14(6):341-352. [doi: 10.1093/tbm/ibad081] [Medline: 38159249] 35. Wilke A, Skudlik C, Sonsmann FK. [Individual prevention of occupational contact dermatitis: protective gloves and skin protection recommendations as part of the patient management scheme by the public statutory employers' liability insurance]. Hautarzt. Jun 2018;69(6):449-461. [doi: 10.1007/s00105-018-4170-1] [Medline: 29721626] 36. Wilke A, Gediga K, John SM, Wulfhorst B. Evaluation of structured patient education in occupational skin diseases: a systematic assessment of the disease-specific knowledge. Int Arch Occup Environ Health. Nov 2014;87(8):861-869. [doi: 10.1007/s00420-014-0926-9] [Medline: 24482039] 37. Ristow N, Wilke A, Malte John S, Ludewig M. Development of an app-based maintenance programme to promote skin protection behaviour for patients with work-related skin diseases. Health Educ J. Aug 02, 2022;81(6):731-744. [doi: 10.1177/00178969221115990] 38. Skivington K, Matthews L, Simpson SA, Craig P, Baird J, Blazeby JM, et al. A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance. BMJ. Sep 30, 2021;374:n2061. [FREE Full text] [doi: 10.1136/bmj.n2061] [Medline: 34593508] 39. Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. [better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide]. Gesundheitswesen. Mar 2016;78(3):175-188. [doi: 10.1055/s-0041-111066] [Medline: 26824401] 40. Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. Mar 07, 2014;348:g1687. [FREE Full text] [doi: 10.1136/bmj.g1687] [Medline: 24609605] 41. Michie S, Atkins L, West R. The Behaviour Change Wheel: A Guide to Designing Interventions. Sutton, UK. Silverback Publishing; 2014. 42. Matthew-Maich N, Harris L, Ploeg J, Markle-Reid M, Valaitis R, Ibrahim S, et al. Designing, implementing, and evaluating mobile health technologies for managing chronic conditions in older adults: a scoping review. JMIR Mhealth Uhealth. Jun 09, 2016;4(2):e29. [FREE Full text] [doi: 10.2196/mhealth.5127] [Medline: 27282195] 43. Wolcott MD, McLaughlin JE. Exploring user experience (UX) research methods in health professions education. Curr Pharm Teach Learn. Feb 2024;16(2):144-149. [doi: 10.1016/j.cptl.2023.12.010] [Medline: 38158330] JMIR Form Res 2025 | vol. 9 | e66791 | p. 17https://formative.jmir.org/2025/1/e66791 (page number not for citation purposes) Ristow et alJMIR FORMATIVE RESEARCH XSL • FO RenderX
44. Gracey LE, Zan S, Gracz J, Miner JJ, Moreau JF, Sperber J, et al. Use of user-centered design to create a smartphone application for patient-reported outcomes in atopic dermatitis. NPJ Digit Med. 2018;1:33. [FREE Full text] [doi: 10.1038/s41746-018-0042-4] [Medline: 31304315] 45. Kernebeck S, Busse TS, Ehlers JP, Vollmar HC. [Adherence to digital health interventions: definitions, methods, and open questions]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. Oct 2021;64(10):1278-1284. [FREE Full text] [doi: 10.1007/s00103-021-03415-9] [Medline: 34559252] 46. Alberts NM, Badawy SM, Hodges J, Estepp JH, Nwosu C, Khan H, et al. Development of the InCharge health mobile app to improve adherence to hydroxyurea in patients with sickle cell disease: user-centered design approach. JMIR Mhealth Uhealth. May 08, 2020;8(5):e14884. [FREE Full text] [doi: 10.2196/14884] [Medline: 32383683] 47. Stoyanov SR, Hides L, Kavanagh DJ, Wilson H. Development and validation of the user version of the Mobile Application Rating Scale (uMARS). JMIR Mhealth Uhealth. Jun 10, 2016;4(2):e72. [FREE Full text] [doi: 10.2196/mhealth.5849] [Medline: 27287964] 48. Messner EM, Terhorst Y, Barke A, Baumeister H, Stoyanov S, Hides L, et al. The German version of the mobile app rating scale (MARS-G): development and validation study. JMIR Mhealth Uhealth. Mar 27, 2020;8(3):e14479. [FREE Full text] [doi: 10.2196/14479] [Medline: 32217504] 49. Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth. Mar 11, 2015;3(1):e27. [FREE Full text] [doi: 10.2196/mhealth.3422] [Medline: 25760773] 50. Pelz C, Schmitt A, Meis M. Knowledge mapping as a tool for analyzing focus groups and presenting their results in market and evaluation research. Forum Qual Soc Res. 2004;5(2). [FREE Full text] [doi: 10.17169/fqs-5.2.601] 51. Donkin L, Christensen H, Naismith SL, Neal B, Hickie IB, Glozier N. A systematic review of the impact of adherence on the effectiveness of e-therapies. J Med Internet Res. Aug 05, 2011;13(3):e52. [FREE Full text] [doi: 10.2196/jmir.1772] [Medline: 21821503] 52. Maher CA, Olds T, Vandelanotte C, Plotnikoff R, Edney SM, Ryan JC, et al. Gamification in a physical activity app: what gamification features are being used, by whom, and does it make a difference? Games Health J. Jun 2022;11(3):193-199. [doi: 10.1089/g4h.2021.0207] [Medline: 35501981] 53. Tolks D, Lampert C, Dadaczynski K, Maslon E, Paulus P, Sailer M. [Game-based approaches to prevention and health promotion: serious games and gamification]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. Jun 2020;63(6):698-707. [doi: 10.1007/s00103-020-03156-1] [Medline: 32451596] 54. Matterne U, Diepgen TL, Weisshaar E. Effects of a health-educational and psychological intervention on socio-cognitive determinants of skin protection behaviour in individuals with occupational dermatoses. Int Arch Occup Environ Health. Feb 2010;83(2):183-189. [doi: 10.1007/s00420-009-0448-z] [Medline: 19641933] 55. Milne-Ives M, Homer SR, Andrade J, Meinert E. Potential associations between behavior change techniques and engagement with mobile health apps: a systematic review. Front Psychol. 2023;14:1227443. [FREE Full text] [doi: 10.3389/fpsyg.2023.1227443] [Medline: 37794916] 56. Jeffrey B, Bagala M, Creighton A, Leavey T, Nicholls S, Wood C, et al. Mobile phone applications and their use in the self-management of type 2 diabetes mellitus: a qualitative study among app users and non-app users. Diabetol Metab Syndr. 2019;11:84. [FREE Full text] [doi: 10.1186/s13098-019-0480-4] [Medline: 31636719] 57. Choukou MA, Sanchez-Ramirez DC, Pol M, Uddin M, Monnin C, Syed-Abdul S. COVID-19 infodemic and digital health literacy in vulnerable populations: a scoping review. Digit Health. 2022;8:20552076221076927. [FREE Full text] [doi: 10.1177/20552076221076927] [Medline: 35223076] 58. Dratva J, Schaeffer D, Zeeb H. [Digital health literacy in Germany: current status, concepts, and challenges]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. Mar 2024;67(3):277-284. [FREE Full text] [doi: 10.1007/s00103-024-03841-5] [Medline: 38315221] 59. Busse TS, Nitsche J, Kernebeck S, Jux C, Weitz J, Ehlers JP, et al. Approaches to improvement of digital health literacy (eHL) in the context of person-centered care. Int J Environ Res Public Health. Jul 07, 2022;19(14):8309. [FREE Full text] [doi: 10.3390/ijerph19148309] [Medline: 35886158] 60. Rocholl M, Wilke A, Meyer J, John SM, Ludewig M. Illness perceptions of patients with occupational skin diseases in a healthcare centre for tertiary prevention: a cross-sectional study. Int J Environ Res Public Health. Apr 26, 2023;20(9):5652. [FREE Full text] [doi: 10.3390/ijerph20095652] [Medline: 37174171] 61. Fox S, Brown LJ, Antrobus S, Brough D, Drake RJ, Jury F, et al. Co-design of a smartphone app for people living with dementia by applying agile, iterative co-design principles: development and usability study. JMIR Mhealth Uhealth. Jan 14, 2022;10(1):e24483. [FREE Full text] [doi: 10.2196/24483] [Medline: 35029539] 62. Poulsen A, Hickie IB, Alam M, LaMonica HM. User experience co-design of a mobile application to support childrearing in lowand middle-income countries. Stud Health Technol Inform. Jun 22, 2023;304:86-90. [doi: 10.3233/SHTI230377] [Medline: 37347576] 63. Vargas C, Whelan J, Brimblecombe J, Allender S. Co-creation, co-design, co-production for public health - a perspective on definition and distinctions. Public Health Res Pract. Jun 15, 2022;32(2):3222211. [FREE Full text] [doi: 10.17061/phrp3222211] [Medline: 35702744] JMIR Form Res 2025 | vol. 9 | e66791 | p. 18https://formative.jmir.org/2025/1/e66791 (page number not for citation purposes) Ristow et alJMIR FORMATIVE RESEARCH XSL • FO RenderX
Abbreviations AD: atopic dermatitis BCT: behavior change technique iDerm: Institute for Interdisciplinary Dermatological Prevention and Rehabilitation MiA: Mein Hautschutz im Alltag (“My skin protection in everyday life”) TIP: tertiary individual prevention uMARS: user version of the Mobile Application Rating Scale UX: user experience WRSD: work-related skin disease Edited by A Mavragani; submitted 24.09.24; peer-reviewed by K Stawarz; comments to author 03.02.25; revised version received 24.02.25; accepted 25.02.25; published 18.04.25 Please cite as: Ristow N, Wilke A, Skudlik C, John SM, Ludewig M User Experience of and Adherence to a Smartphone App to Maintain Behavior Change and Self-Management in Patients With Work-Related Skin Diseases: Multistep, Single-Arm Feasibility Study JMIR Form Res 2025;9:e66791 URL: https://formative.jmir.org/2025/1/e66791 doi: 10.2196/66791 PMID: ©Nele Ristow, Annika Wilke, Christoph Skudlik, Swen Malte John, Michaela Ludewig. Originally published in JMIR Formative Research (https://formative.jmir.org), 18.04.2025. This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included. JMIR Form Res 2025 | vol. 9 | e66791 | p. 19https://formative.jmir.org/2025/1/e66791 (page number not for citation purposes) Ristow et alJMIR FORMATIVE RESEARCH XSL • FO RenderX