0003_hawks

1 SUPPLEMENTARY INFORMATION Accurate Prediction of Momentary Cognition From Intensive Longitudinal Data Hawks et al. Contents Section 1 (S1): Codebook EMA variables…………………………………………………………………… page 2 Baseline variables…………………………………...…………………………… page 4 Continuous variable distributions…………………………...…………………. page 5 References.………..……………………………………………………………… page 6 Section 2 (S2): Supplementary methods and results S2.1. ………………………………………………………………………………. page 7 S2.2. ………………………………………………………………………………. page 9 S2.3. ………………………………………………………………………………. page 10 S2.4. ………………………………………………………………………………. page 11 S2.5. ………………………………………………………………………………. page 12 S2.6. ………………………………………………………………………………. page 13 S2.7. ………………………………………………………………………………. page 14 S2.8. ………………………………………………………………………………. page 21 S2.9. ………………………………………………………………………………. page 22 S2.10………………………………………………………………………………. page 23 References.………..……………………………………………………………… page 24 2 EMA Construct Variable Question Response levels Positive and Negative Affective Schedule (PANAS) Short Form (1)  Global prompt (GP): “For each of the next ten emotion words, indicate to what extent you felt this way right before you started this survey.”  Global rating scale (GRS): [1] Very slightly or not at all; [2] A little; [3] Moderately; [4] Quite a bit; [5] Extremely Negative affect (NA) NA_afrai d GP + afrai d GRS NA_distresse d GP + distresse d GRS NA_nervous GP + nervous GRS NA_scare d GP + scare d GRS NA_upse t GP + upse t GRS Positive affect (PA) PA_aler t GP + aler t GRS PA_determine d GP + determine d GRS PA_enthusiastic GP + enthusiastic GRS PA_excite d GP + excite d GRS PA_inspire d GP + inspire d GRS Daily Inventory of Stressful Events (2,3)  Global prompt (GP): “Since the last survey…” 1. Did you have an argument or disagreement with someone? 2. Did anything happen to a close friend or relative that turned out to be stressful for you? 3. Did anything stressful happen regarding your personal health? 4. Did anything else happen that you could have argued or disagreed about, but you let it pass? 5. Did anything else happen that most people would consider stressful? 6. How much time did you spend thinking about coronavirus/COVID-19?  Contingent follow-up (CF): If GP is endorsed (“yes” response or indication of time spent engaged in activity), then: “How stressful was this experience?”  Global rating scale (GRS): [1] GP not endorsed; [2] GP endorsed, “not at all” to CF; [3] GP endorsed, “a little b it” to CF; [4] GP endorsed, “somewhat” to CF; [5] GP endorsed, “very” to CF Stress stress_argument GP1 ± CF GRS stress_friend_relative GP2 ± CF GRS stress_health GP3 ± CF GRS stress_less_pass GP4 ± CF GRS stress_othe r GP5 ± CF GRS stress_covi d GP6 ± CF GRS Social Functioning Scale (4)  Global prompt (GP): “Since the last survey, about how many times did you talk or communicate with someone else?”  Contingent follow-up (CF): If GP is endorsed (e.g., one or more social interactions), then: 1. To what extent were these interactions worth the effort it took to have them? 2. How well do you think you communicated? 3. What do you think other people thought of you?  Modeling note: Given inte r correlations  0.9, CF items were replaced by a composite score (socialfunc_comp) Social functioning socialfunc_interactions GP [1] 0 interactions [2] 1 interaction [3] 2 or 3 interactions [4] 4 or more interactions socialfunc_worth_effort GP ± CF1 [0] GP not endorsed; [1] Too hard; Not worth trying ⟷ [7] Well worth effort socialfunc_communicated GP ± CF2 [0] GP not endorsed; [1] Made mistakes and failed ⟷ [7] Did well and succeede d socialfunc_others_thought GP ± CF3 [0] GP not endorsed; [1] Unlikeable, stupid, or weird ⟷ [7] Likeable, smart, interesting socialfunc_comp Composite score Computed as mean of socialfunc_worth_effort, socialfunc_communicated, and socialfunc_others_though t Anxiety & Depression Scale (5)  Global prompt (GP): Since the last survey, how often have you felt… 3  Global rating scale (GRS): [1] none of the time; [2] a little of the time; [3] some of the time; [4] most of the time; [5] all the time Anxiety and depression r estless_fidgety GP + restless or fidgety GRS sad_no_cheer GP + so sad that nothing could cheer you up GRS everything_an_effort GP + that everything was an effor t GRS hopeless GP + hopeless GRS irritate d GP + irritate d GRS worrie d GP + worrie d GRS depresse d GP + depression GRS Alertness Item (6) Alertness alert_sleepiness Please indicate your sleepiness during the 5 minutes before this survey by choosing the appropriate description. [1] extremely alert ⟷ [9] very sleepy, great effort to keep awake, fighting sleep Contextual Items  Global rating scale (GRS): [1] Not at all true; [2] A little bit true; [3] Somewhat true; [4] Very true Context context_going_on There is a lot going on around me right now. GRS context_diff_concentrating I am having trouble concentrating right now. GRS context_noisy I am in a very noisy place right now. GRS Attentional Items  Global prompt (GP): “On a scale of 1 to 5, with 1 being “not having difficulty at all” and 5 being “extreme difficulty,” to what extent are you CURRENTLY having difficulty...” 1. Fidgeting with your hands or feet or squirming in seat? 2. Following through on instructions and failing to finish things? 3. Being forgetful 4. Avoiding, disliking, or reluctantly doing things that require a lot of mental effort? 5. Feeling “on the go” or acting as if you are “driven by a motor”? 6. With organization?  Global rating scale (GRS): [1] Not having difficulty at all ⟷ [5] Extreme difficulty Attention attention_fidgeting GP1 GRS attention_finish GP2 GRS attention_forgetful GP3 GRS attention_mentaleffort GP4 GRS attention_moto r GP5 GRS attention_diff_organization GP6 GRS Interruptions Item  Administration note: Unlike items above, which were queried pre-cognitive EMA, interruptions were queried p os t -cognitive EMA Interruptions interruptions Did anything interrupt you during this assessment? [0] no, [1] yes Objectively derived variables Assessment timing study_days Days elapsed in study Acceptable values ranged [0-9] testPosition Position of test within b attery Acceptable values ranged [1-4] studytime Time assessment was completed Measured using 24-hour clock registered to participant’s local time-zone and divided by 24. Acceptable values range d [0, 1] sin_studytime Sine of time, computed as sin(2*pi*studytime) Acceptable values ranged [-1, 1] cos_studytime Cosine of time, computed as cos(2*pi*studytime) Acceptable values ranged [-1, 1] Device characteristics screenH Screen heigh t (in pixels) Observed values range d [320, 864] screenW Screen width (in pixels) Observed values range d [568, 1536] 4 Baseline Construct Variable Question Response levels Sleep wakeUpEarliest In a typical week, what’s the earliest you would wake up for the day? Acceptable values ranged [0-24] wakeUpLatest In a typical week, what’s the latest you would wake up for the day? Acceptable values ranged [0-24] wakeUpTypical In a typical week, what time do you wake up for the day? Acceptable values ranged [0-24] goToSleepEarliest In a typical week, what’s the earliest you would go to bed for the night? Acceptable values ranged [0-24] goToSleepLatest In a typical week, what’s the latest you go to bed for the night? Acceptable values ranged [0-24] goToSleepTypical In a typical week, what time do you go to bed for the night? Acceptable values ranged [0-24] sleep_dur Computed as time between wakeUpTypical and goToSleepTypical Acceptable values ranged (0-24) Demographics education What is the highest level of education you have completed? [1] High school; [2] Post-high school; [3] Bachelor’s degree; [4] Master’s degree; [5] Graduate or professional degree, e.g., PhD, MD, JD englishPrimary Is English your primary or native language? Factor levels: No (reference), yes gender What is your gender? Factor levels: Female (reference), male, nonb inary or genderquee r age What is your age? Measured in years age^2 Quadratic age term Measured in years2 5 Continuous variable distributions Raw score distributions for continuous variables. Dependent variables visualized in orange. 6 EMA items borrowed or adapted from: (1) Mackinnon, A., Jorm, A. F., Christensen, H., Korten, A. E., Jacomb, P. A., & Rodgers, B. (1999). A short form of the Positive and Negative Affect Schedule: Evaluation of factorial validity and invariance across demographic variables in a community sample. Personality and Individual differences, 27(3), 405-416. (2) Almeida, D. M., Wethington, E., & Kessler, R. C. (2002). The Daily Inventory of Stressful Events - An interview-based approach for measuring daily stressors. Assessment, 9(1), 41-55. (3) Stawski, R. S., Sliwinski, M. J., Almeida, D. M., & Smyth, J. M. (2008). Reported exposure and emotional reactivity to daily stressors: the roles of adult age and global perceived stress. Psychology and aging, 23(1), 52. (4) Granholm, E., Ben-Zeev, D., Fulford, D., & Swendsen, J. (2013). Ecological momentary assessment of social functioning in schizophrenia: impact of performance appraisals and affect on social interactions. Schizophrenia research, 145(1), 120-124. (5) Sliwinski, M. J., Almeida, D. M., Smyth, J., & Stawski, R. S. (2009). Intraindividual change and variability in daily stress processes: Findings from two measurement-burst diary studies. Psychology and Aging, 24(4), 828. (6) Akerstedt, T., Anund, A., Axelsson, J. and Kecklund, G. Subjective sleepiness is a sensitive indicator of insufficient sleep and impaired waking function. Journal of Sleep Research, 2014, 23: 240-52. 7 S2.1. Extended task descriptions. Links to tasks are available on GitHub. Refer to CogEMA_tasks.txt. Choice Reaction Time. Choice Reaction Time (CRT) (1,2) is an executive functioning task with demands on processing speed, cognitive inhibition, and cognitive control. CRT for EMA consisted of twenty-four trials. At the outset of each trial, three vertically aligned squares appeared. Squares were colored yellow and blue in a 2:1 ratio, such that one color only appeared one time, and each square contained an arrow pointing left (<) or right (>). At left and right, respectively, of the central square were buttons labeled “L” and “R.” Participants were instructed to press the button that matched the direction of the arrow in the off-colored square. Responses were to be made as quickly as possible. RT (CRT_medianRTc) was recorded as median reaction time on correct responses. Gradual Onset Continuous Performance Test. The Gradual Onset Continuous Performance Test (GCPT) (3,4) is an executive functioning task with demands on sustained attention, cognitive control, and response inhibition. GCPT for EMA consisted of 75 x 800 millisecond trials (total duration = 60 seconds). In each trial, participants viewed a circular, grayscale image of a city or mountain. They were instructed to press their device touchpad if the image depicted a city (80% of trials) and withhold a response if the image depicted a mountain (20% of trials). Images faded in and out between trials. Accuracy (GCPT_dprime) was computed as d-prime (d’), which indexes participants’ ability to discriminate targets from distractors (5). Multiple Object Tracking. Multiple Object Tracking (MOT) (6,7) is a visuospatial task with demands on selective attention, cognitive control, and working memory. MOT for EMA consisted of six trials. At the outset of each trial, ten black dots appeared, five of which briefly flashed green (target probes). Once target probes returned to black, all dots moved around the screen for five seconds. Difficulty increased across trials as the speed of dot motion increased. After motion terminated, participants were asked to recall target probes using their device touchpad. 8 Accuracy (MOT_percent_correct) was computed across trials as number of correctly identified targets divided by the total number of targets (n = 30). Digit-Symbol Matching. Digit-Symbol Matching (DS), adapted for remote administration from the Wechsler Adult Intelligence Scale (8), is a visuospatial task with demands on processing speed and short-term memory (9,10). In each EMA sitting, six symbols were sampled from a larger set of thirty. These symbols were paired with digits numbering 1, 2, or 3 in a 2:1 ratio. More specifically, digit-symbol pairings were oriented in a 3 x 3 grid, with digits in the bottom row. Symbol probes appeared sequentially above the grid for 30 seconds. Participants were instructed to use their device touchpad to identify the digit corresponding to the symbol probe, as reflected in digit-symbol pairings. After response selection, the next symbol probe appeared. RT (DS_medianRTc) was recorded as median reaction time on correct responses. 9 S2.2. Withinand between-person reliability statistics. Between-person reliability reflects the proportion of variance in scores attributable to differences between individuals; within-person reliability reflects systematic, within-person variation across assessments (i.e., variation that may be explained by time-varying predictors). Outcome Between-person reliability Within-person reliability MOT (percent correct) 0.97 0.27 DSM (median RTc) 0.99 0.70 GCPT (dprime) 0.94 0.54 CRT (medianRTc) 0.98 0.75 16 Effect Group Term estimate std.error conf.low conf.high pd fixed NA testPosition -0.048 0.010 -0.068 -0.029 1.000 fixed NA PA_aler t -0.036 0.018 -0.072 -0.001 0.982 fixed NA everything_an_effor t -0.035 0.017 -0.068 -0.001 0.980 fixed NA education -0.031 0.043 -0.140 0.026 0.773 fixed NA NA_nervous -0.021 0.015 -0.052 0.003 0.930 fixed NA PA_excited -0.020 0.017 -0.055 0.006 0.898 fixed NA goToSleepLates t -0.020 0.034 -0.107 0.032 0.714 fixed NA irritated -0.015 0.013 -0.043 0.006 0.880 fixed NA NA_scared -0.015 0.015 -0.047 0.009 0.849 fixed NA worried -0.013 0.014 -0.044 0.009 0.829 fixed NA age:sin_studytime -0.012 0.010 -0.034 0.005 0.885 fixed NA screenH -0.009 0.019 -0.054 0.023 0.683 fixed NA gendermale -0.009 0.039 -0.111 0.061 0.568 fixed NA attention_fidgeting -0.008 0.014 -0.040 0.015 0.715 fixed NA stress_othe r -0.005 0.009 -0.025 0.010 0.718 fixed NA stress_friend_relative -0.005 0.008 -0.023 0.010 0.704 fixed NA NA_distressed -0.004 0.011 -0.030 0.017 0.628 fixed NA screenW -0.003 0.020 -0.047 0.040 0.566 fixed NA goToSleepEarlies t -0.003 0.025 -0.061 0.048 0.544 fixed NA PA_determined -0.003 0.012 -0.028 0.020 0.578 fixed NA attention_moto r -0.002 0.011 -0.027 0.020 0.568 fixed NA wakeUpEarlies t -0.001 0.026 -0.063 0.054 0.512 fixed NA stress_health -0.001 0.007 -0.017 0.014 0.575 fixed NA attention_finish -0.001 0.012 -0.029 0.024 0.537 fixed NA PA_enthusiastic 0.000 0.013 -0.028 0.028 0.503 fixed NA stress_let_pass 0.000 0.008 -0.016 0.017 0.506 fixed NA context_noisy 0.000 0.011 -0.022 0.024 0.516 fixed NA restless_fidgety 0.000 0.011 -0.024 0.025 0.515 fixed NA NA_upse t 0.001 0.010 -0.021 0.024 0.511 fixed NA stress_argumen t 0.001 0.008 -0.015 0.018 0.540 fixed NA interruptions 0.001 0.008 -0.016 0.019 0.548 fixed NA stress_covid 0.002 0.010 -0.017 0.023 0.569 fixed NA socialfunc_comp 0.002 0.010 -0.017 0.024 0.574 fixed NA depressed 0.004 0.013 -0.022 0.035 0.607 fixed NA socialfunc_interactions 0.004 0.010 -0.016 0.027 0.646 fixed NA englishPrimaryyes 0.004 0.043 -0.079 0.104 0.526 fixed NA age:cos_studytime 0.004 0.009 -0.012 0.024 0.676 fixed NA gendernonMbinary 0.005 0.046 -0.082 0.111 0.537 fixed NA hopeless 0.005 0.013 -0.019 0.036 0.644 fixed NA PA_inspired 0.006 0.013 -0.018 0.036 0.657 17 Effect Group Term estimate std.error conf.low conf.high pd fixed NA goToSleepTypical 0.006 0.027 -0.047 0.071 0.572 fixed NA wakeUpTypical 0.010 0.030 -0.040 0.089 0.616 fixed NA sin_studytime 0.013 0.012 -0.006 0.039 0.883 fixed NA wakeUpLates t 0.014 0.032 -0.037 0.096 0.665 fixed NA attention_forgetful 0.016 0.016 -0.009 0.052 0.839 fixed NA NA_afraid 0.020 0.016 -0.006 0.054 0.904 fixed NA sad_no_chee r 0.020 0.017 -0.007 0.055 0.892 fixed NA attention_diff_organization 0.024 0.018 -0.005 0.062 0.919 fixed NA attention_mentaleffor t 0.025 0.018 -0.004 0.061 0.931 fixed NA sleep_du r 0.030 0.038 -0.023 0.123 0.784 fixed NA context_diff_concentrating 0.041 0.016 0.009 0.071 0.994 fixed NA alert_sleepiness 0.044 0.015 0.013 0.074 0.997 fixed NA context_going_on 0.046 0.016 0.013 0.077 0.998 fixed NA cos_studytime 0.076 0.013 0.052 0.102 1.000 fixed NA age^2 0.123 0.069 -0.001 0.257 0.972 ran_pars Residual sd__Observation 0.509 0.007 0.496 0.523 NA ran_pars user_id sd__(Intercept) 0.547 0.039 0.475 0.630 NA fixed NA age 0.584 0.079 0.431 0.739 1.000 DS_medianRTc_ParticipantMean fixed NA (Intercept) 0.010 0.080 -0.148 0.170 0.556 ran_pars Residual sd__Observation 0.546 0.007 0.532 0.560 NA ran_pars user_id sd__(Intercept) 0.851 0.057 0.749 0.972 NA GCPT_dprime_Conditional fixed NA interruptions -0.118 0.017 -0.152 -0.085 1.000 fixed NA context_diff_concentrating -0.065 0.024 -0.111 -0.017 0.998 fixed NA context_noisy -0.050 0.025 -0.098 -0.002 0.984 fixed NA alert_sleepiness -0.031 0.022 -0.076 0.004 0.933 fixed NA PA_excited -0.024 0.024 -0.077 0.010 0.855 fixed NA age^2 -0.022 0.033 -0.106 0.022 0.744 fixed NA context_going_on -0.021 0.022 -0.072 0.011 0.842 fixed NA goToSleepTypical -0.021 0.036 -0.119 0.024 0.717 fixed NA study_days -0.017 0.014 -0.047 0.005 0.898 fixed NA gendernonMbinary -0.008 0.041 -0.108 0.056 0.559 fixed NA attention_finish -0.008 0.016 -0.048 0.020 0.685 fixed NA stress_friend_relative -0.006 0.011 -0.032 0.013 0.692 fixed NA depressed -0.006 0.016 -0.045 0.023 0.628 fixed NA wakeUpLates t -0.006 0.026 -0.070 0.042 0.577 fixed NA attention_mentaleffor t -0.005 0.015 -0.040 0.024 0.604 fixed NA attention_fidgeting -0.005 0.016 -0.042 0.025 0.597 fixed NA sad_no_chee r -0.004 0.015 -0.041 0.024 0.603 18 Effect Group Term estimate std.error conf.low conf.high pd fixed NA hopeless -0.004 0.015 -0.040 0.026 0.597 fixed NA age:sin_studytime -0.004 0.012 -0.031 0.019 0.615 fixed NA irritated -0.004 0.013 -0.034 0.021 0.599 fixed NA attention_diff_organization -0.003 0.016 -0.039 0.028 0.581 fixed NA gendermale -0.003 0.033 -0.083 0.061 0.523 fixed NA stress_health -0.003 0.010 -0.027 0.016 0.615 fixed NA englishPrimaryyes -0.003 0.037 -0.085 0.069 0.518 fixed NA NA_scared -0.001 0.013 -0.031 0.025 0.538 fixed NA PA_inspired -0.001 0.016 -0.036 0.031 0.529 fixed NA testPosition -0.001 0.010 -0.024 0.019 0.551 fixed NA goToSleepLates t -0.001 0.024 -0.055 0.052 0.512 fixed NA wakeUpEarlies t -0.001 0.025 -0.056 0.053 0.503 fixed NA attention_forgetful 0.000 0.015 -0.033 0.033 0.501 fixed NA sleep_du r 0.000 0.023 -0.049 0.051 0.503 fixed NA restless_fidgety 0.001 0.014 -0.028 0.032 0.528 fixed NA NA_nervous 0.001 0.013 -0.026 0.030 0.529 fixed NA stress_argumen t 0.002 0.010 -0.019 0.025 0.557 fixed NA age 0.002 0.024 -0.048 0.058 0.532 fixed NA attention_moto r 0.003 0.014 -0.025 0.036 0.574 fixed NA socialfunc_interactions 0.003 0.013 -0.022 0.033 0.581 fixed NA stress_covid 0.003 0.012 -0.020 0.032 0.588 fixed NA NA_upse t 0.003 0.014 -0.024 0.035 0.579 fixed NA worried 0.004 0.014 -0.023 0.038 0.602 fixed NA socialfunc_comp 0.005 0.013 -0.020 0.035 0.628 fixed NA stress_let_pass 0.005 0.011 -0.015 0.032 0.667 fixed NA (Intercept) 0.006 0.075 -0.138 0.161 0.520 fixed NA PA_enthusiastic 0.008 0.019 -0.023 0.054 0.650 fixed NA wakeUpTypical 0.009 0.028 -0.039 0.081 0.619 fixed NA stress_othe r 0.010 0.014 -0.010 0.042 0.779 fixed NA NA_distressed 0.011 0.017 -0.015 0.050 0.744 fixed NA goToSleepEarlies t 0.012 0.029 -0.033 0.086 0.645 fixed NA everything_an_effor t 0.012 0.018 -0.015 0.054 0.755 fixed NA screenW 0.013 0.031 -0.041 0.089 0.664 fixed NA NA_afraid 0.013 0.017 -0.013 0.055 0.771 fixed NA cos_studytime 0.016 0.018 -0.010 0.056 0.824 fixed NA age:cos_studytime 0.018 0.015 -0.006 0.051 0.895 fixed NA PA_aler t 0.025 0.023 -0.008 0.076 0.880 fixed NA education 0.027 0.040 -0.022 0.131 0.760 fixed NA PA_determined 0.053 0.027 0.001 0.106 0.981 fixed NA screenH 0.057 0.039 -0.005 0.136 0.941 19 Effect Group Term estimate std.error conf.low conf.high pd fixed NA sin_studytime 0.063 0.019 0.027 0.102 1.000 ran_pars user_id sd__(Intercept) 0.596 0.042 0.519 0.687 NA ran_pars Residual sd__Observation 0.785 0.010 0.765 0.805 NA GCPT_dprime_ParticipantMean fixed NA (Intercept) -0.023 0.057 -0.133 0.089 0.658 ran_pars user_id sd__(Intercept) 0.599 0.042 0.523 0.688 NA ran_pars Residual sd__Observation 0.811 0.011 0.790 0.832 NA MOT_percent_correct_Conditional fixed NA age -0.226 0.093 -0.393 -0.016 0.991 fixed NA interruptions -0.102 0.014 -0.130 -0.074 1.000 fixed NA context_noisy -0.045 0.023 -0.089 -0.001 0.980 fixed NA context_going_on -0.040 0.024 -0.086 0.001 0.964 fixed NA sleep_du r -0.035 0.047 -0.155 0.021 0.786 fixed NA age^2 -0.034 0.050 -0.167 0.024 0.767 fixed NA PA_inspired -0.022 0.021 -0.069 0.008 0.872 fixed NA attention_diff_organization -0.019 0.020 -0.064 0.012 0.831 fixed NA attention_finish -0.016 0.019 -0.058 0.011 0.811 fixed NA stress_friend_relative -0.014 0.013 -0.041 0.006 0.879 fixed NA screenW -0.013 0.024 -0.074 0.024 0.692 fixed NA attention_forgetful -0.012 0.018 -0.054 0.015 0.749 fixed NA hopeless -0.011 0.017 -0.052 0.016 0.737 fixed NA NA_afraid -0.011 0.015 -0.045 0.012 0.765 fixed NA sin_studytime -0.010 0.012 -0.037 0.009 0.793 fixed NA PA_excited -0.008 0.015 -0.044 0.017 0.696 fixed NA wakeUpLates t -0.007 0.028 -0.075 0.045 0.585 fixed NA englishPrimaryyes -0.006 0.040 -0.104 0.061 0.543 fixed NA alert_sleepiness -0.006 0.012 -0.035 0.016 0.681 fixed NA context_diff_concentrating -0.006 0.013 -0.036 0.017 0.670 fixed NA stress_let_pass -0.005 0.010 -0.028 0.013 0.677 fixed NA attention_moto r -0.004 0.014 -0.036 0.021 0.613 fixed NA NA_scared -0.004 0.012 -0.033 0.019 0.617 fixed NA depressed -0.004 0.014 -0.037 0.024 0.595 fixed NA attention_fidgeting -0.004 0.015 -0.038 0.025 0.583 fixed NA sad_no_chee r -0.004 0.014 -0.036 0.023 0.592 fixed NA goToSleepLates t -0.003 0.025 -0.064 0.047 0.546 fixed NA everything_an_effor t -0.003 0.013 -0.033 0.022 0.585 fixed NA socialfunc_interactions -0.003 0.012 -0.030 0.020 0.588 fixed NA screenH -0.001 0.019 -0.041 0.039 0.537 fixed NA age:sin_studytime -0.001 0.009 -0.021 0.019 0.519 fixed NA PA_enthusiastic -0.001 0.014 -0.033 0.030 0.510 20 Effect Group Term estimate std.error conf.low conf.high pd fixed NA age:cos_studytime 0.000 0.009 -0.019 0.021 0.516 fixed NA socialfunc_comp 0.001 0.011 -0.022 0.025 0.521 fixed NA stress_health 0.001 0.009 -0.018 0.020 0.539 fixed NA gendernonMbinary 0.001 0.038 -0.074 0.082 0.513 fixed NA goToSleepTypical 0.001 0.027 -0.055 0.062 0.517 fixed NA NA_upse t 0.002 0.012 -0.022 0.028 0.567 fixed NA irritated 0.002 0.012 -0.021 0.029 0.579 fixed NA attention_mentaleffor t 0.003 0.014 -0.023 0.035 0.576 fixed NA cos_studytime 0.003 0.010 -0.017 0.027 0.614 fixed NA NA_distressed 0.004 0.013 -0.020 0.034 0.615 fixed NA wakeUpEarlies t 0.005 0.029 -0.049 0.073 0.548 fixed NA education 0.005 0.026 -0.045 0.072 0.565 fixed NA NA_nervous 0.005 0.013 -0.017 0.034 0.643 fixed NA wakeUpTypical 0.005 0.028 -0.048 0.075 0.562 fixed NA stress_othe r 0.009 0.012 -0.009 0.034 0.771 fixed NA stress_covid 0.009 0.014 -0.012 0.041 0.753 fixed NA worried 0.010 0.016 -0.014 0.047 0.742 fixed NA gendermale 0.017 0.049 -0.047 0.149 0.626 fixed NA PA_aler t 0.018 0.018 -0.009 0.058 0.842 fixed NA PA_determined 0.019 0.020 -0.010 0.062 0.843 fixed NA testPosition 0.020 0.013 -0.001 0.046 0.955 fixed NA goToSleepEarlies t 0.021 0.037 -0.028 0.122 0.718 fixed NA stress_argumen t 0.036 0.014 0.006 0.064 0.995 fixed NA (Intercept) 0.038 0.088 -0.122 0.225 0.659 fixed NA restless_fidgety 0.042 0.023 0.000 0.087 0.973 fixed NA study_days 0.071 0.013 0.046 0.096 1.000 ran_pars Residual sd__Observation 0.653 0.009 0.635 0.670 NA ran_pars user_id sd__(Intercept) 0.665 0.047 0.578 0.762 NA MOT_percent_correct_ParticipantMean fixed NA (Intercept) -0.003 0.070 -0.137 0.138 0.515 ran_pars Residual sd__Observation 0.674 0.009 0.657 0.692 NA ran_pars user_id sd__(Intercept) 0.748 0.050 0.656 0.852 NA 21 S2.8. Strong predictors from stratified cross-validation. Predictors are sorted by cognitive outcome (rows), fold number (columns), and coefficient magnitude (within panels, along y-axis). Significant (sig.) predictors, for which 95% CI did not include zero, are identified by a salmon-colored dot. Std. beta = standardized beta. Fold 1 Fold 2 Fold 3 Fold 4 Fold 5 −0.2 0.0 0.2 0.4 −0.2 0.0 0.2 0.4 −0.2 0.0 0.2 0.4 −0.2 0.0 0.2 0.4 −0.2 0.0 0.2 0.4 study_days testPosition age:sin_studytime PA_ al er t everything_an_effort stress_other context_noisy NA_upset attention_diff_organization PA_inspired attention_forgetful sin_studytime cos_studytime alert_sleepiness age^2 age Std. beta CRT: medianRTc Fold 1 Fold 2 Fold 3 Fold 4 Fold 5 0.00 0.25 0.50 0.75 0.00 0.25 0.50 0.75 0.00 0.25 0.50 0.75 0.00 0.25 0.50 0.75 0.00 0.25 0.50 0.75 study_days testPosition PA_ al er t everything_an_effort PA_excited NA_nervous irritated worried NA_scared age:sin_studytime sin_studytime sad_no_cheer attention_forgetful attention_diff_organization attention_mentaleffort context_diff_concentrating context_going_on alert_sleepiness cos_studytime age^2 age Std. beta DS: medianRTc Fold 1 Fold 2 Fold 3 Fold 4 Fold 5 −0.1 0.0 0.1 −0.1 0.0 0.1 −0.1 0.0 0.1 −0.1 0.0 0.1 −0.1 0.0 0.1 interruptions context_diff_concentrating context_noisy alert_sleepiness study_days stress_other age:cos_studytime PA_ al er t PA_determined screenH sin_studytime Std. beta GCPT: dprime Fold 1 Fold 2 Fold 3 Fold 4 Fold 5 −0.4 −0.3 −0.2 −0.1 0.0 0.1 −0.4 −0.3 −0.2 −0.1 0.0 0.1 −0.4 −0.3 −0.2 −0.1 0.0 0.1 −0.4 −0.3 −0.2 −0.1 0.0 0.1 −0.4 −0.3 −0.2 −0.1 0.0 0.1 age interruptions context_noisy context_going_on attention_forgetful PA_determined testPosition stress_argument restless_fidgety study_days Std. beta MOT: percent correct Interval 0.8 0.85 0.9 0.95 Sig. F T 22 S2.9. Strong predictors from grouped cross-validation. Predictors are sorted by cognitive outcome (rows), fold number (columns), and coefficient magnitude (within panels, along y-axis). Significant (sig.) predictors, for which 95% CI did not include zero, are identified by a salmon-colored dot. Std. beta = standardized beta. Fold 1 Fold 2 Fold 3 Fold 4 Fold 5 −0.25 0.00 0.25 0.50 −0.25 0.00 0.25 0.50 −0.25 0.00 0.25 0.50 −0.25 0.00 0.25 0.50 −0.25 0.00 0.25 0.50 study_days testPosition education age:sin_studytime PA_ al er t screenH everything_an_effort stress_other context_diff_concentrating NA_upset context_noisy attention_diff_organization attention_forgetful PA_inspired cos_studytime sin_studytime alert_sleepiness age age^2 Std. beta CRT: medianRTc Fold 1 Fold 2 Fold 3 Fold 4 Fold 5 0.0 0.3 0.6 0.0 0.3 0.6 0.0 0.3 0.6 0.0 0.3 0.6 0.0 0.3 0.6 study_days testPosition PA_ al er t everything_an_effort PA_excited NA_nervous NA_scared worried irritated age:sin_studytime sin_studytime attention_mentaleffort NA_afraid sad_no_cheer attention_diff_organization context_diff_concentrating context_going_on alert_sleepiness cos_studytime age^2 age Std. beta DS: medianRTc Fold 1 Fold 2 Fold 3 Fold 4 Fold 5 −0.1 0.0 0.1 −0.1 0.0 0.1 −0.1 0.0 0.1 −0.1 0.0 0.1 −0.1 0.0 0.1 interruptions context_diff_concentrating context_noisy alert_sleepiness study_days everything_an_effort age:cos_studytime PA_ al er t PA_determined screenH sin_studytime Std. beta GCPT: dprime Fold 1 Fold 2 Fold 3 Fold 4 Fold 5 −0.4 −0.3 −0.2 −0.1 0.0 0.1 −0.4 −0.3 −0.2 −0.1 0.0 0.1 −0.4 −0.3 −0.2 −0.1 0.0 0.1 −0.4 −0.3 −0.2 −0.1 0.0 0.1 −0.4 −0.3 −0.2 −0.1 0.0 0.1 age interruptions context_noisy context_going_on attention_finish stress_friend_relative sin_studytime PA_ al er t testPosition stress_argument restless_fidgety study_days Std. beta MOT: percent correct Interval 0.8 0.85 0.9 0.95 Sig. F T 23 S2.10. Post-hoc hierarchical linear models evaluating intraand inter-individual effects on cognitive performance. Gray shading identifies significant and marginal terms (p < .10), red text identifies intra-individual predictors, and black text identifies inter-individual predictors. Term estimate std.error t.value df p.value ci.l ci.u CRT_medianRTc (Intercept) 711.074 9.113 78.025 118.897 0.000 693.028 729.120 alert _ sleepiness _ pm -9.728 9.756 -0.997 118.902 0.321 -29.047 9.591 attention _ for g etful _ p m 14.394 9.704 1.483 118.953 0.141 -4.822 33.610 alert _ sleepiness _ cwp 11.344 1.267 8.956 2934.898 0.000 8.861 13.828 attention _ for g etful _ cwp 6.307 1.400 4.506 2934.898 0.000 3.563 9.052 DS_medianRTc (Intercept) 811.563 11.171 72.646 117.955 0.000 789.440 833.685 context _ composite _ pm -4.353 11.753 -0.370 117.907 0.712 -27.628 18.922 alert _ composite _ pm 36.016 11.634 3.096 117.990 0.002 12.979 59.054 ever y thin g_ an _ effort _ p m 5.868 12.000 0.489 117.933 0.626 -17.895 29.631 context _ composite _ cwp 8.865 1.497 5.921 2936.958 0.000 5.929 11.801 alert _ composite _ cwp -7.806 1.490 -5.239 2936.958 0.000 -10.728 -4.885 ever y thin g_ an _ effort _ cwp -2.698 1.636 -1.649 2936.958 0.099 -5.907 0.511 GCPT_dprime (Intercept) 2.833 0.041 68.707 115.639 0.000 2.751 2.914 PA _ determined _ p m -0.044 0.043 -1.037 115.120 0.302 -0.128 0.040 context _ nois y_ pm 0.017 0.062 0.280 117.795 0.780 -0.106 0.141 context _ diff _ concentratin g_ pm -0.065 0.057 -1.144 116.188 0.255 -0.178 0.048 interruptions _ pm -0.028 0.050 -0.565 116.347 0.573 -0.128 0.071 PA _ determined _ cwp 0.053 0.011 4.910 2923.035 0.000 0.032 0.075 context _ nois y_ cwp -0.042 0.012 -3.451 2923.035 0.001 -0.066 -0.018 context _ diff _ concentratin g_ cwp -0.041 0.012 -3.365 2923.035 0.001 -0.064 -0.017 interruptions _ cwp -0.088 0.011 -7.677 2923.035 0.000 -0.110 -0.065 MOT_percent_correct (Intercept) 0.739 0.008 94.638 117.074 0.000 0.723 0.754 stress _ ar g ument _ pm -0.002 0.008 -0.227 116.950 0.821 -0.018 0.014 context _ nois y_ pm -0.009 0.010 -0.905 117.150 0.367 -0.028 0.010 interruptions _ pm -0.004 0.009 -0.417 116.945 0.677 -0.023 0.015 stress _ ar g ument _ cwp 0.005 0.002 3.036 2831.105 0.002 0.002 0.008 context _ nois y_ cwp -0.007 0.001 -4.960 2831.105 0.000 -0.010 -0.004 interruptions _ cwp -0.012 0.001 -7.906 2831.105 0.000 -0.015 -0.009 Df = degrees of freedom; _pm = participant mean; _cwp = centered within participants; ci.l = lower bound of 95% confidence interval; ci.u = upper bound of 95% confidence interval 24 References 1. Rutter LA, Vahia I V., Forester BP, Ressler KJ, Germine L. Heterogeneous Indicators of Cognitive Performance and Performance Variability Across the Lifespan. Front Aging Neurosci. 2020;12(March):1–9. 2. Germine LT, Joormann J, Passell E, Rutter LA, Scheuer L, Martini P, et al. Neurocognition after motor vehicle collision and adverse post-traumatic neuropsychiatric sequelae within 8 weeks: Initial findings from the AURORA study. J Affect Disord [Internet]. 2022;298(PB):57–67. Available from: https://doi.org/10.1016/j.jad.2021.10.104 3. Esterman M, Noonan SK, Rosenberg M, Degutis J. In the zone or zoning out? Tracking behavioral and neural fluctuations during sustained attention. Cereb Cortex. 2013;23(11):2712–23. 4. Fortenbaugh FC, Degutis J, Germine L, Wilmer JB, Grosso M, Russo K, et al. Sustained attention across the life span in a sample of 10,000: Dissociating ability and strategy. Psychol Sci. 2015;26(9):1497–510. 5. Pastore RE, Scheirer CJ. Signal detection theory: Considerations for general application. Psychol Bull. 1974;81(12):945. 6. Storm RW, Pylyshyn ZW. Tracking multiple independent targets: Evidence for a parallel tracking mechanism. Spat Vis. 1988;3(3):179–97. 7. Treviño M, Zhu X, Lu YY, Scheuer LS, Passell E, Huang GC, et al. How do we measure attention? Using factor analysis to establish construct validity of neuropsychological tests. Cogn Res Princ Implic. 2021;6(1):1–26. 8. Wechsler D. WAIS‐III administration and scoring manual. The Psychological Corporation, San Antonio, TX. Wechsler, D(1997) WAIS III Adm Scoring Manual Psychol Corp San Antonio, TX. 1997; 9. Hartshorne JK, Germine LT. When Does Cognitive Functioning Peak? The Asynchronous Rise and Fall of Different Cognitive Abilities Across the Life Span. Psychol Sci. 2015 Apr 25 18;26(4):433–43. 10. Chaytor NS, Barbosa-Leiker C, Germine LT, Fonseca LM, McPherson SM, Tuttle KR. Construct validity, ecological validity and acceptance of self-administered online neuropsychological assessment in adults. Clin Neuropsychol [Internet]. 2021;35(1):148– 64. Available from: https://doi.org/10.1080/13854046.2020.1811893 11. Passell E, Strong RW, Rutter LA, Kim H, Scheuer L, Martini P, et al. Cognitive test scores vary with choice of personal digital device. Behav Res Methods. 2021;53(6):2544– 57. 12. van Erp S, Oberski DL, Mulder J. Shrinkage priors for Bayesian penalized regression. J Math Psychol [Internet]. 2019;89:31–50. Available from: https://doi.org/10.1016/j.jmp.2018.12.004 13. Carvalho CM, Polson NG, Scott JG. Handling sparsity via the horseshoe. J Mach Learn Res. 2009;5:73–80. 14. Vehtarh A, Gelman A, Simpson D, Carpenter B, Burkner PC. Rank-Normalization, Folding, and Localization: An Improved (Formula presented) for Assessing Convergence of MCMC (with Discussion)*†. Bayesian Anal. 2021;16(2):667–718. 15. Gelman A, Rubin DB. Inference from Iterative Simulation Using Multiple Sequences. Stat Sci [Internet]. 1992 Nov 1;7(4):457–72. Available from: https://doi.org/10.1214/ss/1177011136 16. Vehtari A, Gelman A, Gabry J. Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC. Stat Comput. 2017;27(5):1413–32.