A Pseudo-Pilot Workload Assessment Tool Based on NASA-TLX

PP-TLX A Pseudo-Pilot Workload Assessment Tool Based on NASA-TLX Mustafa Özdemir, Kadir Dönmez, Soner Demirel [email protected], [email protected], [email protected] PP-TLX Mental Demand (MD) Decision making Remembering/ monitoring Physical Demand (PD) Frequency occupancy The number of instructions Measurement/ calculating Preparation for exercise Change of pre-defined parameters Temporal Demand (TD) Immediate actions Emergency situations Performance (PER) Missing / incorrect actions of PPs Effort (EF) Exercise duration The number of IFR flights The number of VFR flights Frustration (FR) The number of warnings given to the PPs’ Missing / incorrect actions of controllers Technical issues Communication problems 0 20 40 60 80 100 NASA-TLX PP-TLX NASA-TLX PP-TLX NASA-TLX PP-TLX NASA-TLX PP-TLX NASA-TLX PP-TLX NASA-TLX PP-TLX MD TD PD PER EFF FR Workload Score 0 20 40 60 80 100 NASA-TLX PP-TLX NASA-TLX PP-TLX NASA-TLX PP-TLX NASA-TLX PP-TLX NASA-TLX PP-TLX NASA-TLX PP-TLX NASA-TLX PP-TLX NASA-TLX PP-TLX NASA-TLX PP-TLX AC1-T AC1-G AC2-T AC2-G RAPC PAC RAC RC-AP RC-AR Workload Score Fig. 1 Work flow chart of a pseudo-pilot Mouse Move & click Keyboard Press buttons Controller instructions Radio Press the button, speak & listen PseudoPilot Radar screen Input Readback Methodology o Proposed workload sub-scales were determined by interviewing six pseudo-pilots. o These PPs have 5 to 8 years of experience in this position. o Firstly, 57 sub-scales were defined. o Then, the number of the sub-scales decreased to 19 after the first evaluation. o The content validity method (CVM) was used to determine the key workload sub-scales. o As a result of the CVM analysis, 17 sub-scales were selected. o The PP-TLX was developed by combining these sub-scales and the NASA-TLX scales. o PP-TLX will be validated through performance and physiological (EEG (Electroencephalogram), eye blink, heart rate) measures. NASA-TLX scales Proposed sub-scales RESULTS Aim: The aim of this study is to improve the sub-parameters of the Nasa-TLX including task-specific parameters of pseudo-pilot and to measure the workload perceptions of pseudo-pilot more accurately and easily. PP-TLX allows the sub-scales to be compared among themselves by sorting them hierarchically according to their level of contribution to the workload. Fig. 4 According to the t-test results, no significant difference was observed between the measurement scores of the two tools for each task. Fig. 3 The two tools show significant difference in PD (t = 4.769, p <0.001) and FR (t = - 2.319, p <0.05) scores according to the independent samples t-test. Fig. 2 PP-TLX tool with proposed sub-scales and NASA-TLX scales Fig. 3 Comparison of the tools in terms of the scales Fig. 4 The average workload for 9 different simulation tasks measured with the two tools