scieee Science in your language
[en] (orig)

Adaptation and validation of the individual work performance questionnaire into a Portuguese version

Author: Lousã, Eva Petiz,Alves, Marta Pereira,Koopmans, Linda
Publisher: Basel: MDPI
Year: 2024
DOI: 10.3390/admsci14070150
Source: https://www.econstor.eu/bitstream/10419/320964/1/admsci-14-00150.pdf
Lousã, E a Pe iz; Al es, Ma a Pe ei a; Koopmans, Linda
A icle
Adap a ion and alida ion o he indi idual wo k
pe o mance ques ionnai e in o a Po uguese e sion
Adminis a i e Sciences
P o ided in Coope a ion wi h:
MDPI – Mul idisciplina y Digi al Publishing Ins i u e, Basel
Sugges ed Ci a ion: Lousã, E a Pe iz; Al es, Ma a Pe ei a; Koopmans, Linda (2024) : Adap a ion
and alida ion o he indi idual wo k pe o mance ques ionnai e in o a Po uguese e sion,
Adminis a i e Sciences, ISSN 2076-3387, MDPI, Basel, Vol. 14, Iss. 7, pp. 1-13,
h ps://doi.o g/10.3390/admsci14070150
This Ve sion is a ailable a :
h ps://hdl.handle.ne /10419/320964
S anda d-Nu zungsbedingungen:
Die Dokumen e au EconS o dü en zu eigenen wissenscha lichen
Zwecken und zum P i a geb auch gespeiche und kopie we den.
Sie dü en die Dokumen e nich ü ö en liche ode komme zielle
Zwecke e iel äl igen, ö en lich auss ellen, ö en lich zugänglich
machen, e eiben ode ande wei ig nu zen.
So e n die Ve asse die Dokumen e un e Open-Con en -Lizenzen
(insbesonde e CC-Lizenzen) zu Ve ügung ges ell haben soll en,
gel en abweichend on diesen Nu zungsbedingungen die in de do
genann en Lizenz gewäh en Nu zungs ech e.
Te ms o use:
Documen s in EconS o may be sa ed and copied o you pe sonal
and schola ly pu poses.
You a e no o copy documen s o public o comme cial pu poses, o
exhibi he documen s publicly, o make hem publicly a ailable on he
in e ne , o o dis ibu e o o he wise use he documen s in public.
I he documen s ha e been made a ailable unde an Open Con en
Licence (especially C ea i e Commons Licences), you may exe cise
u he usage igh s as speci ied in he indica ed licence.
h ps://c ea i ecommons.o g/licenses/by/4.0/
Ci a ion: Lousã, E a Pe iz, Ma a
Pe ei a Al es, and Linda Koopmans.
2024. Adap a ion and Valida ion o
he Indi idual Wo k Pe o mance
Ques ionnai e in o a Po uguese
Ve sion. Adminis a i e Sciences 14:
150. h ps://doi.o g/10.3390/
admsci14070150
Recei ed: 3 June 2024
Re ised: 6 July 2024
Accep ed: 10 July 2024
Published: 15 July 2024
Copy igh : © 2024 by he au ho s.
Licensee MDPI, Basel, Swi ze land.
This a icle is an open access a icle
dis ibu ed unde he e ms and
condi ions o he C ea i e Commons
A ibu ion (CC BY) license (h ps://
c ea i ecommons.o g/licenses/by/
4.0/).
adminis a i e
sciences
A icle
Adap a ion and Valida ion o he Indi idual Wo k Pe o mance
Ques ionnai e in o a Po uguese Ve sion
E a Pe iz Lousã1,2,3,* , Ma a Pe ei a Al es 3and Linda Koopmans 4
1
Resea ch Uni in Business Sciences and Sus ainabili y (UNICES), Uni e si y o Maia, 4475-690 Maia, Po ugal
2
Cen e o O ganiza ional and Social S udies o Poly echnic o Po o (CEOS.PP, ISCAP, Poly echnic o Po o),
4465-004 Po o, Po ugal
3Resea ch Cen e in Business Sciences (NECE-UBI), Uni e si y o Bei a In e io , 6200-209 Co ilhã, Po ugal;
[email p o ec ed]
4TNO Heal hy Li ing and Wo k, Depa men o Sus ainable P oduc i i y and Employabili y,
2333 BE Leiden, The Ne he lands; [email p o ec ed]
*Co espondence: [email p o ec ed]
Abs ac : The aim o his s udy is o adap and alida e he Indi idual Wo k Pe o mance Ques ion-
nai e (IWPQ) o a Po uguese e sion (IWPQ-PT) and o e alua e i s psychome ic p ope ies in a
sample o 423 digi al sec o wo ke s. Two s udies we e conduc ed o de ine he ac o ial s uc u e.
In s udy 1 (n= 162), he esul s o an explo a o y ac o analysis poin ed o a h ee- ac o s uc u e
(18 i ems), explaining 55.56% o he a iance. In s udy 2 (n= 261), he esul s o a con i ma o y ac o
analysis e ealed a good model i (CFI = 0.95; RMSEA = 0.06), also ep oducing he s uc u e o
he o iginal model. The o e all scale and subscales demons a ed good eliabili y, wi h C onbach’s
alpha coe icien s anging om 0.72 o 0.88. Co ela ions be ween he IWPQ-PT subscales and o he
ins umen s e ealed ha highe ask and con ex ual pe o mance a e associa ed wi h inc eased job
sa is ac ion, wo k engagemen , and dec eased u no e in en ion. Con e sely, coun e p oduc i e
wo k beha io is associa ed wi h lowe job sa is ac ion, wo k engagemen , and highe u no e
in en ion. This s udy unde sco es he con ibu ions o he IWPQ-PT as a eliable and alid ool o
assessing indi idual wo k pe o mance in Po uguese o ganiza ions and highligh s i s con ibu ions
o he ield o employee wo k pe o mance esea ch as well as human esou ces p ac ices.
Keywo ds: indi idual wo k pe o mance; ask pe o mance; con ex ual pe o mance; coun e p o-
duc i e wo k beha io ; psychome ics
1. In oduc ion
Indi idual pe o mance a wo k mus be s udied in o de o unde s and how people
con ibu e o an o ganiza ion’s success and ensu e i s compe i i eness. Indi idual pe o -
mance has been add essed bo h as an ou come o dependen a iable in esea ch (Ca pini
e al. 2017;Koopmans e al. 2011), and o e he las cen u y, his opic has been cen al o
schola s, highligh ing i s ele ance and complexi y (Ca pini e al. 2017;Dalal e al. 2020).
Se e al heo e ical amewo ks ha e been p oposed o unde s and and analyze job pe o -
mance (Campbell and Wie nik 2015;Ca pini e al. 2017). This di e si y mi o s he ocus
o di e en disciplines: managemen , occupa ional heal h, and wo k and o ganiza ional
psychology. Managemen is ocused on inc easing employee p oduc i i y (e.g., Bea on e al.
2009); occupa ional heal h ocuses on p e en ing p oduc i i y loss due o heal h issues
(e.g., Schul z e al. 2009); and wo k and o ganiza ional psychologis s s udy he associa ion
be ween an eceden s, like wo k engagemen , sa is ac ion, and pe sonali y, and indi idual
wo k pe o mance (Halbeslebe e al. 2008;Judge e al. 2001). None heless, he e is a con-
sensus in he li e a u e ha indi idual wo k pe o mance can be de ined as he beha io s
o ac ions o employees ha a e ele an o he o ganiza ion’s objec i es (Campbell 1990;
Adm. Sci. 2024,14, 150. h ps://doi.o g/10.3390/admsci14070150 h ps://www.mdpi.com/jou nal/admsci
Adm. Sci. 2024,14, 150 2 o 13
Campbell and Wie nik 2015;Ca pini e al. 2017;Koopmans e al. 2011). This de ini ion high-
ligh s some impo an cha ac e is ics o indi idual job pe o mance. On he one hand, i
pu s he a en ion on employee beha io s. On he o he hand, i emphasizes ha indi idual
pe o mance a wo k in ol es he conc e e ac i i ies ha employees pe o m o achie e he
o ganiza ion’s goals. In addi ion, hese beha io s a e unde s ood om a mul idimensional
pe spec i e (e.g., Campbell 1990;Campbell and Wie nik 2015;Koopmans e al. 2011), which
encompasses pe o mance o he ask (i.e., con ibu ing di ec ly o he p oduc ion o goods
o se ices); o ganiza ional ci izenship beha io s (i.e., employee beha io s ha bene i
he o ganiza ion’s social and psychological en i onmen , and in his sense, con ibu e o
i s o e all goals); and coun e p oduc i e beha io s a wo k (i.e., olun a y ac ions ha
ha e he po en ial o ha m he well-being o he o ganiza ion and i s s akeholde s). Job
pe o mance is also linked wi h p oac i e beha io (i.e., i in ol es an icipa o y ac ions
by employees o impac hemsel es o he wo k en i onmen ), c ea i e beha io (i.e., i
encompasses he gene a ion o inno a i e ideas and solu ions), and adap i e pe o mance
(i.e., i includes beha io al modi ica ions in esponse o he demands and si ua ions o he
wo k en i onmen ) (Dalal e al. 2020).
Koopmans e al. (2012) iden i ied se e al limi a ions associa ed wi h he a ie y o
scales used o measu e he dimensions o indi idual wo k pe o mance (e.g., Podsako and
MacKenzie 1989;Spec o e al. 2006;Williams and Ande son 1991). Fi s , no single scale en-
compasses all dimensions, equi ing esea che s o combine mul iple ins umen s. Second,
he way hese dimensions a e de ined and ope a ionalized a ies ac oss scales, making
i di icul o choose he mos app op ia e one o a speci ic s udy popula ion. Ano he
issue is he p esence o an i he ical i ems, as obse ed by Dalal (2005), whe e o e lapping
beha io s a e ound in scales ha measu e di e en dimensions, comp omising he con en
alidi y o he measu es. To add ess hese limi a ions and acili a e he op imal measu e-
men o indi idual wo k pe o mance, Koopmans e al. (2014b) de eloped he Indi idual
Wo k Pe o mance Ques ionnai e (IWPQ) o assessing indi idual-le el wo k pe o mance
in a gene ic and sho ques ionnai e. The Indi idual Wo k Pe o mance Ques ionnai e
was de eloped in se e al phases. Ini ially, Koopmans e al. (2011), based on a sys ema ic
e iew o he li e a u e on indi idual wo k pe o mance in di e en ields o esea ch,
namely in occupa ional heal h, psychology, and managemen , iden i ied ou dimensions
equen ly used o desc ibe indi idual pe o mance in any job: ask pe o mance; con ex-
ual pe o mance; coun e p oduc i e wo k beha io ; and adap i e pe o mance. In a la e
s udy, Koopmans e al. (2012) de eloped a gene ic and sho ques ionnai e o measu e job
pe o mance a he indi idual le el and iden i ied a h ee-dimensional s uc u e, consis ing
o ask pe o mance, con ex ual pe o mance, and coun e p oduc i e wo k beha io . I ems
ela ed o adap i e pe o mance we e included in con ex ual pe o mance. Koopmans
e al. (2011) de ined ask pe o mance as he compe ence wi h which indi iduals pe o m
he essen ial o echnical asks cen al o hei wo k. This is he adi ional ocus o he
indi idual pe o mance cons uc a wo k, and i in ol es he e ec i e execu ion o he
speci ic esponsibili ies assigned o a ole o posi ion. Con ex ual pe o mance, acco ding
o Koopmans e al. (2011), consis s o beha io s ha con ibu e o he o ganiza ional, social,
and psychological en i onmen in which echnical wo k is pe o med. These beha io s
suppo and acili a e he e ec i e unc ioning o he wo k en i onmen , p omo ing a
posi i e and collabo a i e o ganiza ional clima e. Addi ionally, Koopmans e al. (2011)
desc ibed coun e p oduc i e wo k beha io as beha io s ha ha m he well-being and
unc ioning o he o ganiza ion. This includes ac ions such as sabo age, une hical beha io ,
excessi e absen eeism, and misapp op ia ion o he o ganiza ion’s esou ces, among o he s,
which ha e a nega i e impac on he company’s ope a ions and esul s.
The IWPQ was de eloped in he Ne he lands and Koopmans e al. (2016) cul u ally
adap ed he ins umen o Ame ican English, e alua ing he in e nal consis ency and
con en alidi y o he ques ionnai e in his con ex . Resea ch wi h he IWPQ has shown
alidi y e idence ac oss di e en coun ies, such as Bahasa Indonesia (Widyas u i and
Hidaya 2018), I aly (Pla ania e al. 2023), Vie nam (Nguyen-Duc e al. 2023), and Spain
Adm. Sci. 2024,14, 150 3 o 13
(Ramos-Villag asa e al. 2019). In Po ugal, he e is no ins umen o assess indi idual
pe o mance a wo k. In his sense, i s adap a ion o he Po uguese con ex is c ucial
in p o iding a eliable and alid ool o e alua ing he pe o mance o employees in
Po uguese-speaking o ganiza ions. A eliable and alida ed ool will allow o ganiza ions
o gain a mo e accu a e unde s anding o hei employees’ pe o mance and iden i y a eas
o imp o emen . In u n, he o iginal ques ionnai e was de eloped o measu e a ious
aspec s o indi idual job pe o mance. Thus, i is also he objec i e o he p esen s udy o
e alua e he psychome ic p ope ies o he IWPQ h ough explo a o y and con i ma o y
ac o analysis in a sample o wo ke s om digi al sec o o ganiza ions. The digi al sec o
encompasses ac i i ies ela ed o in o ma ion echnology, communica ions, he in e ne ,
so wa e, and e-comme ce. And his is a sec o ha has been g owing in he las ew yea s
(OECD 2024). Thus, i is pe inen o s udy he beha io s, ways o wo king, and me hods
o e alua ing he indi idual wo k pe o mance o people whose ac i i ies a e ca ied ou
in a digi al con ex . Mo e speci ically, his s udy aimed o (a) iden i y he ac o s uc u e
o he Po uguese e sion (IWPQ) and compa e i wi h he o iginal e sion by Koopmans
e al. (2014b), h ough explo a o y ac o analysis; (b) analyze he in e nal consis ency and
in e co ela ions o IWPQ sco es; (c) con i m he ac o s uc u e and calcula e adjus men
indices h ough a con i ma o y ac o analysis; (d) assess composi e eliabili y, con e gen ,
and disc iminan alidi y o he measu e; and (e) p o ide u he e idence o cons uc
alidi y by examining how IWPQ sco es ela e o measu es o wo k engagemen , job
sa is ac ion, and u no e in en ion.
We es ed he hypo hesis ha he Po uguese e sion o he IWPQ demons a es a
simila s uc u e o he o iginal e sion, composed o h ee dimensions— ask pe o mance,
con ex ual pe o mance, and coun e p oduc i e wo k beha io —while also p esen ing
adequa e eliabili y. The dimensions o job pe o mance and con ex ual pe o mance a e
expec ed o co ela e posi i ely wi h engagemen and job sa is ac ion, and he coun e -
p oduc i e pe o mance dimension is expec ed o co ela e nega i ely wi h engagemen
and job sa is ac ion (Koopmans e al. 2014a;Pla ania e al. 2023). I is also an icipa ed ha
he dimensions o ask pe o mance and con ex ual pe o mance will co ela e nega i ely
wi h u no e in en ion (Van Sco e 2000). In u n, he coun e p oduc i e pe o mance
dimension will co ela e posi i ely wi h u no e in en ion (Ha ab e al. 2022).
2. Me hod
2.1. Pa icipan s
Sample 1. A sample o 162 wo ke s om digi al sec o o ganiza ions (e.g., digi al
ma ke ing, elecommunica ions, e-comme ce, in o ma ion echnology, and so wa e de el-
opmen ) pa icipa ed in he i s s udy. Mos o hem we e male (60.5%), aged be ween
21 and 30 yea s (48.1%), and hei o ganiza ional enu e was mo e han six yea s (43.8%).
Rega ding educa ional le el, mos o he pa icipan s we e highly educa ed (74.1%), o
which 37.7% had a bachelo ’s deg ee and 36.4% had a mas e ’s deg ee.
Sample 2: Pa icipan s we e 261 wo ke s om digi al sec o o ganiza ions, wi h 56.3%
being male, aged be ween 19 and 58 yea s (M = 32.22; SD = 8.41), and hei a e age
o ganiza ional enu e was 4.01 yea s (SD = 4.24). Rega ding educa ional le el, mos o he
pa icipan s we e highly educa ed (83.3%), o which 52.9% had a bachelo ’s deg ee and
32.5% had a mas e ’s deg ee.
2.2. P ocedu e
We used a non-p obabilis ic con enience sample and a sel -adminis e ed ques ionnai e
o da a collec ion. Da a we e collec ed bo h in o ganiza ional con ex s and h ough
in o mal ne wo ks. In he i s case, he p ocedu e adop ed was ca ied ou by e-mail by
sending a co e le e o he o ganiza ions, in which objec i es, a iables unde s udy, and
s eps o he collec ion o in o ma ion we e explained. A e he o ganiza ions accep ed,
mo e de ailed in o ma ion was p o ided, and a sel -adminis e ed ques ionnai e was made
a ailable o he wo ke s, which could be comple ed online. In he case o in o mal ne wo ks,
Adm. Sci. 2024,14, 150 4 o 13
pa icipan s we e con ac ed by pe sonal emails, social ne wo ks (Facebook, Ins ag am, and
LinkedIn), and in pe son. Google Fo ms was he ool used o his pu pose. The sample
inclusion c i e ia we e o ganiza ions ha pa ially o ully p o ided digi al se ices o
wo ke s o o ganiza ions ope a ing in he digi al sec o . Fo S udies 1 and 2, da a ela ed o
he a iables o he IWPQ and da a conce ning he sample cha ac e iza ion we e collec ed.
Da a ela ed o wo k engagemen , job sa is ac ion, and u no e in en ion we e collec ed in
he second s udy. The s udies we e app o ed by he E hics Commi ee o he Uni e si y o
Maia. In o med consen and olun a y pa icipa ion, anonymi y, and con iden iali y o he
answe s we e ensu ed, and he da a collec ed would only be used o esea ch pu poses o
ensu e he e hical issues o esea ch.
2.3. Ins umen s
2.3.1. Indi idual Wo k Pe o mance Ques ionnai e (IWPQ)
The o iginal e sion o he scale is composed o 18 i ems di ided in o h ee subscales:
ask pe o mance (e.g., “I was able o se p io i ies”), con ex ual pe o mance (e.g., “I ook
on ex a esponsibili ies”), and coun e p oduc i e wo k beha io (e.g., “I ocused on he
nega i e aspec s o he wo k si ua ion ins ead o he posi i e aspec s”) (Koopmans e al.
2014b). On all subscales, all i ems co espond o a 3-mon h ecall span, and i has a a ing
o 5 poin s on a Like scale. Fo ask and con ex ual pe o mance, 0 was labeled as “ a ely”
and 4 as “always”. Fo coun e p oduc i e wo k beha io , 0 was labeled as “ne e ” and
4 as “o en”.
To ensu e he cul u al and linguis ic alidi y o he indi idual pe o mance scale
o he Po uguese con ex , he p ocess o ansla ion and linguis ic adjus men s was
conduc ed ollowing he guidelines o Gje sing e al. (2010). Ini ially, he scale i ems we e
ansla ed in o Po uguese by wo ansla o s luen in he a ge language, ollowing he
e e se ansla ion guidelines. Then, a consolida ed e sion was elabo a ed, in eg a ing
he ansla o s’ sugges ions and conside ing he cla i y and comp ehension o he i ems
o po en ial pa icipan s. Subsequen ly, his e sion was submi ed o e iew by a panel
o expe s composed o p o essionals wi h expe ise in o ganiza ional psychology and
linguis ics. This panel e alua ed he seman ic and concep ual equi alence o he i ems, as
well as hei cul u al adequacy in he Po uguese con ex . Based on he ecommenda ions o
he expe panel, addi ional adjus men s we e made o he i ems when necessa y, o ensu e
ha he scale main ained i s ideli y o he o iginal cons uc while being linguis ically
unde s andable and cul u ally ele an o Po uguese collabo a o s. Finally, we did a pilo
es wi h a small g oup o 10 wo ke s, who did no sugges any addi ional modi ica ions.
Appendix Acon ains he lis o he 18 i ems o IWPQ in Po uguese.
2.3.2. Wo k Engagemen Scale Sho Ve sion (UWES-9)
The Wo k Engagemen Scale, in i s sho e sion, is a psychome ic ins umen ha
measu es employees’ wo k engagemen in o ganiza ions. The o iginal e sion, UWES-
9, was de eloped by Schau eli and Bakke (2003), and i was adap ed and alida ed in
Po ugal by Sin al e al. (2018). The UWES-9 is a sel - epo scale, and on all subscales,
all i ems ha e a a ing o 7 poin s on a Like scale (0 = ne e ; 6 = always). The scale
is di ided in o h ee subscales: igo (e.g., “A my wo k, I eel bu s ing wi h ene gy”),
dedica ion (e.g., “My job inspi es me”), and abso p ion (e.g., “I eel happy when I am
wo king in ensely”), wi h h ee ques ions each. In e nal consis ency o he measu e was
e y good, wi h an o dinal C onbach’s
α
o he o al sample o 0.95. This measu e was
assessed in Sample 2.
2.3.3. Sho Index o Job Sa is ac ion (SIJS)
The Sho Index o Job Sa is ac ion is a psychome ic ins umen ha measu es job
sa is ac ion h ough i e i ems adap ed o Po uguese by Sin al and Ma ôco (2020). The
o iginal e sion is based on a sel - epo psychome ic ins umen c ea ed by B ay ield and
Ro he (1951), al hough a sho e e sion wi h i e i ems (SIJS) has also been p oposed by

Adm. Sci. 2024,14, 150 5 o 13
Judge e al. (2000) and Judge and Klinge (2008). One example o an i em is “I eel ai ly
sa is ied wi h my p esen job”. All i ems ha e a a ing on a i e-poin scale (1 “S ongly
Disag ee”, 2 “Disag ee”, 3 “Undecided”, 4 “Ag ee”, 5 “S ongly Ag ee”), and wo o hose
i ems a e e e sed. C onbach’s alpha eliabili y coe icien was 0.88. Highe sco es on
his scale indica e g ea e sa is ac ion o he indi idual wi h hei job. This measu e was
assessed in Sample 2.
2.3.4. Tu no e In en ion (TI)
Tu no e in en ion includes h ee i ems de i ed om a s udy by Mobley e al. (1978),
also used by Skel on e al. (2019), employing a i e-poin Like scale, anging om
1 (s ongly disag ee) o 5 (s ongly ag ee). One example o an i em is “I o en hink o
lea ing he o ganiza ion”. Highe sco es on his scale indica e g ea e in en ion o he
indi idual o lea e he o ganiza ion. This measu e was assessed in Sample 2.
2.4. S a is ical Analysis Plan
IBM SPSS S a is ics 29 and IBM SPSS Amos 29 s a is ical analysis so wa e was used.
Each sample was examined sepa a ely o e i y ha he da a we e no mal and ee o
missing alues. Fi s , an explo a o y ac o analysis (EFA) was ca ied ou in S udy 1
(n= 162) using Va imax o hogonal o a ion and p incipal componen analysis (PCA). Also,
he in e nal consis ency o each subscale (i.e., C onbach’s alpha) and co ela ions be ween
subscales we e calcula ed. Following Cohen’s (1988) guidelines, a co ela ion absolu e
alue be ween (-)0.10 and 0.29 co esponds o a weak associa ion be ween wo a iables,
absolu e alues be ween 0.30 and 0.49 indica e a mode a e co ela ion, and absolu e alues
abo e 0.50 indica e a s ong ela ionship.
Second, in S udy 2, he ac o solu ion was es ed using he maximum likelihood (ML)
es ima ion me hod in con i ma o y ac o analysis (CFA) on a di e en sample (n= 261).
The model i was e alua ed using he ollowing indexes: chi-squa e (
χ
2 and
χ
2/d ),
compa a i e i index (CFI), goodness-o - i index (GFI), and oo mean squa e e o o
app oxima ion (RMSEA, 90% CI) (Jackson e al. 2009). Addi ionally, composi e eliabili y
(CR) and a e age a iance ex ac ed (AVE) we e calcula ed o assess cons uc consis ency
and alidi y, espec i ely. Finally, co ela ion analyses we e pe o med be ween IWPQ-
PT subscales and o he ele an a iables, namely measu es o job sa is ac ion, u no e
in en ion, and wo k engagemen .
3. Resul s
3.1. Explo a o y Fac o Analysis
A o al o 18 i ems om he IWPQ we e submi ed o an EFA (using p incipal compo-
nen analysis and Va imax o hogonal o a ion). These decisions ega ding me hodology
we e in acco dance wi h he p ocedu es ollowed by esea che s o alida e he scale’s
ini ial e sion (Koopmans e al. 2014b).
The Kaise –Maye –Olkin (KMO) was 0.84 and he Ba le es o sphe ici y eached
s a is ical signi icance:
χ
2(153) = 1319.07, p< 0.001. Thus, he da ase was shown o be
app op ia e o ac o analysis. The Ca ell sc ee es (Ca ell 1966), which ecommends
ac o ex ac ion o h ee o ou , was used o asce ain he numbe o componen s o be
kep . The i ems wi h he highes loadings we e aken in o conside a ion when deciding
which componen an i em should belong o. In he p esen s udy, he alue o 0.40 was
conside ed as he h eshold loading alue, ollowing he ecommenda ions o some au ho s
in he li e a u e (e.g., Cos ello and Osbo ne 2005). Two EFAs we e pe o med, ixing h ee
and hen ou ac o s o ex ac . In he h ee- ac o solu ion, eigh i ems we e ela ed o he
con ex ual pe o mance dimension, i e o ask pe o mance, and i e o coun e p oduc i e
wo k beha io (CWB). In he ou - ac o s uc u e, wo con ex ual pe o mance i ems om
he h ee- ac o solu ion we e loaded in o a di e en and ou h dimension (i.e., i ems 8 and
9). Bo h heo e ically and s a is ically, he h ee-componen ac o solu ion was e ealed o
be consis en wi h he h ee- ac o s uc u e o he e sion o he IWPQ ha eme ged in
Adm. Sci. 2024,14, 150 6 o 13
he empi ical alida ion s udy o Koopmans e al. (2014b). Thus, we decided o conside
he h ee- ac o s uc u e. Table 1shows he ac o loadings, communali ies, explained
a iance, and desc ip i e s a is ics.
Table 1. Desc ip i e s a is ics, ac o loadings, communali ies, and explained a iance: IWPQ-PT.
IWPQ I ems
In he Pas Th ee Mon hs. . .
Componen s
M SD 1 2 3 h2
Componen 1
12. I con inually sough new challenges in my wo k 2.99 0.86 0.87 0.10 −
0.08
0.77
11. I ook on ex a esponsibili ies 2.95 0.94 0.82 0.03 0.06 0.67
10. I came up wi h c ea i e solu ions o new p oblems 2.98 0.79 0.76 0.17 −
0.02
0.61
7. I ook on challenging asks when hey we e a ailable 3.12 0.82 0.72 0.25 −
0.06
0.58
6. On my own ini ia i e, I s a ed new ask when my old asks we e comple ed 3.15 0.88 0.68 0.17 0.07 0.49
13. I ac i ely pa icipa ed in mee ings and/o consul a ions 2.95 0.90 0.62 0.25 0.09 0.46
9. I wo ked on keeping my wo k skills up- o-da e a3.25 0.64 0.59 0.41 −
0.23
0.57
8. I wo ked on keeping my job- ela ed knowledge up- o-da e a3.23 0.68 0.55 0.49 −
0.24
0.60
Componen 2
3. I was able o se p io i ies 3.21 0.64 0.07 0.77 −
0.02
0.62
1. I managed o plan my wo k so ha I inished i on ime 3.09 0.68 0.07 0.75 0.08 0.57
4. I was able o ca y ou my wo k e icien ly 3.15 0.20 0.25 0.74 −
0.02
0.39
2. I kep in mind he wo k esul I needed o achie e 3.15 0.65 0.26 0.69 −
0.05
0.52
5. I managed my ime well 2.90 0.77 0.26 0.67 −
0.01
0.41
Componen 3
14. I complained abou mino wo k- ela ed issues a wo k 1.73 1.02 0.22 0.06 0.72 0.57
16. I ocused on he nega i e aspec s o si ua ion a wo k ins ead o he posi i e aspec s 1.20 0.89 −
0.24
−
0.12
0.69 0.55
17. I alked o colleagues abou he nega i e aspec s o my wo k 2.12 1.07 0.03 0.03 0.68 0.46
15. I made p oblems a wo k bigge han hey we e 0.82 0.93 0.04 −
0.16
0.67 0.48
18. I alked o people ou side he o ganiza ion abou he nega i e aspec s o my wo k 1.80 1.23 −
0.13
0.09 0.65 0.45
Eigen alues 4.33 3.27 2.48
% o Va iance 24.06 18.15 13.76
No es. Values in bold indica e he inclusion o he i ems on he espec i e componen s.
a
I ems wi h c oss-loadings
on Componen s 1 and 2. IWPQ-PT = Indi idual Wo k Pe o mance Ques ionnai e-Po uguese Ve sion.
The inal solu ion o 18 i ems, displayed in Table 1, comp ised h ee componen s
ha accoun ed o 55.56% o he a iance. As expec ed, in he inal solu ion, i ems 8 and
9 showed c oss-loadings in o componen s 1 and 2 wi h alues abo e 0.40. Bo h i ems
we e assigned o he i s componen (con ex ual pe o mance) o wo easons. Fi s , his
decision was cong uen wi h he o iginal e sion o he scale; second, i ems 8 and 9 e ealed
highe loading alues on ha componen . Conside ing he inal a e - o a ion solu ion, he
i s componen , con ex ual pe o mance, is composed o eigh i ems and explains 24.06%
o he o al a iance. The second componen , ask pe o mance, includes i e i ems and
accoun s o 18.15% o he o al a iance. The hi d componen , CWB, explains 13.76% o
he o al a iance and con ains i e i ems.
3.2. In e nal Consis ency and Co ela ions be ween Subscales
Conside ing Sample 1, C onbach’s alpha eliabili y coe icien s we e compu ed o
assess he in e nal consis ency o he explo a o y h ee- ac o solu ion (Table 2). Rega ding
subscales eliabili y coe icien s, we ob ained 0.81 o ask pe o mance, 0.88 o con ex
pe o mance, and 0.72 o CWB. Acco ding o he esul s p esen ed in Table 2, co ela ions
be ween ask pe o mance and con ex pe o mance we e signi ican (p< 0.001), posi i e,
and s ong (i.e., = 0.50). In con as , he co ela ions be ween ask pe o mance and CWB
and be ween con ex pe o mance and CWB we e no s a is ically signi ican .
Adm. Sci. 2024,14, 150 7 o 13
Table 2. In e -co ela ions, means, s anda d de ia ions, and C onbach’s alpha: IWPQ-PT.
1 2 M (SD) C onbach’α
1. Task pe o mance - - 3.10 (0.51) 0.81
2. Con ex pe o mance 0.50 ** - 3.08 (0.61) 0.88
5. CWB −0.05 −0.07 1.54 (0.71) 0.72
No e. IWPQ-PT = Indi idual Wo k Pe o mance Ques ionnai e-Po uguese Ve sion. CWB = Coun e p oduc i e
Wo k Beha io s. ** p< 0.01.
3.3. Con i ma o y Fac o Analysis
Using a di e en sample o 261 indi iduals (Sample 2), he h ee- ac o s uc u e
ound h ough EFA has been submi ed o a CFA (S udy 2). We es ed i he IWPQ ac o ial
s uc u e was app op ia e o he Po uguese da a using he ML es ima ion app oach.
In e ms o he local adjus men o he i ems (see Figu e 1), all o hem had signi ican
non-s anda dized eg ession weigh s (p> 0.05) and c i ical a io (CR) alues subs an ially
abo e 1.96. Mo eo e , h ee i ems (i.e., 14, 17, and 18) o CWB p esen ed s anda dized
es ima es a li le below 0.40 (i.e., 0.37, 0.30, and 0.34, espec i ely). These h ee i ems also
had he lowes alues o R2 (i.e., 0.16, 0.12, and 0.15, espec i ely).
Task
Pe o mance
Con ex
Pe o mance
CWB
IWP03
IWP01
IWP05
IWP02
IWP04
IWP07
IWP06
IWP08
IWP09
IWP10
IWP11
IWP12
IWP13
IWP15
IWP16
IWP18
IWP17
IWP14
e03
e01
e02
e05
e04
e07
e06
e09
e10
e08
e11
e13
e12
e16
e15
e14
e17
e18
0.83
0.80
0.80
0.79
0.79
0.80
0.78
0.82
0.76
0.78
0.82
0.46
9
0.72
0.95
0.74
0.30
0.34
0.37
0.84
−0.30
−0.28
Figu e 1. Con i ma o y ac o analysis o he Indi idual Wo k Pe o mance Ques ionnai e (Po -
uguese Ve sion; IWPQ-PT): h ee- ac o model, s anda dized eg ession weigh s, and co ela ions
ac oss ac o s.
Rega ding he model global adjus men , a good model i has been associa ed wi h a
small and signi ican χ2, alues nea 0.90 o CFI and GFI, and RMSEA below 0.10 (By ne
2010). The ini ial model did no app op ia ely i he da a:
χ
2(132) = 411.26, p< 0.001;
χ
2/d = 3.12, CFI = 0.95, GFI = 0.81, and RMSEA = 0.09 [90% CI 0.08–0.10]. Since he modi-
Adm. Sci. 2024,14, 150 8 o 13
ica ion indices sugges ed indica ions o he model imp o emen , co a iances be ween
wo e o pai s comp ising consecu i e i ems wi h compa able con en we e added (i.e.,
be ween i em 11 and i em 12, and be ween i em 17 and i em 18). Only co ela ions be ween
e o measu emen s associa ed wi h he same ac o we e es ima ed. A e wa ds, indings
showed a mo e accep able model i :
χ
2(130) = 261.62, p< 0.001;
χ
2/d = 2.01; CFI = 0.95;
GFI = 0.90; RMSEA = 0.06 [90% CI 0.05–0.07]. Finally, AVE was 0.64 o ask pe o mance,
0.60 o con ex pe o mance, and 0.36 o CWB. The CR alues ob ained we e 0.90, 0.92,
and 0.70 o ask pe o mance, con ex pe o mance, and CWB, espec i ely. Following
he ecommenda ions o Fo nell and La cke (1981), AVE alues we e sa is ac o y o ask
pe o mance and con ex pe o mance (i.e., g ea e han 0.50) and inadequa e o he CWB
subscale. All AVE alues we e supe io o he squa ed co ela ion alues (R
2
) ob ained
be ween IWPQ-PT dimensions (i.e., supe io o 0.25), indica ing disc iminan alidi y be-
ween a iables. Wi h ega d o CR alues, he h ee subscales showed adequa e sco es,
conside ing 0.70 as he lowe h eshold.
3.4. Co ela ions wi h Rele an Va iables
The ma ix o co ela ions be ween IWPQ-PT subscales and some ele an a iables is
p esen ed in Table 3. Measu es o job sa is ac ion, u no e in en ion, and wo k engagemen
we e used. Fi s , indings poin o he exis ence o mode a e- o-s ong posi i e associa ions
be ween bo h ask pe o mance and con ex pe o mance and job sa is ac ion ( = 42
and = 0.53, p< 0.001, espec i ely) and all o he dimensions o wo k engagemen
( igo , dedica ion, and abso p ion), wi h alues o co ela ion anging om 0.58 o 0.69
(p< 0.001). Second, he CWB subscale was nega i ely and weakly o mode a ely ela ed o
job sa is ac ion ( =
−
0.30, p< 0.001) and wo k engagemen subscales ( =
−
0.15, p< 0.05 o
dedica ion and =
−
0.17, p< 0.01 o igo and abso p ion). Finally, bo h he dimensions o
ask pe o mance and con ex pe o mance we e mode a ely and nega i ely co ela ed o
u no e in en ion ( =
−
0.33 o ask pe o mance and =
−
0.44 o con ex pe o mance,
p< 0.001); con as ingly, he associa ion be ween CWB and u no e in en ion was posi i e
and weak ( = 0.22, p< 0.001).
Table 3. Co ela ions be ween IWPQ-PT, SIJS, TI, and UWES-9 sco es.
IWPQ-PT Sco es SIJS TI
UWES-9
Vigo Dedica ion Abso p ion
Task pe o mance 0.42 *** −33 *** 0.58 *** 0.62 *** 0.63 ***
Con ex ual pe o mance 0.53 *** −44 *** 0.61 *** 0.69 *** 0.68 ***
CWB −0.30 *** −0.22 *** −0.17 ** −0.15 * −0.17 **
No es. IWPQ-PT = Indi idual Wo k Pe o mance Ques ionnai e-Po uguese Ve sion. SIJS = Sho Index o Job
Sa is ac ion. TI = Tu no e In en ion. UWES-9 = Wo k Engagemen Scale sho e sion. CWB = Coun e p oduc i e
Wo k Beha io s. * p< 0.05; ** p< 0.01; *** p< 0.001.
4. Discussion
The p esen s udy aimed o adap and alida e he Indi idual Wo k Pe o mance
Ques ionnai e (IWPQ) in o a Po uguese e sion (IWPQ-PT). The indings p o ide e idence
o suppo he adap a ion and psychome ic p ope ies o he IWPQ-PT o assessing
indi idual wo k pe o mance in Po uguese-speaking samples wo king in digi al se ice
o ganiza ions. In addi ion, he esul s ob ained allow us o es ablish he ela ionship wi h
o he ele an a iables, namely wo k engagemen , job sa is ac ion, and u no e in en ion.
Rega ding he ac o ial s uc u e o he IWPQ-PT, he EFA suppo ed a h ee- ac o
s uc u e o he IWPQ-PT, mi o ing he s uc u e o he o iginal IWPQ. This s uc u e
aligns wi h he heo e ical amewo k p oposed by Koopmans e al. (2014b). The ollowing
ac o s we e iden i ied: ask pe o mance, con ex ual pe o mance, and coun e p oduc i e
wo k beha io (CWB). No ably, wo i ems we e ini ially loaded on o wo componen s:
con ex ual pe o mance and ask pe o mance. Howe e , bo h we e eassigned o he