I. In oduc ion
The appea ance o mode n de ices ha o e qui e na u al and easy-
o-lea n in e ac ions, as o example sma phones o able s, ha e
aken he gene al expec a ion o use s conce ning use expe ience o
use in e aces o a new le el. Today’s use s simply expec a high le el
o sa is ac ion du ing hei in e ac ion wi h a use in e ace, e en i i is
a complex business applica ion o a p og amming en i onmen .
In o de o be success ul in a highly compe i i e ma ke en i onmen ,
i is hus no longe su icien o o e p oduc s o new and powe ul
unc ionali y. Use s also expec ha hey can lea n how o use he
applica ion wi hou much e o , sol e hei asks as and e icien ly,
and a e able o con ol he in e ac ion a each poin . In addi ion o hese
goal-o ien ed in e ac ion quali ies, i is also impo an ha he p oduc
ca ches he use ’s a en ion and in e es and ha using he p oduc is
in e es ing and s imula ing. Consequen ly, hedonic, no di ec ly goal-
o ien ed in e ac ion quali ies ha e o be conside ed as well in o de o
be success ul [1].
Fo example, in a s udy conce ning business so wa e [2] i was
shown ha p agma ic quali y aspec s and hedonic quali y aspec s
equally in luence he a ac i eness and p e e ence o a p oduc . Thus,
use expe ience wi h all i s ace s is an impo an aspec ha mus be
conside ed du ing p oduc design and as a pa o quali y con ol.
This aises he ques ion o how o measu e use expe ience. All
aspec s o use expe ience a e highly subjec i e e alua ions. A
p oduc ha is seen as easy o lea n and unde s and by one pe son
can be judged as qui e complica ed and di icul o lea n by ano he
pe son. This can, o example, be due o di e en le els o expe ise
o knowledge. Ano he eason can be a di e en le el o expe ise
wi h simila p oduc s.
The same is ue o he pe cei ed pe o mance o a p oduc . A
p oduc ha a use pe cei es as slow and annoying can be seen as
pe o ming adequa ely by ano he use . In his espec , use s a y widely
in hei expec a ions and pe sonal p e e ences. Thus, any measu emen
o use expe ience mus conside he eedback o a ep esen a i e and
la ge enough g oup o use s.
The e o e, ques ionnai es a e a simple me hod o collec such use
eedback [3]. They can be dis ibu ed a he e icien ly o la ge g oups
o use s, especially i hey a e designed as online ques ionnai es. In
addi ion, analyzing he nume ical da a om such ques ionnai es is
highly s anda dized and hus e icien as well.
In his pape we desc ibe he design and e alua ion o a sho e sion
o he Use Expe ience Ques ionnai e, which is a widely used ool o
measu e use expe ience.
II. The Use Expe ience Ques ionnai e (UEQ)
The objec i e o he UEQ is o allow a quick assessmen done by
end use s co e ing a p e e ably comp ehensi e imp ession o use
expe ience. I should allow he use s o exp ess eelings, imp essions,
and a i udes ha a ise when expe iencing he p oduc unde
in es iga ion in a e y simple and immedia e way.
The UEQ can be used as a pape -pencil e sion, bu is also sho
enough o be used as an online ques ionnai e. I consis s o 26 i ems
(Fig. 1) ha a e g ouped in o 6 scales.
Each i em o he UEQ consis s o a pai o e ms wi h opposi e
meanings, o example:
No unde s andable o o o o o o o Unde s andable
E icien o o o o o o o Ine icien
Pa icipan s a e each i em on a 7-poin Like scale. The answe s
a e scaled om -3 ( ully ag ee wi h nega i e e m) o +3 ( ully ag ee
wi h posi i e e m). Hal o he i ems s a wi h he posi i e e m, he
o he s wi h he nega i e e m (in andomized o de ).
Design and E alua ion o a Sho Ve sion o he Use
Expe ience Ques ionnai e (UEQ-S)
Ma in Sch epp1, And eas Hinde ks2, Jö g Thomaschewski3*
1 SAP AG (Ge many)
2 Uni e si y o Se ille (Spain)
3 Uni e si y o Applied Sciences Emden/Lee (Ge many)
Recei ed 19 June 2017 | Accep ed 12 July 2017 | Published 11 Sep embe 2017
Keywo ds
Use Expe ience, UEQ,
Ques ionnai e, Sho
Ve sion.
Abs ac
The use expe ience ques ionnai e (UEQ) is a widely used ques ionnai e o measu e he subjec i e imp ession
o use s owa ds he use expe ience o p oduc s. The UEQ is a seman ic di e en ial wi h 26 i ems. Filling ou
he UEQ akes app oxima ely 3-5 minu es, i.e. he UEQ is al eady easonably e icien conce ning he ime
equi ed o answe all i ems. Howe e , he e exis se e al alid applica ion scena ios, whe e illing ou he
en i e UEQ appea s imp ac ical. This pape deals wi h he c ea ion o an 8 i em sho e sion o he UEQ, which
is op imized o hese speci ic applica ion scena ios. Fi s alida ions o his sho e sion a e also desc ibed. DOI: 10.9781/ijimai.2017.09.001
* Co esponding au ho .
E-mail add ess: joe g. homaschewski@hs-emden-lee .de
Regula Issue
- 103 -
- 104 -
In e na ional Jou nal o In e ac i e Mul imedia and A i icial In elligence, Vol. 4, Nº6
The o iginal e sion o he UEQ was designed in Ge man [4], [5],
bu has so a been ansla ed o se e al languages like Spanish [7] and
Po uguese [11]. The English e sion o he UEQ is shown in Fig. 1.
annoying o o o o o o o enjoyable 1
no unde s andable o o o o o o o unde s andable 2
c ea i e o o o o o o o dull 3
easy o lea n o o o o o o o di icul o lea n 4
aluable o o o o o o o in e io 5
bo ing o o o o o o o exci ing 6
no in e es ing o o o o o o o in e es ing 7
unp edic able o o o o o o o p edic able 8
as o o o o o o o slow 9
in en i e o o o o o o o con en ional 10
obs uc i e o o o o o o o suppo i e 11
good o o o o o o o bad 12
complica ed o o o o o o o easy 13
unlikable o o o o o o o pleasing 14
usual o o o o o o o leading edge 15
unpleasan o o o o o o o pleasan 16
secu e o o o o o o o no secu e 17
mo i a ing o o o o o o o demo i a ing 18
mee s expec a ions o o o o o o o does no mee expec a ions 19
ine icien o o o o o o o e icien 20
clea o o o o o o o con using 21
imp ac ical o o o o o o o p ac ical 22
o ganized o o o o o o o clu e ed 23
a ac i e o o o o o o o una ac i e 24
iendly o o o o o o o un iendly 25
conse a i e o o o o o o o inno a i e 26
Fig. 1. English e sion o he UEQ.
The o iginal Ge man e sion o he UEQ was designed using a da a
analy ics app oach o ensu e he p ac ical ele ance o he cons uc ed
scales. Each scale ep esen s a dis inc UX quali y aspec .
An ini ial se o mo e han 200 po en ial i ems ela ed o UX was
c ea ed wi h usabili y expe s in wo b ains o ming sessions. A numbe
o hese expe s hen educed he selec ion o a aw e sion o 80 i ems.
The aw e sion was used in se e al s udies (wi h a o al o 153
pa icipan s) on he quali y o in e ac i e p oduc s, including a s a is ics
so wa e package, cell phone add ess books, online collabo a ion
so wa e, o business so wa e. Finally, he scales and he i ems
ep esen ing each scale we e ex ac ed om his da a se by p incipal
componen analysis [4], [5].
This analysis yielded he inal ques ionnai e wi h 26 i ems a anged
in o six scales:
• A ac i eness: O e all imp ession o he p oduc . Do use s like o
dislike i ? Is i a ac i e, enjoyable o pleasing?
• Pe spicui y: Is i easy o ge amilia wi h he p oduc ? Is i easy o
lea n? Is he p oduc easy o unde s and and unambiguous?
• E iciency: Can use s sol e hei asks wi hou unnecessa y e o ?
Is he in e ac ion e icien and as ? Does he p oduc eac o use
inpu quickly?
• Dependabili y: Does he use eel in con ol o he in e ac ion?
Can he o she p edic he sys em’s beha io ? Does he use eel
con iden when wo king wi h he p oduc ?
• S imula ion: Is i exci ing and mo i a ing o use he p oduc ? Is i
enjoyable o use?
• No el y: Is he p oduc inno a i e and c ea i e? Does i cap u e he
use ’s a en ion?
Scales a e no assumed o be independen . In ac , a use ’s gene al
imp ession is eco ded by he A ac i eness scale, which should be
in luenced by he alues on he o he 5 scales (see Fig. 2).
Fig. 2. Assumed scale s uc u e o he Use Expe ience Ques ionnai e (UEQ).
A ac i eness is a pu e alence dimension (emo ional eac ion
on a pu e accep ance/ ejec ion dimension). Pe spicui y, E iciency,
and Dependabili y a e p agma ic quali y aspec s, i.e. hey desc ibe
in e ac ion quali ies ha ela e o he asks o goals he use aims o
each when using he p oduc . S imula ion and No el y a e hedonic
quali y aspec s, i.e. hey do no ela e o asks and goals, bu desc ibe
aspec s ela ed o pleasu e o un while using he p oduc [2], [6].
Fo de ails conce ning he design and alida ion o he UEQ see [4],
[5]. Help ul hin s on using he UEQ a e also a ailable in [7], [8]. The e
is a benchma k a ailable as well, which is desc ibed in [12].
Fo a seman ic di e en ial like he UEQ, i is e y impo an ha
pa icipan s can ill i ou in hei na i e language. Thus, se e al
con ibu o s c ea ed a numbe o ansla ions.
The UEQ is cu en ly a ailable in 19 languages (Ge man, English,
F ench, I alian, Russian, Spanish [7], Po uguese [11], Tu kish, Chinese,
Japanese, Indonesian [10], Du ch, Es onian, Slo ene, Swedish, G eek,
Polish, Hindi, and Bulga ian).
The UEQ in all a ailable languages, an Excel shee o da a
analysis, and he UEQ Handbook a e a ailable ee o cha ge a
www.ueq-online.o g.
III. Scena ios Requi ing a Sho Ve sion?
Usually, 3-5 minu es a e su icien o ill ou he UEQ including
some demog aphic da a [3]. Thus, he UEQ is al eady a qui e e icien
me hod o cap u e he opinion o a use owa ds he use expe ience
o a p oduc , leading o he ob ious ques ion why a sho e e sion is
needed a all?
In he las couple o yea s we ecei ed a numbe o eques s o a
sho e e sion, and some use s e en c ea ed hei own sho e sion
by emo ing a ew i ems (which is no a ecommended p ac ice o a
s anda dized ques ionnai e like he UEQ [9]). Acco dingly, he e seem
o be some cases in which a ull UEQ is conside ed o be oo ime
consuming.
All hese eques s came om h ee di e en gene ic applica ion
scena ios in which only a e y small numbe o i ems could be used o
measu e use expe ience.
1. The i s scena io is collec ing da a when he use lea es a web
shop o web se ice. Fo example, he use has jus o de ed
some hing in a web shop and logs ou . A e p essing he log ou
bu on, he use is asked o ill ou a sho ques ionnai e conce ning
he use expe ience o he shop. In such scena ios i is c ucial ha
he use has he imp ession ha illing ou he ques ionnai e can be
- 105 -
Regula Issue
done ex emely as . O he wise, use s will e use o gi e eedback
( hey a e inished wi h hei ini ial ask and a e in he p ocess o
lea ing he shop, so mo i a ing hem o spend some mo e ime
on eedback is di icul ). P esen ing an en i e UEQ wi h all 26
ques ions in such a scena io will se e ely educe he numbe o
use s willing o gi e eedback.
2. In he second and qui e equen scena io, a ques ionnai e
conce ning use expe ience should be included in an al eady
exis ing p oduc expe ience ques ionnai e. Typically, such a
ques ionnai e is sen ou a e a cus ome has pu chased a p oduc
and has al eady used i o some ime.
Such ques ionnai es y o collec da a abou he en i e p oduc
expe ience, asking, o example, why he cus ome chose he
p oduc , i he unc ionali y o he p oduc ul ills he expec a ions,
i he pu chasing p ocess was pleasan , i he cus ome wan s o
be in o med abou simila o o he p oduc s o he company in
he u u e, e c. As a esul , such ques ionnai es end o be qui e
leng hy. Thus, i is di icul o add a ull 26 i em use expe ience
ques ionnai e in such cases.
On he o he hand, i is o en no possible o collec da a conce ning
use expe ience in a sepa a e ques ionnai e, since he numbe o
cus ome in e ac ions canno exceed a ce ain limi (cus ome s
can ge easily annoyed i hey ecei e such ma ke ing e-mails oo
o en).
Thus, including a e y sho use expe ience sec ion in such
a cus ome expe ience ques ionnai e is o en he only way o
UX p ac i ione s o collec eedback on hei cus ome s’ use
expe ience.
3. A hi d scena io men ioned some imes a e expe imen al se ings
whe e a pa icipan is asked o judge he use expe ience o se e al
p oduc s o a ian s o a p oduc in one session. In such scena ios
he p oduc s o p oduc a ian s a e p esen ed o he pa icipan
in a andom o de one a e he o he , and hey ha e o ill ou
a ques ionnai e conce ning use expe ience o each o hem. In
such a se ing, he numbe o i ems mus be kep o a minimum.
O he wise he pa icipan will be s essed and he quali y o
answe s will dec ease quickly.
All o hese scena ios sha e he equi emen ha he numbe o
i ems mus be small. In addi ion, any ins uc ion mus be simple and
quick o ead.
IV. Cons uc ion o he Sho Ve sion
The sho e sion should con ain only a limi ed numbe o i ems,
bu i should s ill co e he spec um o p oduc quali ies measu ed by
he UEQ.
To sho en he UEQ i was decided o skip he measu emen o he
single dimensions and o concen a e on he measu emen o he wo
me a-dimensions p agma ic and hedonic quali y. Fo each o hese
dimensions ou i ems a e chosen. Thus, he sho e sion o he UEQ
(hence o h: UEQ-S) will only con ain eigh i ems, g ouped in o wo
scales. In addi ion, he mean alue o he eigh i ems will be gi en as
an o e all UX alue.
A da a se wi h 1867 da a eco ds was collec ed by he Ge man
UEQ in p e ious s udies. Each da a eco d e lec s he e alua ion o a
p oduc by a pa icipan . In o al, 21 di e en p oduc s we e assessed
(business so wa e, web shops, household appliances, e c.).
A main componen analysis was pe o med on all wel e UEQ
i ems om he E iciency, Pe spicui y and Dependabili y scales. Fo
he analysis he numbe o ac o s was se o 1, and he ou i ems ha
showed he highes loading on his ac o we e chosen. These we e
he i ems 11, 13, 20, and 21 (see Fig. 1) o he UEQ. They he e o e
ep esen he P agma ic Quali y scale o he sho e sion UEQ-S.
The same p ocedu e was epea ed o he eigh UEQ i ems om he
S imula ion and O iginali y scales. The i ems 6, 7, 10, and 15 (see Fig.
1) showed he highes loadings and hus ep esen he Hedonic Quali y
scale o he UEQ-S.
The UEQ-S hus consis s o i ems shown in Fig. 3:
obs uc i e o o o o o o o suppo i e 1
complica ed o o o o o o o easy 2
ine icien o o o o o o o e icien 3
clea o o o o o o o con using 4
bo ing o o o o o o o exi ing 5
no in e es ing o o o o o o o in e es ing 6
con en ional o o o o o o o in en i e 7
usual o o o o o o o leading edge 8
Fig. 3. The sho e sion UEQ-S.
The i s ou i ems ep esen he p agma ic quali y scale and he las
ou i ems he hedonic quali y scale.
To check he c oss-loadings he da a se was educed o hese eigh
i ems and a main componen analysis ( a imax o a ion) was pe o med
wi h wo ac o s. Table 1 shows he i ems’ loadings on hese ac o s.
TABLE I. Loadings o he I ems o he Sho Ve sion UEQ-S on he
Fac o s P agma ic and Hedonic Quali y
I em P agma ic Hedonic
clea / con using 0.71 0.21
ine icien / e icien 0.63 0.39
complica ed / easy 0.79 0.10
obs uc i e / suppo i e 0.69 0.41
bo ing / exi ing 0.29 0.74
no in e es ing / in e es ing 0.36 0.75
con en ional / in en i e 0.19 0.82
usual / leading edge 0.19 0.86
Thus, he i ems show he in ended scale s uc u e. Only he i em
obs uc i e/suppo i e yields a ele an , bu s ill ela i ely small c oss-
loading o he o he ac o . The o he i ems load s ongly on he ac o
hey belong o and only weakly o he o he ac o .
In he o iginal UEQ hal o he i ems s a wi h he posi i e e m
and he o he hal o i ems s a wi h he nega i e e m. In addi ion, he
o de o he i ems is andomized in he ques ionnai e. This was done
o be able o de ec pa icipan s ha do no answe se iously [9] and o
o ce use s o ca e ully ead he al e na i es. Howe e , his also has
some disad an ages. The change o pola i y mus be explained in he
ins uc ion and in addi ion, i is cogni i ely mo e demanding o he
pa icipan s.
In o de o simpli y he ins uc ion and make i easie o ill in he
ques ionnai e, i was decided ha all i ems ha e he same pola i y. The
le side e lec s he nega i e e m and he igh side he posi i e e m
(see Fig. 3). In addi ion, he o de is no andomized: he i s 4 i ems
e lec he p agma ic quali y and he i ems 5 o 8 he hedonic quali y.
V. P edic ion Quali y
As a i s e alua ion we calcula ed how well he scales o he sho
e sion (UEQ-S) app oxima e he co esponding scales o he ull
e sion (UEQ). The e o e, in ou da a se ha was used o design he
sho e sion, we calcula ed he di e ence be ween he mean alue o
all 8 i ems in he sho e sion and he mean alue o all 26 i ems (he e
12 i ems belong o p agma ic quali y, 8 belong o hedonic quali y and
- 106 -
In e na ional Jou nal o In e ac i e Mul imedia and A i icial In elligence, Vol. 4, Nº6
6 belong o he scale A ac i eness, which is nei he p agma ic no
hedonic) in he ull UEQ o each pa icipan . The same was done o
he scales p agma ic and hedonic quali y o he sho e sion.
Rega ding he p agma ic quali y we calcula ed he di e ence
be ween he mean o he ou i ems o he p agma ic quali y scale
o he UEQ-S and all wel e i ems o he E iciency, Pe spicui y and
Dependabili y scales in he ull UEQ o each pa icipan .
Following ha pa e n, we compa ed he di e ence be ween he ou
i ems o he hedonic quali y scale o he UEQ-S wi h he mean o he
eigh i ems o he S imula ion and O iginali y scales in he ull UEQ.
The dis ibu ion o hese di e ences (ke nel densi y plo s) is shown
in Fig. 4, Fig. 5 and Fig. 6.
Gene al esul (all i ems)
Fig. 4. Dis ibu ion o he di e ence pe pa icipan be ween he ull UEQ and
he sho e sion UEQ-S o he o e all alue.
P agma ic Quali y
Fig. 5. Dis ibu ion o he di e ence pe pa icipan be ween he ull UEQ and
he sho e sion UEQ-S o p agma ic quali y.
Hedonic Quali y
Fig. 6. Dis ibu ion o he di e ence pe pa icipan be ween he ull UEQ and
he sho e sion UEQ-S o hedonic quali y.
The mean and s anda d de ia ion o he obse ed di e ences a e
0.06 (0.39) o all i ems (Fig. 4), -0.09 (0.46) (Fig. 5) o he i ems
conce ning p agma ic quali y and -0.03 (0.45) (Fig. 6) o he i ems
conce ning hedonic quali y. Please no e ha he UEQ scale anges
om -3 o +3, so hese di e ences conce ning he scale means a e qui e
small.
In all h ee cases he dis ibu ion o he obse ed di e ences is
nea ly symme ical a ound ze o, hus he e is no sys ema ic o e - o
unde es ima ion based on he educed numbe o i ems in he sho
e sion UEQ-S. I is e iden ha he sho e sion is able o p edic he
alues o he ull e sion qui e accu a ely.
VI. An E alua ion S udy
In a i s s udy wi h he sho e sion 47 s uden s judged he use
expe ience o di e en well-known p oduc s. Each s uden could
choose o judge ei he Amazon, Skype o Wikipedia wi h an online
e sion o he UEQ-S. We only epo esul s o Amazon, since o
he o he wo p oduc s he e we e simply no enough da a o d aw
meaning ul conclusions.
The consis ency o he p agma ic quali y and hedonic quali y scales
was easonably high. The co esponding C onbach Alpha alues we e
0.85 (p agma ic quali y) and 0.81 (hedonic quali y).
The scale means o Amazon (N=31 s uden s decided o judge
Amazon) we e 1.09 o p agma ic and 0.51 o hedonic quali y. These
alues a e qui e simila o he alues ob ained in an olde s udy wi h a
simila a ge g oup (Ge man s uden s) and he ull UEQ. In his s udy
he mean alue o he E iciency, Pe spicui y and Dependabili y UEQ
scales was 1.17 and he mean alue o S imula ion and O iginali y was
0.66. Thus, he sho e sion UEQ-S seems o app oxima e he long
e sion expec edly well.
A main componen analysis o his da a se shows he expec ed ac o
s uc u e once mo e. The loading o he i ems o he wo ex ac ed
ac o s ( ac o s we e ex ac ed acco ding o he Kaise -Gu man
c i e ium, loadings a e a imax o a ion) a e shown in Table 2.
TABLE II. Fac o Loadings on he Two Ex ac ed Fac o s o he Sho
Ve sion UEQ-S o he Full Da a Se o he S udy (47 Pa icipan s)
I em Fac o 1
p agma ic quali y
Fac o 2
hedonic quali y
clea / con using 0.825 -0.209
ine icien / e icien 0.833 0.255
complica ed / easy 0.849 -0.033
obs uc i e / suppo i e 0.789 0.215
bo ing / exi ing 0.274 0.701
no in e es ing / in e es ing 0.220 0.806
con en ional / in en i e -0.047 0.841
usual / leading edge -0.221 0.809
VII. Language Ve sions
The i ems o he UEQ-S a e a subse o he UEQ i ems. Acco dingly,
all he a ailable ansla ions o he UEQ can be used, i.e. he UEQ-S
is di ec ly a ailable in all languages o which a ull e sion exis s
(Ge man, English, F ench, I alian, Russian, Spanish, Po uguese,
Tu kish, Chinese, Japanese, Indonesian, Du ch, Es onian, Slo ene,
Swedish, G eek, Polish, Hindi, and Bulga ian).
The ansla ed e sion o he UEQ-S can simply be c ea ed by
choosing he co esponding i ems om he ull UEQ o he desi ed
language.
Howe e , he ques ion emains i he selec ed i ems p edic he
- 107 -
Regula Issue
beha io o he ull UEQ as well as he Ge man e sion. We canno
e i y his o all ansla ions ye , since we do no ha e access o
su icien ly la ge da a se s o all o hem. So a , his is only possible
o some languages.
Table 3 shows he measu ed de ia ion pe pa icipan be ween he
sho e sion and he co esponding alues o he long e sion o i e
languages (same compu a ion me hod as desc ibed in he alida ion o
he Ge man sho e sion abo e).
TABLE III. De ia ions be ween Sho Ve sion UEQ-S and Full Ve sion
Language All P agma ic Hedonic n
Po uguese 0.19 (0.33) 0.07 (0.41) 0.13 (0.41) 206
Tu kish 0.13 (0.39) -0.06 (0.44) 0.22 (0.47) 943
Spanish 0.16 (0.38) 0.02 (0.49) 0.1 (0.38) 377
Indonesian 0.14 (0.33) -0.15 (0.38) 0.25 (0.38) 212
English 0.15 (0.34) 0.03 (0.43) 0.17 (0.36) 224
The da a shows ha o hese languages he i be ween he sho
e sion and he ull e sion o he UEQ is good enough o allow a
p ac ical applica ion o he UEQ-S. Fo example, o he English
e sion we can expec ha he mean o he eigh i ems o he UEQ-S
de ia es 0.15 (on a e age) om he mean o all 26 UEQ i ems. Fo he
ou UEQ-S i ems o he p agma ic quali y scale he de ia ion om
he mean o all wel e UEQ i ems o he E iciency, Dependabili y and
Pe spicui y scales is 0.03 on a e age. Fo he ou UEQ-S i ems o he
hedonic scale he de ia ion om he mean o all eigh UEQ i ems o
he scales S imula ion and O iginali y a e ages a 0.17. Thus, as in he
case o he Ge man e sion, he app oxima ion is qui e good.
VIII. Limi a ions o he Sho Ve sion UEQ-S
We desc ibed he design o he UEQ’s sho e sion UEQ-S. Fo
a UX p o essional who wan s o plan an e alua ion he ques ion
a ises which o he wo e sions should be used. Ob iously, he sho
e sion has some ad an ages conce ning he numbe o ques ions and
acco dingly he ime he pa icipan s need o ill ou he ques ionnai e.
Howe e , his comes a a p ice. The ull UEQ gi es a de ailed
eedback conce ning 6 di e en aspec s o UX, i.e. measu es on he
A ac i eness, E iciency, Pe spicui y, Dependabili y, S imula ion
and O iginali y scales. This is los in he sho e sion ha only
dis inguishes be ween p agma ic and hedonic quali y.
Gi en he ac ha e en a ull UEQ equi es only 3-5 minu es, he
usage o he UEQ-S should be limi ed o he scena ios desc ibed in
he beginning o his pape . The sho e sion should only be used
in si ua ions whe e a ull UEQ can no be applied a all. O he wise,
he loss o de ailed in o ma ion is no compensa ed by sa ing ime in
illing ou he ques ionnai e.
IX. Conclusion
We desc ibed he design and alida ion o a sho e sion o he
UEQ. I consis s o only eigh o he 26 i ems o he UEQ. The sho
e sion, which is named UEQ-S, con ains wo subscales (p agma ic
and hedonic quali y; 4 i ems each) and a o al alue e lec ing he
o e all use expe ience.
I was shown ha he sho e sion is able o p edic he beha io o
he ull e sion conce ning p agma ic and hedonic quali y. The mean
alue ob ained by he ou i ems o he sho e sion app oxima es
he alues ob ained by a e aging all 12 p agma ic i ems ( om he
E iciency, Pe spicui y and Dependabili y scales) and all 8 hedonic
i ems ( om he S imula ion and O iginali y scales) o he ull e sion.
In a i s applica ion s udy conce ning Amazon done wi h Ge man
s uden s, he scales showed a high le el o consis ency. In addi ion, he
measu ed mean o he p agma ic and hedonic quali y app oxima es
he alues ob ained by he ull UEQ collec ed in a p e ious s udy.
The sho e sion UEQ-S is only in ended o speci ic scena ios
which do no allow employing a ull UEQ. The UEQ-S does no
allow measu ing he de ailed UX quali ies A ac i eness, E iciency,
Pe spicui y, Dependabili y, S imula ion and No el y, which a e pa o
he UEQ epo . I is, in gene al, qui e use ul o ga he hese de ailed
alues when i comes o in e p e ing he esul s and de ine a eas o
imp o emen [3].
Thus, he sho e sion UEQ-S only allows a ough measu emen
on highe le el me a-dimensions. Ou ecommenda ion he e o e
is o only use he sho e sion UEQ-S in he scena ios desc ibed in
his pape . The sho e sion should no eplace he usage o he ull
e sion in s anda d scena ios, o example a e usabili y es s. In such
scena ios, he small gain in e iciency does no compensa e o he loss
o de ailed in o ma ion on he single scales and he e o e mo e de ailed
quali y aspec s.
Re e ences
[1] P eece, J.; Roge s, Y. & Sha pe, H. (2002): In e ac ion design: Beyond
human-compu e in e ac ion. New Yo k: Wiley.
[2] Sch epp, M.; Held, T. & Laugwi z, B.: The in luence o hedonic quali y
on he a ac i eness o use in e aces o business managemen so wa e.
In e ac ing wi h Compu e s 18, pp. 1055-1069 (2006).
[3] Sch epp, M.; Hinde ks, A. & Thomaschewski, J. (2014). Applying he
Use Expe ience Ques ionnai e (UEQ) in Di e en E alua ion Scena ios.
In: Ma cus, A. (Ed.): Design, Use Expe ience, and Usabili y. Theo ies,
Me hods, and Tools o Designing he Use Expe ience. Lec u e No es
in Compu e Science, Volume 8517, pp. 383-392, Sp inge In e na ional
Publishing.
[4] Laugwi z, B.; Sch epp, M. & Held, T. (2006). Kons uk ion eines
F agebogens zu Messung de Use Expe ience on So wa ep oduk en.
[Cons uc ion o a ques ionnai e o he measu emen o use expe ience
o so wa e p oduc s] In: A.M. Heinecke & H. Paul (Eds.): Mensch &
Compu e 2006 – Mensch und Compu e im S uk u wandel. Oldenbou g
Ve lag, pp. 125-134.
[5] Laugwi z, B.; Sch epp; M. & Held, T. (2008). Cons uc ion and e alua ion
o a use expe ience ques ionnai e. In: Holzinge , A. (Ed.): USAB 2008,
LNCS 5298, pp. 63-76.
[6] Hassenzahl, M. (2001). The e ec o pe cei ed hedonic quali y on p oduc
appealingness. In e na ional Jou nal o Human-Compu e In e ac ion,
13(4), pp. 481-499.
[7] Rauschenbe ge , M.; Sch epp, M.; Pe ez-Co a, M.; Olschne , S. &
Thomaschewski, J. (2013): E icien Measu emen o he Use Expe ience
o In e ac i e P oduc s. How o use he Use Expe ience Ques ionnai e
(UEQ). Example: Spanish Language Ve sion. In: In e na ional Jou nal o
In e ac i e Mul imedia and A i icial In elligence, 2(1), pp. 39-45.
[8] Sch epp, M. (2015). Use Expe ience Ques ionnai e Handbook. DOI:
10.13140/RG.2.1.2815.0245. A ailable unde : h ps://www. esea chga e.
ne /publica ion/281973617_Use _Expe ience_Ques ionnai e_Handbook.
[9] Sch epp, M.; Hinde ks, A. & Thomaschewski, J. (2016). Use Expe ience
mi F agebögen e aluie en - Tipps und T icks ü Da ene hebung,
Auswe ung und P äsen a ion de E gebnisse. S. Hess & H. Fische
(H sg.): Mensch und Compu e 2016 – Usabili y P o essionals. h p://
dx.doi.o g/10.18420/muc2016-up-0016.
[10] San oso, H.B.; Sch epp, M.; Isal, R.Y.K.; U omo, A.Y. & P iyogi, B.
(2016). Use Expe ience Ques ionnai e: De elopmen o an Indonesian
Ve sion and I s Usage o P oduc E alua ion. The Jou nal o Educa o s
Online-JEO Janua y 2016 ISSN 1547-500X Vol 13 Numbe 1, pp. 58-79.
[11] Pé ez Co a, M.; Thomaschewski, J.; Sch epp, M. & Goncal es, R. (2014).
E icien Measu emen o he Use Expe ience. A Po uguese Ve sion.
P ocedia Compu e Science. 5 h In e na ional Con e ence on So wa e
De elopmen and Technologies o Enhancing (27), pp. 491-498. DOI:
10.1016/j.p ocs.2014.02.053
[12] Sch epp, M.; Hinde ks, A. & Thomaschewski, J. (2017). Cons uc ion o
a benchma k o he Use Expe ience Ques ionnai e (UEQ). In e na ional

- 108 -
In e na ional Jou nal o In e ac i e Mul imedia and A i icial In elligence, Vol. 4, Nº6
Jou nal o In e ac i e Mul imedia and A i icial In elligence, 4(4), pp. 40-
44. DOI: 10.9781/ijimai.2017.445
Ma in Sch epp
Ma in Sch epp has been wo king as a use in e ace
designe o SAP AG since 1994. He inished his diploma
in ma hema ics in 1990 a he Uni e si y o Heidelbe g
(Ge many). In 1993 he ecei ed a PhD in Psychology (also
om he Uni e si y o Heidelbe g). His esea ch in e es s
a e he applica ion o psychological heo ies o imp o e
he design o so wa e in e aces, he applica ion o Design
o All p inciples o inc ease accessibili y o business so wa e, measu emen
o usabili y and use expe ience, and he de elopmen o gene al da a analysis
me hods. He has published se e al pape s conce ning hese esea ch ields.
And eas Hinde ks
And eas Hinde ks g adua ed wi h a diploma in Compu e
Science and is Mas e o Science in Media In o ma ics by
he Uni e si y o Applied Science Emden/Lee . He has
wo ked as a business analys and a p og amme om 2001
o 2016. Back hen, he ocused on de eloping use - iendly
business so wa e. Cu en ly, he is a eelancing business
analys and senio UX a chi ec . Fu he mo e he is a Ph.D.
s uden a he Uni e si y o Se ille, Spain. He is in ol ed in esea ch ac i i ies
dealing wi h UX ques ionnai es, p ocess op imiza ion, in o ma ion a chi ec u e,
and use expe ience since 2011.
Jö g Thomaschewski
Jö g Thomaschewski ecei ed a PhD in physics om he
Uni e si y o B emen (Ge many) in 1996. He became Full
P o esso a he Uni e si y o Applied Sciences Emden/
Lee (Ge many) in Sep embe 2000. His esea ch in e es s
a e In e ne applica ions o human-compu e in e ac ion,
e-lea ning, and so wa e enginee ing. D . Thomaschewski
is he au ho o a ious online modules, e.g., “Human-
Compu e Communica ion,” which a e used by he Vi ual Uni e si y (online)
a six uni e si y si es. He has wide expe ience in usabili y aining, analysis,
and consul ing.