A creative prototype illustrating the ambient user experience of an intelligent future factory

Jou nal o Ambien In elligence and Sma En i onmen s 9 (2017) 41–57 41 DOI 10.3233/AIS-160417 IOS P ess A c ea i e p o o ype illus a ing he ambien use expe ience o an in elligen u u e ac o y Tiina Kymäläinen a,*, Eija Kaasinen a, Jaakko Hakulinen b, Tomi Heimonen b,**, Pe i Mannonen c, Maiju Aikala a,***, Hannu Paunonen d, Jouni Ruo salainen dand Lau i Leh ikunnas d aHuman Fac o s in Complex Sys em, VTT Technical Resea ch Cen e o Finland L d, Tampe e, Finland bTampe e Uni o Compu e -Human In e ac ion, School o In o ma ion Sciences, Uni e si y o Tampe e, Finland cSchool o Science, Aal o Uni e si y, Espoo, Finland dR&D Valme Au oma ion Inc, Tampe e, Finland Abs ac . This a icle in oduces use expe ience esea ch ha has been ca ied ou by e alua ing a ideo-illus a ed science ic ion p o o ype wi h p ocess con ol wo ke s. Essen ially, he p o o ype ‘A emo e ope a o ’s day in a u u e con ol cen e in 2025’ was aimed a disco e ing oppo uni ies o new in e ac ion me hods and ambien in elligence o he ac o ies o he u u e. The heo e ical objec i e was o ca y ou expe ience design esea ch, which was based on explici ambien use expe ience goals in he nomina ed indus ial wo k con ex . This a icle desc ibes he comple e c ea i e p o o yping p ocess, s a ing om he ini ial use esea ch ha included e alua ions o cu en wo k p ac ices, echnological end s udies and co-design wo kshops, and concluding wi h use esea ch ha assessed he inal design ou come, he science ic ion p o o ype. The main con ibu ion o he a icle is on he ambien use expe ience goals, he c ea ion p ocess o he ideo-illus a ed science ic ion p o o ype, and on he e lec ion o how he expe ience-d i en p o o ype was e alua ed in wo esea ch se ups: as ideo sequences embedded in a Web su ey, and as in e iews ca ied ou wi h expe p ocess con ol wo ke s. Fo he science ic ion p o o yping p ocess, he con ibu ion demons a es how he me hod may employ ideo-illus a ion as a means o u u e-o ien ed use expe ience esea ch, and how complemen a y use -cen e ed me hods may be used o alida e he esul s. Keywo ds: Indus y 4.0, science ic ion p o o yping (SFP), (ambien ) use expe ience (UX) design, use -cen e ed design (UCD), p ocess con ol wo k 1. In oduc ion Enabled by ad anced digi aliza ion, indus ial in e - ne and in elligen echnologies, such as ambien in- elligence (AmI), i is expec ed ha he 4 h indus- ial e olu ion, o en e e ed as o Indus y 4.0, will soon be on i s way [28,31]. In gene al, i is expec ed ha Indus y 4.0 will bene i om he AmI ech- nologies and esul e.g. in sho e de elopmen pe i- ods, indi idualiza ion in demand o he cus ome s, lexibili y, decen aliza ion and esou ce e iciency. In *Co esponding au ho . Tel.: +358 400399511; E-mail: [email p o ec ed]. **P esen add ess: Depa men o Compu ing and New Media Technologies, Uni e si y o Wisconsin-S e ens Poin , USA. ***P esen add ess: Pilo Plan , Oy Keskuslabo a o io – Cen al- labo a o ium Ab, Espoo, Finland. he p oduc ion p ocesses, he e will be signi ican ly g ea e demands made o all membe s o he wo k- o ce, in e ms o managing complexi y, abs ac ion and p oblem-sol ing [19]. Fo he indus ial wo ke s, he e olu ion is expec ed o p o ide oppo uni ies by he quali a i e en ichmen o he ac o y wo k: a mo e in e es ing wo king en i onmen and he g ea e au- onomy and oppo uni ies o sel -de elopmen . Sub- sequen ly, he employees a e likely o ac much mo e on hei own ini ia i e, o possess excellen commu- nica ion skills and o o ganize hei pe sonal wo k low; i.e. in he u u e ac o ies hey a e expec ed o ac as s a egic decision-make s and lexible p oblem- sol e s [10]. The indus y ans o ma ion is an icipa ed o be mos ele an in he manu ac u ing indus y, bu i will also a ec such indus ial sec o s as p ocess con ol This a icle is published online wi h Open Access and dis ibu ed unde he e ms o he C ea i e Commons A ibu ion Non-Comme cial Li- cense (CC BY-NC 4.0). 1876-1364/17/$35.00 © 2017 – IOS P ess and he au ho s. 42 T. Kymäläinen e al. / A c ea i e p o o ype illus a ing he ambien use expe ience o an in elligen u u e ac o y wo k, which is he main con ex en i onmen o his a - icle. The design esea ch in oduced p esen s an idea ha he u u e con ol wo ke s will moni o and supe - ise AmI sys ems wi h new in e ac ion me hods, and ha he wo k asks will be sha ed lexibly be ween he sys ems and human wo ke s. The esea ch has aken a s ance ha , in o de o succeed, he Indus y 4.0 e- qui es mo e han me ely in oducing new echnologies on he ac o y loo . In essence, o de eloping sus ain- able solu ions he e is a need o a sha ed ision o he u u e, which equi es a clea and ex ensi e iew o how he new echnologies will be u ilized and wha kind o wo k oles and p ac ices will eme ge as a e- sul . So as o c ea e a sha ed ision o he u u e p o- cess con ol wo k, he esea ch has ocused on use ex- pe ience (UX) design and employed a me hod called science ic ion p o o yping (SFP) [17] in deli e ing i s design ou come. The a icle explains in de ail he UX in es iga ions ha ha e ollowed he SFP ame- wo k [12,13], ye he main ocus is on illus a ing how he UX esea ch has been implemen ed in a ideo- illus a ed science ic ion p o o ype, en i led ‘A emo e ope a o ’s day in a u u e con ol cen e in 2025’, in which AmI, compu ing and design play a c i ical ole. Fo he AmI communi y, his con ibu ion is essen- ial, as i demons a es UX esea ch esul ing om he use -cen e ed design (UCD) app oach o ambien in- elligence, which is an impo an opic aised by Aa s and De Ruy e [1] in hei call o new esea ch pe - spec i es on AmI. In addi ion, he design esea ch con ibu es o he second o de ambien in elligence, which ad oca es new o ms o expe ience, cu iosi y and engagemen in AmI solu ions [5]. Essen ially, he a icle ackles a challenging p oblem in he ba ie e- duc ion o Indus y 4.0. in he inclusion o sma in- ui i e sys ems explici ly a ge ed a p ocess con ol wo k in u u e p ocess plan s. The main objec i e is o p o ide a p ac ical example o he c ea i e UX design me hodology o ea ly engagemen wi h pa icipan s in u u e AmI sys ems. 2. Backg ound o he s udy and key li e a u e The use expe ience (UX) esea ch was seen o be imely and ele an in his case s udy, as, o e all, he UX app oach is cu en ly ecei ing g owing a en ion in he de elopmen o indus ial wo king en i onmen s and se ices [18,44]. Basically, he UX app oach sug- ges s ha , in con as o p oblem- o echnology-d i en design, use expe ience should be he main o ce in d i ing he design [9,24,39]. In gene al, he aim is o guide he design owa ds posi i e and sa is ying expe- iences ha help in communica ing impo an objec- i es, as p oposed e.g. by [9,15,40,45]. In an indus ial wo k con ex , he in es iga ions ha e usually ocused on a ho ough unde s anding o wha he employees wan o achie e in hei wo k, and how his can bes be suppo ed. Acco dingly, in his domain, UX has been in e p e ed explici ly as: “The way a pe son eels abou using a p oduc , se ice, o sys em in a wo k con ex , and how his shapes he image o onesel as a p o essional” [18]. So a , he main di icul y in adop - ing he UX-d i en design app oach in a echnology- d i en indus y has been he ac ha he echnological skills in a company o en dic a e he design space [38]. The e o e, he co e p oposi ion in UX design, ‘expe i- ence be o e p oduc ’ [15, p. 63], has no been ealized. Tha is he eason why he esea ch in his a icle has encou aged he idea ha UX design in es iga ions and ou comes should ini ially be in balance wi h he b and and image o he company and in ol e he cha ac e is- ics o he se ices ha a e gene ally alued by i s cus- ome s. To achie e his, he impo an expe iences has been pu sued by de ining explici ambien UX goals o which he indus ial pa ne and he esea ch g oup ha e commi hemsel es. As o he p ima y means o c ea e, deli e and e al- ua e he UX goals, he s udy has employed he science ic ion p o o yping (SFP) me hod ha B.D. Johnson o iginally in oduced as a ool o in elligen en i on- men (IE) esea ch [16,17]. A e he me hod launch, he g ea majo i y o he SF-p o o ypes we e published wi hin he IE domain, al hough he me hod has la e been widely adop ed also by o he ields, such as u- u es s udies, o esigh and business s udies (a ull li - e a u e syn hesis on he SF-p o o ype opics can be ound in [25]). I should be no ed ha he ela ion be- ween science ic ion and science ac has also been iden i ied simul aneously by schola s, echnology de- signe s and esea che s om di e se disciplines, e.g. by [4,6,7,14,30,37,41,42]. P incipally, he p o o ypes c ea ed by he SFP me h- od a e s o ies g ounded in cu en science and engi- nee ing esea ch ha a e w i en o he pu pose o ac - ing as p o o ypes o people o explo e a wide a ie y o u u es [17]. In o de o jus i y he use o he me hod in a UX esea ch con ex , i is e e ed he e o Fo l- izzi and Ba a bee [9], who ha e con i med ha s o ies and s o y elling p o ide a solid basis o UX esea ch. They explain ha , as a eposi o y o expe ience, s o ies T. Kymäläinen e al. / A c ea i e p o o ype illus a ing he ambien use expe ience o an in elligen u u e ac o y 43 con ain almos e e y hing ha is equi ed o a deep, app ecia i e unde s anding o he s eng hs and weak- nesses o a se ice, as well as wha needs o be e- designed o he u u e. In his con ex , he SFP me hod seemed pa icula ly expedien , since, as a design ool, i allows one o s udy al e na i e, po en ial u u es and illus a e how o in e ac wi h AmI and eme ging ech- nologies a e he ans o ma ion o he indus ial wo k en i onmen . The ea lie SF-p o o ypes ha ha e e e ed o UX design can be ound e.g. om he wo k o Ege on e al. [8] and G aham [11], bu he ole o he UX design has no been sys ema ically desc ibed in ei- he o hose. Co espondingly, many o he p o o ypes make e e ence o he b oade conce ns o UCD, e.g. [36,43,47], bu do no explain in de ail how hese ind- ings a e con e ed in o p o o ype c ea ion. The mos sui able p e ious example o a UX-d i en SFP p ocess was ound om [23]. The app oach in he UX esea ch has ne e heless been in oduced in a e y di e en e- sea ch con ex , and as i does no include he c i ical in ol emen o he company b and in he p ocess, he backg ound o he design p ocess was sough om elsewhe e, namely business sciences. In ha domain, Wu, has in oduced “imagina ion wo kshops” [46] and Zheng & Callaghan “Diege ic Inno a ion Templa - ing” (DiT) [49] as po en ial SFP c ea ion p ocesses. The disad an age o hose o his esea ch, howe e , seemed o be ha hey employed exis ing Science Fic- ion as hei p ima y sou ce o inspi a ion. Ul ima ely, he esea ch o his a icle ound solid g ound o he UX-d i en p ocess om he amewo k in oduced by G aham e al. [12,13]. This SFP amewo k in ensi ies he me hod by “expanded consume expe ience de el- opmen ”, which seemed o be he mos con enien ap- p oach o ambien UX design esea ch. 3. Me hodology – Design o he s udy and used me hods Acco dingly, he esea ch o his a icle has em- ployed he SFP amewo k by G aham e al. o i s UX design p ocess and Johnson’s SFP me hod o c ea ing i s main design ou come, he SF-p o o ype. In b ie , he SFP amewo k includes ou asks: –Resea ch and expe imen a ion (wha ) –Explo a ion and planning (who) –De elopmen (how), and –Deploymen The i s ask o he amewo k is in ended o sup- po he wo ld building p ocess o he p o o ype by esea ch and expe imen a ion. In he p ac ical UX e- sea ch, du ing his ask he esea ch g oup in es iga ed end s udies (business, echnology and socie al ends) and o ganized co-design wo kshops o selec ing mos sui able echnologies and opics o be explo ed in he p o o ype. The second ask in ol es people in he p o- cess by con inuing he explo a ion and planning wi h ha ocus. In o de o de e mine he speci ic people and loca ions in he nomina ed p ocess con ol wo k, he esea ch g oup conduc ed p elimina y use s ud- ies on loca ion. In he amewo k, his ask concludes wi h an expe ience speci ica ion, which in he s udy has been unde s ood as he de ining o explici ambien UX goals o he p ocess con ol wo k. In con empla ing he hi d ask, he de elopmen o he SF-p o o ype, he esea ch g oup a anged se e al i e a i e wo kshops, in which he manusc ip o he p o o ype was accomplished. The c ea ion p ocess ol- lowed igo ously Johnson’s SFP me hod, which con- sis s o i e undamen al s eps [16]: 1. Selec a echnology, science o issue o be ex- plo ed using he p o o ype. Se up he wo ld in ques ion; in oduce people and loca ions. 2. In oduce he scien i ic in lec ion poin . 3. Explo e he science’s implica ions and ami ica- ions o he wo ld. 4. In oduce he human in lec ion poin wi h he echnology; modi ica ions o ixing he p oblem; a new a ea o expe imen a ion. 5. Explo e he implica ions, solu ion o lessons lea n . In gene al, he use o he me hod esul s in an SFP ha akes a w i en o m, bu in his case he ou - come was decided o be ideo sequences and suppo - i e in e ac ion demos. The inal s ep o he me hod “explo ing he implica ions, solu ion o lessons lea n ” may also be unde s ood as he las , ou h s ep in he SFP amewo k, he deploymen . In he s udy, his pa ecei ed special a en ion, as he e we e wo complemen a y use e alua ion se ups o ganized o e alua ing he SFP: a Web su ey and expe in e - iews. To summa ize, in he pu sui o c ea ing, deli e ing and e alua ing he SFP he design p ocess was con- s uc ed om he ollowing ac ions (see Table 1). Figu e 1explica es how he imeline o he case s udy is a ached o he SFP amewo k and SFP me h- od. 44 T. Kymäläinen e al. / A c ea i e p o o ype illus a ing he ambien use expe ience o an in elligen u u e ac o y Table 1 A summa y o how he s udy was designed Task 1. Resea ch and expe imen a ion T end s udies Co-design wo kshops Task 2. Explo a ion and planning Use s udies in he nomina ed indus ial wo k con ex De ining o he ambien UX goals Task 3. De elopmen Wo kshops o c ea ing he manusc ip C ea ing o he SFP ideo C ea ing he suppo i e in e ac ion demos Task 4. Deploymen Use e alua ions by a Web su ey Use e alua ions by expe in e iews Fig. 1. Design p ocess: on op a e he asks o he SFP amewo k, in he middle he case s udy se ings, and a he bo om, he s eps o he SFP me hod. As he objec i e o he esea ch was o ca y ou UX in es iga ions by c ea i e p o o yping, he esea ch ques ions we e o med a ound his p oblem-space. Consequen ly, he design esea ch was pu sued in o - de o answe he ollowing ques ions: –How o ca y ou UX-d i en esea ch by employ- ing he SFP me hod and SFP amewo k –How o c ea e and deli e ideo-illus a ed SFP wi h ambien UX goals –How o e alua e he ambien UX goals embedded in he SFP and by ha , alida e esea ch The emainde o his a icle will ollow he s uc- u e o he SFP amewo k, a i s , wi h a de ailed de- sc ip ion o he p ocess, me hods used and da a se s o each o he asks, and subsequen ly, by deli e ing he esul s and ou come o he p ocess. 3.1. Resea ch and expe imen a ion In he ini ial phase o he p ocess, he esea ch g oup a anged a se ies o co-design wo kshops o delibe - a ing he wo ld building p ocedu e o he i s ame- wo k ask. The p ocess began wi h a end analysis ha s udied business, echnology and he gene al soci- e al ends o he nomina ed p ocess con ol wo k do- main. A e ha , he esul s we e sha ed wi hin he i s co-design wo kshop, which in ol ed esea che s and company ep esen a i es. The pa icipan s assessed he impo ance o he ends p esen ed, and he mos pop- ula o hem we e used as he basis o a discussion in g oups ha iden i ied impo an hemes ela ing o use expe iences and possible echnical solu ions ha sup- po ed hem. The mos in e es ing concep s, om aca- demic and business pe spec i es, we e in he conclud- ing wo kshops u he de eloped in o usage scena ios. As a e e ence, in he SFP amewo k, he concep ual p o o yping is encou aged as he ou come o he i s ask. 3.2. Explo a ion and planning The i s use esea ch in an ac ual loca ion ocused on wha kinds o expe iences people cu en ly had du - ing he p ocess con ol wo k, and wha kinds o posi- i e expe iences hey expec o ha e in he u u e. The esea ch was ca ied ou in an oil e ine y ocusing on he p oduc ion o ad anced, low-emission a ic u- els in Finland (de ails omi ed o gua an ee pa icipan anonymi y), in he au umn o 2012. The esea ch was conduc ed in si u in he con ol cen e whe e he ope - a o s wo ked; 23 ope a o s pa icipa ed in he esea ch (20 male/3 emale; wi h wo k expe ience anging om 1–15 yea s). The esea ch consis ed o a con ex ual in- qui y [2], a use expe ience signi icance ques ionnai e, and c i ical expe ience in e iew [32]. The e we e al- oge he six con ex ual inqui y sessions and i e c i i- cal expe ience in e iews. The esea ch me hods we e selec ed so ha he use and wo k expe iences we e handled bo h di ec ly and indi ec ly du ing he in o - ma ion ga he ing. 3.3. De elopmen Du ing he wo kshops, he esea ch g oup consid- e ed al e na i e means o desc ibing and illus a ing T. Kymäläinen e al. / A c ea i e p o o ype illus a ing he ambien use expe ience o an in elligen u u e ac o y 45 he UX goals by using he SFP me hod. To suppo his aim, he means we e selec ed p ima ily o be ideo sequences and, seconda ily, in e ac ion demos, which we e hypo hesized o p o ide an e ec i e deli e y o he con en o he e alua ion pa icipan s. Videos we e chosen o illus a e, in pa icula , expe iences ela ing o AmI, new echnical possibili ies o emo e con- ol wo k, he emo e p esence o employees and new collabo a ion p ac ices. The ideos we e also consid- e ed o be an e ec i e way o communica e abou he o e all design, which was aimed o be a com o able and lexible wo king space ha suppo ed collabo a- ion. The in e ac i e demo was c ea ed o speech- and ges u e-based in e ac ion. Fo his wo k, he un- damen al amewo k came om [29]. The sc een- play was collabo a i ely de eloped by means o i- sual sc ip s and ea ly es ideos, as hese echniques we e iden i ied as being ele an du ing he end anal- ysis. The ideo-illus a ed SFP ‘A emo e ope a o ’s day in a u u e con ol cen e in 2025’ included al oge he six ideo sequences. The i e a i e wo k was ca ied ou by a eam comp ising esea che s, company ep- esen a i es and ideo p oduc ion p o essionals. To make he ideos, he esea ch g oup i s o ganized a wo kshop o c ea ing he sc eenplays o he ideo sequences. Fo his wo k, he g ounding amewo k came om [35]. The sequences we e ilmed in an in e - ac i e collabo a i e en i onmen ha was s aged wi h a se o moni o s, wall-sized p ojec ed displays and la ge ouchsc eens. The imagina y isual con en was exclu- si ely c ea ed o all he displays seen on he ideo. Technically, he ideos we e sho by using a combi- na ion o minimally in e ac i e p o o ypes and g een sc een echnique, whe e en isioned sc een con en was added o he ideo a he pos p oduc ion s age. Dis- play con en s we e added by using digi al composi - ing and anima ions, e.g. an on-sc een cu so ollow- ing hand poin ing, we e synch onized o he ilmed ma e ial. Spoken dialogue and a na a o ’s oice we e added in o he ideo a pos p oduc ion. The speech- and ges u e-based in e ac ion demo was implemen ed by adding new in e ac ion modali- ies in o an exis ing p ocess au oma ion sys em and, consequen ly, he p o o ype did no exac ly ma ch wi h he in e ac ions seen on he ideo-illus a ed SFP. Howe e , he same au oma ion sys em was in use in he o ganiza ion whe e he on-si e e alua ions ook place, so he pa icipan s we e al eady amilia wi h he sys em and could, he e o e, ocus simply on he new in e ac ion echniques. Technically, he suppo - i e in e ac ion demos we e implemen ed by using Mi- c oso Kinec and Mic oso Speech Recogni ion. A wi eless clip on a mic ophone a ached o he use ’s clo hes was used o he speech inpu . The p o o ype enabled window and iew manipula ion; pa icipan s could poin a windows using hand ges u es and, using an on-sc een poin e , g ab and mo e windows by clos- ing a poin ing hand in o a is , esize windows by g ab- bing wi h wo hands, close and esize windows wi h speech, and poin a and change iews and open new ones by using speech commands. The ac ual p ocess con ol ope a ions we e omi ed om he suppo ed unc ionali y. 3.4. Deploymen Fo e alua ing he ideo-illus a ed SFP, wo com- plemen a y use esea ch se ups wi h expe p ocess con ol ope a o s and wo ke s we e es ablished. In he i s se up, he pa icipan s we e in oduced o he SFP ia he ideos uploaded o YouTube and embedded in a Web ques ionnai e. The ques ionnai e included a discussion space ha was ac i e o a wo-mon h pe- iod, in la e 2014. In all, 58 expe s pa icipa ed in he Web su ey, 16 o whom we e ac i e commen a o s. The pa icipan s we e selec ed om among he cus- ome companies o he p ojec ’s pa icipa ing com- pany. The pa icipan s’ backg ound in p ocess con ol wo k was di e se, as he domains ela ed o he chem- ical indus y, ene gy dis ibu ion, ene gy p oduc ion, ood indus y, o es indus y, manu ac u ing and nu- clea powe . The pa icipan s had wo k expe ience o up o 41 yea s; all we e in e es ed o e y in e es ed in new echnologies. The second e alua ion se up included in e iews conduc ed in si u in a municipal powe plan in a ci y in sou he n Finland (de ails omi ed o gua an ee pa - icipan anonymi y), du ing Oc obe 2015. In addi ion o seeing he SFP ia YouTube ideos, he pa icipan s we e also able o y ou he speech- and ges u e-based in e ac ion demo. The e alua ions included six ope a- o s (all male) aged 27–34, who desc ibed hei occu- pa ional i les as: au oma ion manage , p ocess ope - a o , powe plan ope a i e, se ice enginee , au oma- ion enginee , and elec ici y ins umen manage . The pa icipan s had expe ience o wo king in a con ol cen e en i onmen anging om 1–7 yea s; all we e in e es ed o e y in e es ed in new echnologies. The Web su ey consis ed o bo h closed and open- ended ques ions; he in e iew se up consis ed o a ideo in e iew wi h use analysis [48] and a semi- 46 T. Kymäläinen e al. / A c ea i e p o o ype illus a ing he ambien use expe ience o an in elligen u u e ac o y s uc u ed in e iew [22]. In bo h g oups, he pa ic- ipan s assessed six ideo scenes, one a a ime; he main di e ence be ween he e alua ion se ups was ha , in he Web su ey, he pa icipan s could choose which o he six scenes hey wan ed o see and com- men on i s . In o de o gain quan i a i e da a abou he UX goals, he use s we e, a e seeing each ideo scene, eques ed o assess whe he hey could iden i y wi h he UX goals by answe ing a UX signi icance ques ionnai e (using a 5-poin Like scale) speci i- cally c ea ed o his p ojec . The use s in bo h e- sea ch se ups answe ed he same open-ended ques- ions ela ing o he SFP; in addi ion, hey we e e- ques ed o analyze he new in e ac ion me hods and de- li e new ideas. As a inal pa , he pa icipan s we e allowed o p o ide o e all eedback on he p esen ed u u e con ol en i onmen . The Web su ey and in- e iew da a we e ansc ibed and quali a i ely ana- lyzed. 4. Analysis and indings 4.1. Resul s o he esea ch and expe imen a ion The aim o he i s wo kshops was o iden i y and discuss he esul s o he end s udies, analyze he use esea ch esul s and o c ea e u u e con ol cen e us- age concep s o he SFP. Visions o he new use in e - ac ion ools we e o especial in e es , as i was seen ha hey may imp o e he wo k p ocesses and suppo new ways o wo king. In he i s wo kshop, he ollowing ideas conce ning business enewal and ela ed de el- opmen possibili ies we e iden i ied o u he consid- e a ion: –Dis ibu ed p oduc ion: sma mobile in e ac ion ools, –Highly au oma ed p oduc ion: a cen alized e- mo e expe compe ence cen e , –Tempo a y plan wi h less well educa ed use s: ex emely in ui i e con ol wi h sa e y ensu ed, –No ice ope a o s: help om a social ne wo k o o he ope a o s, in elligen agen s and knowledge managemen , –Quickly changing p oduc ion plans: co-c ea ion wi h he cus ome . In addi ion, du ing he i s co-design wo kshops he po en ial ambien UX goals ha based on end analy- sis and cu en unde s anding o he ope a o wo k in he pa icipa ing company we e de eloped. 4.2. Resul s o he explo a ion and planning The ini ial use esea ch ocused on de ining he building blocks o he use expe iences in he nomi- na ed p ocess con ol wo k en i onmen . The con ex- ual inqui y ocused on wo k cha ac e is ics, as de- ined in he co e- ask analysis me hod [20,33,34]. The analysis was ho ough; i included he de ini ion o he wo k en i onmen by inspec ing special occasions, e en s, eelings and expe iences ela ed o i . The cu - en s a e o UX was also polled wi h a use expe i- ence signi icance ques ionnai e, especially c ea ed o his case s udy, which eques ed he ope a o s o a e 19 use expe ience goals de eloped in he co-design wo kshops. The c i ical expe ience in e iew [32] was de el- oped by adap ing he c i ical decision me hod by Klein e al. [21]. While he me hod in gene al ocuses on decisions and elemen s o decision-making, he c i i- cal expe ience in e iews ocused on he eelings and expe iences and hei de elopmen du ing he pa ici- pan s’ wo k ac i i ies. The s uc u e o he c i ical ex- pe ience in e iew mainly ollowed he s uc u e o he c i ical decision me hod, i.e. ob aining an uns uc u ed inciden accoun , cons uc ing an inciden imeline, ex- pe ience momen iden i ica ion, and expe ience mo- men p obing. In addi ion, he ope a o s we e asked abou he ools used in di e en phases o he inciden , possibili ies o new echnologies o imp o ing he op- e a o s’ wo k du ing simila inciden s, and in o ma ion sha ing needs and p ac ices ela ing o he inciden s. The ich ield esea ch da a was u he analyzed by iden i ying ope a o s’ ema ks conce ning he UX goals and hei ca ego iza ion. Al oge he , 216 ex- ce p s we e iden i ied and all o hem, excluding 7 gen- e al p oduc imp o emen sugges ions, we e also clas- si ied in o 19 p ede ined UX goals. The UX goals we e again analyzed and hei dynamics, con ex o eme - gence and building blocks desc ibed. Consequen ly, as a esul o he ini ial use s udies, he e was a ela i ely ex ensi e lis o ele an UX goals o he explici AmI domain; howe e , he in o ma ion was no ye ocused enough o guide he concep ideo phase. The e o e, i was essen ial o na ow he lis down in o mo e dis inc ambien UX goals. 4.3. Resul s leading o SFP de elopmen Toge he wi h he use s udy indings, he esul s o he ini ial wo kshops we e employed in de e min- ing he UX goals and o inspi ing u he idea ion o T. Kymäläinen e al. / A c ea i e p o o ype illus a ing he ambien use expe ience o an in elligen u u e ac o y 47 he SFP. Subsequen ly, i was de ined ha he one p i- ma y, highe le el ambien UX goal in he p ocess con- ol wo k should be “Peace o mind”, which was in- e p e ed as: “The ope a o knowing wha is going on in he p oduc ion p ocess and how o in e ene when needed”. In essence, “Peace o mind” included he ol- lowing se en b oade -spec um UX goals ha guided he inal SFP c ea ion: –Sense o con ol –T us in human-au oma ion coope a ion –Sense o eedom –Owne ship o he p ocess –Rela edness o he wo k communi y –Meaning ulness o he wo k –Success and achie emen . The ideas g adually begun o o m in o scena ios ha all ela ed o he opic: ‘A emo e ope a o ’s day in a u u e con ol cen e in 2025’. The selec ed usage scena ios in oduced a u u e plan whe e: –The con ol cen e changed in o a lexible space, which could be shaped o suppo di e en wo k asks and esponsibili ies, such as g oup o indi- idual wo k; –The AmI sys em was able o p edic he p ocess dis u bances h ough simula ions; and, as a esul , many dis u bances could be p e en ed be o e hey ook place; –The AmI sys em enabled p oac i e and u u e- o ien ed p ocess con ol wo k; –Use in e aces p o ided isual and si ua ion- awa e desc ip ions o cu en and upcoming p o- cess e en s; –The AmI sys em enabled collabo a i e p oblem sol ing and con inuous de elopmen . Consequen ly, each scena io was w i en as a UX- d i en scene: he s a ing poin was he a ge ed use expe ience, and essen ially he scene desc ibed how he expe ience was acili a ed by design. 5. The science ic ion p o o ype As a s o yline, he SFP ideo “A emo e ope a o ’s day in a u u e con ol cen e in 2025” has been buil om six scenes ha ake place du ing an ope a o ’s wo k shi . The li e ac ion scenes and oice-o e ex- plana ions delibe a ely aimed o be p o oca i e in o - de o s imula e discussion be ween he pa icipan s. In wha ollows, he e is a b ie explana ion o each Fig. 2. P oduc ion moni o ing. SFP scene and a link o he YouTube ideos (p esen ed in Finnish, he o iginal language, wi h English sub i- les). The scenes in oduce: ou ine p oduc ion supe - ision, ope a o guidance, p epa a ion o a p oduc ion change, ca ying ou he p oduc ion change, inciden managemen , and a concluding shi change. 5.1. P oduc ion moni o ing ‘P oduc ion moni o ing’ depic s p ocess con ol op- e a ion se ings whe e an ope a o moni o s he s a- us o he p ocess om hei pe sonal wo ks a ion (see Fig. 2). The AmI sys em is p esen ed as a esponsi e and in elligen pa ne assis ing he ope a o in p edic - ing and eac ing o changes in p ocess s a us. The goal is o emphasize he use ’s sense o eedom and con ol by allowing hem o use in e ac ion me hods o choice. These quali ies a e exempli ied h ough speech-based in e ac ions, which allow he ope a o o issue com- mands o e ie e in o ma ion and enable in elligen agen s o moni o he p ocess on behal o he ope a o . This ees he ope a o o ocus on o he asks. Link o he scene: h ps://www.you ube.com/wa ch? =wy-3Aw iY-A. 5.2. Guidance ‘Guidance’ ocuses on po aying how new in e ac- ion echniques enable ope a o s o mo e eely a ound he con ol cen e and collabo a e wi h one ano he (see Fig. 3). Thei asks a e suppo ed by he in elligen AmI sys em. In he scene, an expe ienced ope a o p o- ides guidance o a no ice ope a o on a speci ic pa o he p oduc ion p ocess. The guidance is gi en by using ges u al and spoken in e ac ion on a wall-sized display. The use o he sys em blends in as a na u al elemen o he collabo a ion. Link o he scene: h ps://www.you ube.com/wa ch? =JRjRJIpwQN8. 48 T. Kymäläinen e al. / A c ea i e p o o ype illus a ing he ambien use expe ience o an in elligen u u e ac o y Fig. 3. Guidance. Fig. 4. P epa a ion o a p oduc ion change. 5.3. P epa a ion o a p oduc ion change Majo p oduc ion changes a e p ocedu es ha e- qui e ca e ul planning in o de o a oid dis u bances o unnecessa y de ia ions in p oduc ion quali y. This scene illus a es how he u u e con ol cen e acili- a es collabo a ion be ween he cen e and ield pe - sonnel h ough imp o ed si ua ional awa eness, such as pe sonnel loca ions and ongoing main enance ope - a ions (see Fig. 4). The pe sonnel a e going h ough a p oduc ion change plan, which hey e i y by com- munica ing wi h he ield pe sonnel. The echnologies include speech-based in e ac ion, la ge ouchsc een displays, synch onous oice communica ion and li e ideo wi h augmen ed eali y and 3D elemen s. Link o he scene: h ps://www.you ube.com/wa ch? =9 nB96 q_QY. 5.4. P oduc ion change ‘P oduc ion change’ ocuses on ope a o ’s asks du - ing an ongoing p oduc ion change (see Fig. 5) and he use o in e nal social media ools. The main ocus is on he ole o he AmI sys em, which, as an ac i e pa - ne , suppo s he human ope a o in si ua ions ha a ise du ing p oduc ion change. The sys em is able o an- Fig. 5. P oduc ion change. Fig. 6. Dis u bance managemen . icipa e po en ial dis u bances, eco ds he ope a o ’s oubleshoo ing ac i i ies, and sugges s a ious solu- ions ha he ope a o can choose om. Success ul op- e a ions sha ed by ope a o s allow he sys em o make u u e ecommenda ions. The new echnologies demons a ed in he scene in- clude speech commands and in elligen and p oac i e in o ma ion collec ion, p edic ion and ecommenda- ion unc ionali ies. Link o he scene: h ps://www.you ube.com/wa ch? =guMgYnPoI1Y. 5.5. Dis u bance managemen ‘Dis u bance managemen ’ illus a es how mobile in e ac ion echnologies may be used o access he au oma ion sys em emo ely, ou side o he con ol cen e , and enable collabo a ion on- and o -si e (see Fig. 6). The scene demons a es how dialogue wi h he AmI sys em helps ope a o s manage oubleshoo ing and dis u bance si ua ions. By acking bes p ac ices used in ope a ing he au oma ion sys em, ope a o s can be connec ed o a ailable esou ces and o he – e en emo ely loca ed – ope a o s o enable collabo a i e analysis and he esolu ion o p oblems. The ou- T. Kymäläinen e al. / A c ea i e p o o ype illus a ing he ambien use expe ience o an in elligen u u e ac o y 49 Fig. 7. Shi change. bleshoo ing ac ions a e au oma ically s o ed by he sys em so ha hey can be o use should he same si u- a ion a ise in he u u e. Link o he scene: h ps://www.you ube.com/wa ch? =8BiNS8dA-xo. 5.6. Shi change The inal scene po ays he oppo uni ies o mo- bile wo k a o ded by new echnologies (see Fig. 7). The shi change be ween ope a o s is acili a ed by he au oma ion sys em, which au oma ically acks ope a- o s’ loca ions wi hin he acili y. The sys em ensu es ha esponsibili y o he p ocess is seamlessly ans- e ed wi hou a ace- o- ace hando e . The new echnologies illus a ed in he SFP in- clude he use o mobile de ices o moni o and con- ol he p ocess, new senso echnologies ha ecog- nize and ack people, and he unc ionali y o moni- o ope a o s’ ac i i ies and acili a e he hando e p o- cess – wi hou comp omising sa e y o ope a o s’ con- ol o e he sys em. Link o he scene: h ps://www.you ube.com/wa ch? = z2wyn6Xzgw. 6. Resul s o he deploymen In Johnson’s me hod, he SFP c ea ion p ocess con- cludes wi h an explo a ion o he implica ions and e- isi s he lessons lea n . In his a icle, he e lec ion pa p esen s he main indings o he use esea ch and UX goal e alua ions, and, as such, i also demons a es he inal s ep o he SFP amewo k. In wha ollows will be he mos impo an indings om bo h e alu- a ion se ups in de ail. The indings a e based on he w i en eedback (Web su ey) and e bal discussions (in e iews) ha ook place a e he pa icipan s had seen each o he ideo scenes. 6.1. Scene 1: P oduc ion moni o ing This scene illus a es he use o speech commands and sma au oma ion sys em and i s use in e ace. The AmI sys em was desc ibed as suppo ing eedom o choice, and, acco ding o he pa icipan s, he sys- em p esen ed ce ainly p o ided in e es ing oppo u- ni ies o in e ac ion. In gene al, he con ol cen e was s a ed o be pleasan in appea ance, and he use in e - ace colo scheme well composed. Speech commands we e gene ally seen o be sui - able o na iga ion, opening app op ia e iews, mon- i o ing o plans and p edic ions; bu no o ope a- ions, excep in c i ical si ua ions. Especially in he ield wo k, he speech commands we e conside ed help ul o sea ching ele an in o ma ion. The com- mands we e expec ed o be e y simple and cus- omizable o each ope a o ’s p e e ences. One e- sponden in he Web ques ionnai e ne e heless spec- ula ed c i ically: “As speech-based in e ac ion doesn’ wo k e y well be ween humans, i could be e en wo se in he communica ion be ween humans and ma- chines”. The po en ial o speech ecogni ion e o s also aised some conce ns. S ill, i was belie ed ha he sma au oma ion sys em would be able o pick ou some impo an keywo ds om con e sa ions and p o ide ele an , con ex -awa e in o ma ion. In gen- e al, he AmI sys em was conside ed o make p ac ical wo k mo e e o less and e icien , and consequen ly educe he p obabili y o human e o s in he ope a ion wo k. The g ea es alue esul ing om he AmI was ex- pec ed o be achie ed in ieldwo k. Acco ding o he pa icipan s, au oma ion is cu en ly no a he le el il- lus a ed in he ideo, and qui e a numbe o he asks p esen ed a e ca ied ou manually. One conce n was ha , when he AmI o e ed in o ma ion abou ala ms, i only p esen ed he ex emes, al hough he e would also be a need o mo e comp ehensi e ala m in o - ma ion. In he in e iews, some pa icipan s s a ed ha hey we e used o “ ixed” ala m no i ica ions, bu e en cu en ly some p e e ed o cus omize hem. In he Web su ey, some esponden s c i icized ha oo much au oma ion migh e ode he p o essional skills o he wo k o ce; ne e heless, his could be compensa ed wi h simula ion aining. 6.2. Scene 2: Guidance This scene in oduced he ges u e con ol and use o di e en ypes o displays. In gene al, ges u e con- 56 T. Kymäläinen e al. / A c ea i e p o o ype illus a ing he ambien use expe ience o an in elligen u u e ac o y [12] G. G aham, A. G eenhill and V. Callaghan, C ea i e p o o yp- ing, Technological Fo ecas ing and Social Change 84 (2014). [13] G. G aham, A. G eenhill, G. Dymski, E. Coles and P. Hen- nelly, The science ic ion p o o yping amewo k: Building beha iou al, social and economic impac and communi y e- silience, Fu u e Ci y & Communi y Resilience Ne wo k, 2015. [14] A. G een ield, E e ywa e – The Dawning Age o Ubiqui ous Compu ing, New Ride s, USA, 2006. [15] M. Hassenzahl, Expe ience Design – Technology o All he Righ Reasons, Mo gan and Claypool Publishe s, 2010. [16] B.D. Johnson, Science ic ion p o o ypes. O : How I lea ned o s op wo ying abou he u u e and lo e science ic ion, in: P oceedings o he 5 h In e na ional Con e ence on In elligen En i onmen s, IOS P ess, 2009, pp. 3–8. [17] B.D. Johnson, Science Fic ion P o o yping: Designing he Fu- u e wi h Science Fic ion, Mo gan and Claypool Publishe s, 2011. [18] E. Kaasinen, V. Ro o, J. Hakulinen, J.P. Jokinen, H. Ka onen e al., De ining use expe ience goals o guide he design o indus ial sys ems, Beha iou & In o ma ion Technology 3001 (2015), 976–991. doi:10.1080/0144929X.2015.1035335. [19] H. Kage mann, W. Wahls e and J. Helbig, Secu ing he u- u e o Ge man manu ac u ing indus y. Recommenda ions o implemen ing he s a egic ini ia i e INDUSTRIE 4.0, Final epo o he Indus ie 4.0 Wo king G oup, Fo schungsunion, 2013. [20] H. Ka onen, I. Aal onen, M. Wahls öm, L. Salo, P. Sa ioja and L. No os, Hidden oles o he ain d i e : A challenge o me o au oma ion, In e ac ing wi h Compu e s 23 (2011). [21] G. Klein, R. Calde wood and D. MacG ego , C i ical decision me hod o elici ing knowledge, IEEE T ansac ions on Sys- ems, Man and Cybe ne ics 19 (1989), 462–472. doi:10.1109/ 21.31053. [22] M. Kunia sky, Obse ing he Use Expe ience, a P ac i- ione ’s Guide o Use Resea ch, Mo gan Kau mann, 2003, pp. 419–437. [23] T. Kymäläinen, Science Fic ion P o o ypes as Design Ou come o Resea ch – Re lec ing Ecological Resea ch App oach and Expe ience Design o he In e ne o Things, Aal o ARTS Books, Aal o Uni e si y, 2015. [24] T. Kymäläinen, The design me hodology o s udying sma bu complex do-i -you sel expe iences, Jou nal o Ambien In el- ligence and Sma En i onmen s (2015), IOS P ess. [25] T. Kymäläinen, Science ic ion p o o ypes as a me hod o dis- cussing socio- echnical issues wi hin eme ging echnology e- sea ch and o esigh , A hens Jou nal o Technology & Engi- nee ing (ATINER) (2016). [26] T. Kymäläinen, P. Pe älä, J. Hakulinen, T. Heimonen, J. James and J. Pe ä, E alua ing a u u e emo e con ol en i onmen wi h an expe ience-d i en science ic ion p o o ype, in: 11 h In e na ional Con e ence on In elligen En i onmen s, IEEE Compu e Socie y, 2015, pp. 81–88. [27] T. Kymäläinen, E. Kaasinen, M. Aikala, J. Hakulinen, T. Hei- monen, P. Mannonen, H. Paunonen, J. Ruo salainen and L. Leh ikunnas, E alua ing u u e au oma ion wo k in p o- cess plan s wi h an expe ience-d i en science ic ion p o o ype, in: 12 h In e na ional Con e ence on In elligen En i onmen s, IEEE Compu e Socie y, 2016. [28] H. Lasi, P. Fe ke, H.G. Kempe , T. Feld and M. Ho mann, In- dus y 4.0. Business & In o ma ion Sys ems Enginee ing 6(4) (2014). [29] L. Leh ikunnas, Puhe- ja eleohjaus p osessinhallinnassa (Speech and ges u e in e ac ion in p ocess con ol wo k, in Finnish), Diploma hesis, Tampe e Uni e si y o Technology, Tampe e, Finland, 2014. [30] C. Linehan, B.J. Ki man, S. Ree es, M.A. Bly he, J.G. Tanen- baum, A. Desja dins and R. Wakka y, Al e na e endings: Us- ing ic ion o explo e design u u es, in: CHI’14 Ex ended Ab- s ac s on Human Fac o s in Compu ing Sys ems, ACM, 2014, pp. 45–48. [31] W. MacDougall, Indus ie 4.0: Sma manu ac u ing o he u- u e, Ge many T ade & In es (2014). [32] P. Mannonen, M. Aikala, H. Koskinen and P. Sa ioja, Unco e - ing he use expe ience wi h c i ical expe ience in e iews, in: P oceedings o he 26 h Aus alian Compu e -Human In e ac- ion Con e ence on Designing Fu u es: The Fu u e o Design (OzCHI ’14), ACM, New Yo k, NY, USA, 2014, pp. 452–455. [33] L. No os, Ac ing unde unce ain y, he co e- ask analysis in ecological s udy o wo k, Espoo, VTT, Finland, 2004. [34] M. Nuu inen and L. No os, Co e ask analysis in acciden in es iga ion: Analysis o ma i ime acciden s in pilo ing si - ua ions, Cogni ion, Technology & Wo k 11 (2007), 129–150. doi:10.1007/s10111-007-0104-x. [35] H. Paunonen, Roles o in o ma ing p ocess con ol sys ems, Ph.D. Disse a ion, Tampe e Uni e si y o Technology, Tam- pe e, Finland, Publica ion 225, 1997. [36] R. Peldszus, Su p ise payload ack: A use scena io o a con- cep ual no el y in e en ion sys em o isola ed c ews on ex- ended space explo a ion missions, in: Wo kshop P oceedings o he 7 h In e na ional Con e ence on In elligen En i on- men s, IOS P ess, 2011, pp. 290–300. [37] P. Pu dy, F om science ic ion o science ac : How design can in luence he u u e, Use Expe ience Magazine 13(2) (2013). [38] V. Ro o, Y. Lu, H. Nieminen and E. Tu al, Designing o use and b and expe ience ia company-wide expe ience goals, in: P oceedings o he 33 d Annual ACM Con e ence Ex ended Abs ac s on Human Fac o s in Compu ing Sys ems,ACM, 2015, pp. 2277–2282. [39] E.B.N. Sande s and U. Danda a e, Design o expe iencing: New ools, in: P oceedings o he Fi s In e na ional Con e - ence on Design and Emo ion, C.J. O e beeke and P. Hekke , eds, Del Uni e si y o Technology, Del , The Ne he lands, 1999, pp. 87–91. [40] N. Shed o , Expe ience Design, New Ride s Publishing, Indi- anapolis, 2001. [41] N. Shed o and C. Noessel, Make I So: In e ac ion Design Lessons om Science Fic ion, O’Reilly Media Inc., 2012. [42] J. Tanenbaum, Design ic ional in e ac ions: Why HCI should ca e abou s o ies, In e ac ions 21(5) (2014), 22–23. doi:10. 1145/2648414. [43] K. Tassini, The magician’s assis an , in: Wo kshop P oceed- ings o he 7 h In e na ional Con e ence on In elligen En i- onmen s, IOS P ess, 2011, pp. 267–278. [44] H. Vää äjä, T. Olsson, P. Sa ioja and V. Ro o, UX goals – How o u ilize use expe ience goals in design, Tampe e Uni e si y o Technology, Depa men o So wa e Sys ems Tampe e, Fin- land, 2012. [45] P. W igh and J.J. McCa hy, Technology as Expe ience,MIT P ess, Camb idge, 2007. [46] H.Y. Wu, Imagina ion wo kshops: An empi ical explo a ion o SFP o echnology-based business inno a ion, Fu u es 50 (2013), 44–55. doi:10.1016/j. u u es.2013.03.009. T. Kymäläinen e al. / A c ea i e p o o ype illus a ing he ambien use expe ience o an in elligen u u e ac o y 57 [47] H.Y. Wu and V. Callaghan, The spi i ual machine, in: Wo k- shop P oceedings o he 7 h In e na ional Con e ence on In el- ligen En i onmen s, IOS P ess, 2011, pp. 155–166. [48] S. Yli isku and J. Buu , Designing wi h Video, Focusing he Use -Cen ed Design P ocess, Sp inge Science & Business Media, 2007. [49] P. Zheng and V. Callaghan, Diege ic inno a ion empla ing, in: Wo kshop P oceedings o he 12 h In e na ional Con e ence on In elligen En i onmen s, IOS P ess, 2016.