scieee Science in your language
[en] (orig)

Augmented reality in error troubleshooting inside flexible manufacturing cells

Abstract

A new type of software framework for error troubleshooting in flexible manufacturing systems using a frame marker device. Our framework system meant to resolve the failures originated from the human-machine interface and to generate self-training from previous experience.

Read accessible full text

Augmented reality in error troubleshooting inside flexible manufacturing cells

Author: Csokmai, Lehel; Tarca, Radu; Moldovan, Ovidiu
Publisher: Debreceni Egyetemi Kiadó – Debrecen University Press
Year: 2015
Source: https://dea.lib.unideb.hu/bitstreams/c49b6c11-b704-49b7-ba63-a56a8d77721c/download
Recen Inno a ions in Mecha onics (RIiM) Vol. 2. (2015). No. 1-2.
DOI: 10.17667/ iim.2015.1-2/3.
1
Augmen ed eali y in e o oubleshoo ing inside
lexible manu ac u ing cells
Lehel Csokmai PhD
Uni e si y o O adea,
Facul y o IMT, P esea ch Cen e
P oduc ica, O adea, Romania
lcsokmai@uo adea. o
Radu Ta ca PhD
Uni e si y o O adea,
Facul y o IMT, Depa men o
Mecha onics, O adea, Romania
a ca@uo adea. o
Moldo an O idiu PhD
Uni e si y o O adea,
Facul y o IMT, Depa men o
Mecha onics, O adea, Romania
o [email protected]
Abs ac —A new ype o so wa e amewo k o e o
oubleshoo ing in lexible manu ac u ing sys ems using a ame
ma ke de ice. Ou amewo k sys em mean o esol e he
ailu es o igina ed om he human-machine in e ace and o
gene a e sel - aining om p e ious expe ience.
Keywo ds— lexible manu ac u ing cell;e o oubleshoo ing;
augmen ed eali y; so wa e; amewo k.
I. INTRODUCTION
The so wa e amewo k and he ame ma ke de ice has
been connec ed o he TMA 550 AL lexible manu ac u ing
cell. The cell is composed o he TMA 550 AL manu ac u ing
cen e, wo ABB obo s and one T shaped con eyo sys em
which connec s he wo ABB obo s. The posi ion o he cell
componen s is p esen ed on he (Fig. 1).
Fig 1. The TMA 55 Al lexible manu ac u ing cell
The ame ma ke de ice is connec ed o he lexible
manu ac u ing cell h ough he cell con ol so wa e which is
unning on he cen al command PC. The command so wa e
is made in-house wi h Emba cade o's RAD S udio and using
as da abase MySQL.
The cell command so wa e is based on modules. In he
case o he manu ac u ing cell con ol applica ion each
expansion module is a TCP/IP se e o clien . These modules
may ope a e wi hou he help o o he modules (s andalone),
o a e able o connec o o he in e nal modules (e.g.,
da abase). The ollowing ex ension modules has been made
o he lexible manu ac u ing cell: Con eyo , ABB, Fanuc,
RFID, AR. (Fig. 2)
Fig 2. The TMA 55 Al lexible manu ac u ing cell con ol so wa e
Recen Inno a ions in Mecha onics (RIiM) Vol. 2. (2015). No. 1-2.
DOI: 10.17667/ iim.2015.1-2/3.
2
II. AUGMENTED REALITY IN ERROR TROUBLESHOOTING
Vi ual eali y (VR) and augmen ed eali y (AR) a e ools
and echniques o i ual en i onmen s ha has key ea u es
in common wi h physical en i onmen . View and in e ac wi h
3D objec s is close o eali y han abs ac ma hema ics and
2D app oaches. Augmen ed eali y is an ad anced o m o
VR, which in eg a es images o i ual objec s in he eal
wo ld.
Wi h inc easing amoun o digi al da a ha can be s o ed
and accessed, he e is a need o ha ness his da a and u n in o
an engine capable o de eloping a new pe cep ion o he eal
wo ld.
Augmen ed eali y depends on he compu ing powe o he
de ices, which mus be able o e ain in o ma ion abou he
eal wo ld, such as ideo da a, posi ion, o ien a ion e c. and
also mus display he combined in o ma ion o he cap u ed
sc een and i ual in o ma ion in a way ha is meaning ul o
he ope a o .
The augmen ed eali y module o he con ol applica ion is
composed om 3 pa s:
 a web module (AR-WEB) esponsible o displaying
he documen a ion o e o codes and ohe
in o ma ion,
 he con ol applica ion module (AR-PC) esponsible
o ga he ing e o messages and o he in o ma ion
ela ed o e o s,
 and he so wa e unning on he mobile de ice (AR-
MOBILE) esponsible o he ecogni ion o ame
ma ke ags and displaying he documen a ion om
he web module.
III. AR-WEB MODULE
Fig 3. AR-WEB module o he lexible cell con ol applica ion
The AR-WEB (Fig. 3) module is done using he PHP
p og amming language wi h MySQL da abase suppo . The
module is in ended o se e he que ies sen om mobile
de ices. A e e y 4-5 seconds he mobile de ices making
que ies owa ds he web module which checks he da abase o
e o s and o he in o ma ions happening in he lexible
manu ac u ing cell. This module uns on an Apche web se e
which can un on he same compu e wi h he con ol
applica ion. In addi ion o se ing que ies o e o messages,
he module displays documen a ion ha may help sol e he
p oblems o he lexible manu ac u ing cell.
In Fig. 4 is shown a page om he ABB documen a ion o
esol e an e o o he ABB IRB1600 obo whe e he obo
memo y ba e y is discha ged and mus be eplaced and he
obo mus be ecalib a ed.
Fig 4. ABB documen a ion displayed on mobile de ice
Fo a as e esolu ions o e o s, a o m comple ed by he
ope a o which esol ed he e o can be added on he
documen a ion page. On any u u e e o his o m will be
displayed along wi h he documen a ion.
IV. AR-PC MODULE
The AR-PC module is designed o e ie e e o messages
and o he in o ma ions om he equipmen s o he lexible
manu ac u ing cell connec ed o he con ol applica ion hen
inse in o he da abase. These e o s and in o ma ions will be
e u ned on he nex que y made om he mobile de ice.
V. AR-MOBILE MODULE
The AR-MOBILE (Fig. 5) module was c ea ed using he
Uni y de elopmen en i onmen . This de elopmen
en i onmen is o en used o c ea ing games and was selec ed
Recen Inno a ions in Mecha onics (RIiM) Vol. 2. (2015). No. 1-2.
DOI: 10.17667/ iim.2015.1-2/3.
3
because has he Vu o ia augmen ed eali y lib a ies in eg a ed.
Ano he ad an age is he ease o dis ibu ing he applica ion
on di e en mobile pla o ms. Wi h mino modi ica ions he
applica ion may be dis ibu ed on he ollowing pla o ms:
And oid, iOS, Windows o Linux.
Fig 5. Uni y de elopmen en i onmen
A e he AR-MOBILE applica ion is connec ed o he AR-
PC module and he e o codes a e e ie ed, he i ual
objec s ep esen ing he e o s a e displayed when he mobile
de ice is di ec ed owa ds he ag gene a o de ice (Fig. 6).
Selec ing he i ual objec on he AR-MOBILE applica ion
will open he documen a ion page shown in Fig. 4.
Fig 6. Tag gene a o o AR-MOBILE module
VI. CONCLUSION
The p oposed use o augmen ed eali y in he e o
oubleshoo ing inside he lexible manu ac u ing cells can
imp o e he con ol ac i i ies using an in eg a ed e o
handling sys em.
The e o da abase can be dynamically ex ended wi h new
i ems co esponding o unp edic able e o s de eloped du ing
he manu ac u ing p ocesses.
Acknowledgmen
This wo k was pa ially suppo ed by he s a egic g an
POSDRU/107/1.5/S/80272, inside POSDRU Romania 2007-
2013 co- inanced by he Eu opean Social Fund – In es ing in
People.
Re e ences
[1] Lehel Csokmai, O idiu Moldo an, Cons an in Bungău, “A chi ec u e o
a lexible manu ac u ing cell con ol applica ion”, In e na ional
Scien i ic Con e ence on Ad ances in Mechanical Enginee ing 10-11
Oc obe 2013, Deb ecen, Hunga y
[2] L.Csokmai, O. Moldo an, I. Ta ca, R. Ta ca, “A Comp ehensi e
App oach o Ad anced E o T oubleshoo ing in In elligen
Manu ac u ing Sys ems”, Applied Mechanics and Ma e ials, Volume
404, 2013, pp. 631-634.
[3] L.S. Csokmai R.C. Ța că C. Bungău G. Husi, “A Comp ehensi e
App oach o O line Ad anced E o T oubleshoo ing in In elligen
Manu ac u ing Sys ems”, ICCCC 2014, O adea, Romania.
[4] Lehel Csokmai, O idiu Moldo an, Ioan Ta ca and Radu Ta ca,
“So wa e F amewo k o Ad anced E o T oubleshoo ing In Flexible
Manu ac u ing Sys em”, ICADME 2013.
[5] S. Lee, D.M. Tilbu y, “A modula con ol design me hod o a lexible
manu ac u ing cell including e o handling”, In J Flex Manu Sys
(2007) 19, pp.308–330.
[6] C. Syan, Y. Mos e ai, “S a us moni o ing and e o eco e y in lexible
manu ac u ing sys ems, In eg a ed Manu ac u ing Sys ems”, 1995, Vol.
6 Iss: 4 pp. 43-48.
[7] H. Kaindl, M. Vallée, and E. A nau o ic, “Sel -Rep esen a ion o Sel -
Con igu a ion and Moni o ing in Agen -Based Flexible Au oma ion
Sys ems, IEEE T ansac ions on Sys ems”, Man, and Cybe ne ics:
Sys ems, Vol. 43, no.1, 2013, pp.164-175.
[8] Bo chel , R. D., Tho son, J. “Towa d eusable hie a chical cell con ol
so wa e”, In e na ional Jou nal o P oduc ion Resea ch, 1997, 35:2,
577-594.
[9] Kao, J.F., “Op imal eco e y s a egies o manu ac u ing sys ems”,
Eu opean Jou nal o Ope a ional Resea ch 80 (2), 1995, 252263.
[10] Toguyeni, A.K.A., C aye, E., Gen ina, J.C., “A amewo k o design a
dis ibu ed diagnosis in FMS”, IEEE In e na ional Con e ence on
Sys ems Man and Cybe ne ics, 1996, Vol. 4, 2774-2779