THEIAXR has ecei ed unding om he Eu opean Union’s Ho izon Eu ope esea ch and inno a ion p og amme unde g an ag eemen No. 101092861. Any in o ma ion o esul s e lec s only he au ho ’s iew
and he Eu opean Commission is no esponsible o any use ha may be made o he in o ma ion i con ains.
E ec i e eX ended Reali y in Machine Ope a ion
THEIAXR
MAKING THE NON-PERCEIVABLE PERCEIVABLE
Ma ijn Rooke , PhD
Senio Inno a ion P ojec s & Funding Manage
TTCon ol GmbH
2
2025. 11. 05.
Challenges
O -Highway mobile machine y o e limi ed isibili y
o he human ope a o .
›En i onmen al condi ions
›Mobile machine y design
›Remo e ope a ion
Following his, he de ined challenges a e:
›De ini ion o in ui i e HMIs
›In ui i e in e ac ion wi h XR echnologies
›A ailable da a
›In e p e ing and p esen a ion o (limi ed) a ailable da a
›P ocessing on mobile machine y
›Human-cen e ed da a (incl. p i acy) / Co-Design
THEIAXR | Ma ijn Rooke | Public
Sou ce:
you ube
h ps://www.cdc.go /
Sou ce: you ube
3
2025. 11. 05.
THEIAXR Goals
THEIAXR will deli e he ollowing key inno a ions:
•eX ended Reali y echnologies applicable o s a e-
o - he-a ope a ing en i onmen s (cabin-based,
and ele-ope a ional) o make he in isible isible
esp. he non-pe cei able pe cei able o he
human ope a o
•XR in e ac ion concep and design p inciples ha
acili a e a human iendly and in ui i e design o
XR in e ac ion in indus ial applica ions
•A ansdisciplina y co-design me hodology o
design and de elop mul imodal XR in o ma ion
p esen a ion and in e ac ion solu ions
THEIAXR | Ma ijn Rooke | Public
4
2025. 11. 05.
THEIAXR De elopmen s
THEIAXR | Ma ijn Rooke | Public
5
2025. 11. 05.
Use Cases
Snow G ooming Logis ics Cons uc ion
©p ino h ©KALMAR Sou ce:
liebhe .com
THEIAXR | Ma ijn Rooke | Public
6
2025. 11. 05.
Concep s
XR use in e ace key concep s
•Comp ehensi e and compa ible XR use
in e aces concep s we e c ea ed
•A lis o assis i e ea u es we e ealized
h ough di e en o ms o ex ending
in o ma ion p esen a ion
•In e ac i e unc ions we e also
concep ualized and in eg a ed
•Basis o elabo a ing design de ails and
echnical ealiza ion
THEIAXR | Ma ijn Rooke | Public
7
2025. 11. 05.
In eg a ed Solu ions
mobile machine y
da a
en i onmen
da a
Senso s /
Ac ua o s
Came a(s)
Came a(s)
ECU(s)
Ga eway(s)
Cen al
p ocesso
Ou pu
de ices
Simula ed en i onmen /
machine da a
THEIAXR | Ma ijn Rooke | Public
8
2025. 11. 05.
P o o ype Solu ions
›No el senso se ups:
1. PanoThe m: Pano amic The mal Imaging o Objec De ec ion and T acking [1]
[1] Ke nbaue e al.: PanoThe m: Pano amic The mal Imaging o Objec De ec ion and T acking, VISAPP'2024
THEIAXR | Ma ijn Rooke | Public
9
2025. 11. 05.
Pano he m Resul s
THEIAXR | Ma ijn Rooke | Public
16
2025. 11. 05.
Hap ic / Fo ce Feedback In e ac ion
Hap ic eedback o con ol o
machine y
Feedback abou :
•Mo ion
•Exca a ing
•Handling o ca go
•Hap ic T ack
con ols o
Mo ion
•Hap ic
handling o
ac ua o s
THEIAXR | Ma ijn Rooke | Public
17
2025. 11. 05.
Vi ual Wo lds
THEIAXR | Ma ijn Rooke | Public
18
2025. 11. 05.
Vi ual Wo lds
Basis o emo e ope a ion
•In o ma ion indica ion
•Di ec ion
•G asping poin s
•Hidden In o ma ion
THEIAXR | <P esen e >
19
2025. 11. 05.
Vi ual Wo lds
THEIAXR | Ma ijn Rooke | Public
20
2025. 11. 05.
Fi s Feedback om Ope a o s
The ac ha you can also
see he dep hs whe e he
bucke is in he side iew
is jus cool!
Wo ld class! Tha ‘s a g ea
idea. I‘ e no ied i ye ,
bu I‘m con inced by he
look o i
G ea concep , i i wo ks
like his. Especially he
swi elling ange and
objec ecogni ion.
We mus n' o ge ha d i ing an
exca a o means you ha e o be
cons an ly ocused. (...) I hink ha i
you y o display oo many de ails a
he same ime, you will e en ually
o e whelm he exca a o d i e .
THEIAXR | Ma ijn Rooke | Public
THEIAXR has ecei ed unding om he Eu opean Union’s Ho izon Eu ope esea ch and inno a ion p og amme unde g an ag eemen No. 101092861. Any in o ma ion o esul s e lec s only he au ho ’s iew
and he Eu opean Commission is no esponsible o any use ha may be made o he in o ma ion i con ains.
Thank you o you a en ion
Ma ijn Rooke
Senio Inno a ion P ojec s & Funding Manage
[email p o ec ed]
+43 1 585 3434 4207 h ps://www. heia-x .eu
h ps://www.linkedin.com/company/ heia-x
h ps://zenodo.o g/communi ies/ heia-x /
