The four-masted Barque Peking in virtual reality as a new form of knowledge transfer
Abstract
Virtual Reality (VR) has established itself in recent years in the geosciences through its application in the immersive visualization of spatial data. In particular, VR offers new possibilities for the user to acquire knowledge through playful interaction within a virtual environment. This paper details the development and implementation of a new form of knowledge transfer, based on interactivity within a VR system. The particular use-case discussed is a VR application focusing on the four-masted barque Peking. From 2023 on, the restored ship will form an important exhibit in the future German Hafenmuseum in Hamburg. The new VR application offers users the possibility to enter and explore a virtual model of the Peking and find out more information at three separate points of interaction (3D object models, sails and ship flags). These interaction points provide a timely opportunity to examine several of the theoretical aspects of knowledge transfer through interactivity and integrate them in the development of the VR application. Above all, the VR application should be an important part of the learning process for the user. There remains still much potential for further research into more advanced approaches such as support for user-input questions and tailored content.
Full text
THE FOUR-MASTED BARQUE PEKING IN VIRTUAL REALITY
AS A NEW FORM OF KNOWLEDGE TRANSFER
T. P. Ke s en1, *, D. T au1, 2, F. Tschi schwi z3
1 Ha enCi y Uni e si y Hambu g, Pho og amme y & Lase Scanning Lab, Übe seeallee 16, D-20457 Hambu g, Ge many
(Thomas.Ke s en, Dominik.T au)@hcu-hambu g.de
2 Agency o Geoin o ma ion and Su eying, Neuen elde S aße 19, D-21109 Hambu g, Ge many Dominik.T au@g .hambu g.de
3 IB&T So wa e GmbH, An'n Slagboom 51, D-22848 No de s ed , Ge many - Felix.T[email p o ec ed]
Commission IV, WG IV/9
KEY WORDS: 3D, Anima ion, Games Engine, In e ac ion, Modelling, Recons uc ion, Visualisa ion
ABSTRACT:
Vi ual Reali y (VR) has es ablished i sel in ecen yea s in he geosciences h ough i s applica ion in he imme si e isualiza ion o
spa ial da a. In pa icula , VR o e s new possibili ies o he use o acqui e knowledge h ough play ul in e ac ion wi hin a i ual
en i onmen . This pape de ails he de elopmen and implemen a ion o a new o m o knowledge ans e , based on in e ac i i y
wi hin a VR sys em. The pa icula use-case discussed is a VR applica ion ocusing on he ou -mas ed ba que Peking. F om 2023 on,
he es o ed ship will o m an impo an exhibi in he u u e Ge man Ha enmuseum in Hambu g. The new VR applica ion o e s use s
he possibili y o en e and explo e a i ual model o he Peking and ind ou mo e in o ma ion a h ee sepa a e poin s o in e ac ion
(3D objec models, sails and ship lags). These in e ac ion poin s p o ide a imely oppo uni y o examine se e al o he heo e ical
aspec s o knowledge ans e h ough in e ac i i y and in eg a e hem in he de elopmen o he VR applica ion. Abo e all, he VR
applica ion should be an impo an pa o he lea ning p ocess o he use . The e emains s ill much po en ial o u he esea ch in o
mo e ad anced app oaches such as suppo o use -inpu ques ions and ailo ed con en .
1. INTRODUCTION
In he ea ly days o VR, he e we e limi ed applica ions ou side
o la ge esea ch labo a o ies and mili a y acili ies (Dö ne
2013). Howe e , hanks o he ad en o low-cos i ual eali y
sys ems in he mid-2010s (Oculus Ri , HTC Vi e) and imp o ed
a ailabili y and licensing possibili ies o game engines, his
echnology is now a ailable o a wide public and is expec ed o
make an impo an con ibu ion o he u u e media landscape.
Mo e and mo e VR expe iences deal wi h a eas o objec s ha
a e no longe in exis ence, such as his o ical ci ies o cul u al si es
(Deggim e al. 2017; Tschi schwi z e al. 2019; Walmsley,
Ke s en 2019). The ull po en ial o hese gene a ed i ual
en i onmen s using speci ic game engines o e s mo e han s a ic
isualisa ion and p esen a ion o cul u al asse s o he use . The
in eg a ion o in e ac i e elemen s can be used o p omo e
educa ion h ough en e ainmen (known commonly by he
po man eau “edu ainmen ”), in pa icula o younge audiences
and use g oups ha a e no so well- e sed in he subjec .
Fu he mo e, he implemen a ion o dynamic elemen s o e s an
enhancemen o he imme si e expe ience o he iewe .
Using he example o he ou -mas ed ba que Peking, a ious
poin s o in e ac ion allowing addi ional in o ma ion o be
con eyed ha e been de eloped and es ed wi hin he i ual
en i onmen . Wha esul s is a new o m o knowledge ans e
ha includes bo h his o ical in o ma ion pe aining o he ship, as
well as in o ma ion abou he de elopmen p ocess o he VR
applica ion. This la e subjec is impo an o p esen as he VR
expe ience is a ge ed a he gene al public and no only a
selec ed expe s.
* Co esponding au ho
The goal o his p ojec was o i ually e-cons uc a his o ical
ship in de ail in 3D in o de o de elop a VR applica ion including
in e ac ions o demons a e he po en ial o i ual eali y o
knowledge ans e in museums.
2. METHODS
Fo he de elopmen o he in e ac i e VR applica ion and
isualiza ion o he ou -mas ed ba que Peking, he game engine
Un eal Engine 4.22.3 om he so wa e company Epic Games
Inc. was used. Fo he ha dwa e, he Vi e P o head-moun ed
display om HTC and Val e Co po a ion was chosen.
Fo he upcoming pe manen exhibi ion in he u u e Ge man
Ha enmuseum, he ou -mas ed ba que Peking (Figu e 1 le ) was
i ually es o ed o i s 1927/1928 s a e. To c ea e he i ual ship
Peking (Figu e 1 igh ), 3D models and plans we e acqui ed om
sou ces in he shipping indus y, and in o ma ion on he ship and
he ship's in en o y eco ded by geode ic me hods
(pho og amme y and e es ial lase scanning (TLS)).
The Peking is a ou -mas ed s eel ba que, commissioned by he
F. Laeisz shipping company and buil om 1910 o 1911 by he
Blohm + Voss shipya d in Hambu g. The ship is o e 115 m long
and has ou mas s o up o 50 m in heigh . I s long and a ied
his o y has been desc ibed in de ail by he associa ion "F eunde
de Vie mas ba k PEKING e.V." (2020) ("F iends o he ou -
mas ed Ba que Peking"). Un il sho ly a e he yea s 1927/1928,
he ship was used o anspo sal pe e om Chile o Eu ope and
hen, a e some con e sions, se ed as a aining ship o na al
o ice candida es. In 2017 he Peking e u ned om New Yo k
o Ge many a e se e al changes o owne ship. The his o ic ship
is cu en ly unde going es o a ion a he Pe e s shipya d in he
ISPRS Annals o he Pho og amme y, Remo e Sensing and Spa ial In o ma ion Sciences, Volume V-4-2020, 2020
XXIV ISPRS Cong ess (2020 edi ion)
This con ibu ion has been pee - e iewed. The double-blind pee - e iew was conduc ed on he basis o he ull pape .
h ps://doi.o g/10.5194/isp s-annals-V-4-2020-155-2020 | © Au ho s 2020. CC BY 4.0 License.
155
illage Wewels le h (60 km no hwes o Hambu g nea
Glücks ad ), and will likely be one o he lagships o he u u e
Ge man Ha enmuseum in Hambu g om 2023.
In he ollowing, special emphasis is gi en o hose pa s o he
isualisa ion p ocess ha di e signi ican ly om p e ious
app oaches in VR isualiza ion. Fi s , he en i e wo k low is
p esen ed, wi h special a en ion gi en o he da a o ma s used,
be o e he implemen a ion o dynamic and in e ac i e elemen s
is desc ibed in mo e de ail.
2.1 De elopmen o he VR applica ion
The Hansa Ha bou in Hambu g's Kleine G asb ook qua e was
chosen as he " i ual be h" o he Peking, as i o e s a isually
closed-o a ea and was indeed he ship’s his o ical ancho age
du ing i s ac i e pe iod. Su ounding en i onmen al objec s such
as buildings, quay walls and ege a ion we e only udimen a ily
gene a ed so as no o educe dis ac ion om he main objec o
in es iga ion, he ship i sel . An o e ly de ailed design isks
ocusing he iewe 's a en ion on hese en i onmen al elemen s
a he expense o he ship. The LoD2 (Le el o De ail) models
om he Hambu g 3D ci y da ase we e used o he placemen
o building meshes lining he ha bou , limi ing he use ’s iew
om he ship deck and con ibu ing o he o e all imme si e
e ec o he en i onmen . These da a as well as he digi al e ain
model (g id wid h = 1 me e ) used o he landscape opog aphy
a e eely a ailable om he Agency o Geoin o ma ion and
Su eying Hambu g.
Figu e 2 illus a es he a ea o he Hansa Po , which was
econs uc ed as an en i onmen al backd op o he expe ience
and which is di ided in h ee hema ic hemes. I is explici ly no
he aim o his econs uc ion o depic he eal en i onmen , bu
a he o gi e an imp ession o he ypical po cha ac e is ics ha
exis in his a ea.
In he no he n a ea, con aine s, loading c anes and walls we e
added o he scene in addi ion o he exis ing logis ics complexes.
The second hema ic a ea in he sou h encloses he headqua e
buildings o he Hambu g Po Au ho i y (HPA) and is, in i s
cu en s a e, mainly hidden behind ees and bushes. Meanwhile,
Figu e 1. The Peking in he yea 2017 a e i s ans e om New Yo k o he Pe e s shipya d in Wewels le h a he en ance o
he i e S ö (le , pho o: S i ung Hambu g Ma i im) and he i ual econs uc ion o he ship ( igh )
Figu e 2. The i ual be h o he Peking in he VR applica ion: Hambu g's Hansa ha bou wi h su ounding buildings ac ing as
isual ba ie s
ISPRS Annals o he Pho og amme y, Remo e Sensing and Spa ial In o ma ion Sciences, Volume V-4-2020, 2020
XXIV ISPRS Cong ess (2020 edi ion)
This con ibu ion has been pee - e iewed. The double-blind pee - e iew was conduc ed on he basis o he ull pape .
h ps://doi.o g/10.5194/isp s-annals-V-4-2020-155-2020 | © Au ho s 2020. CC BY 4.0 License.
156
he hi d hema ic a ea is loca ed a he wes e n end o he po
basin and encloses he his o ic sheds no. 50 and 51, which se ed
as a ca go handling a ea a he beginning o he 20 h cen u y.
Today he e a e s ill many c anes and wagons p esen , which
we e in eg a ed in o he VR applica ion as scene y p ops.
One o he cen al objec i es o he p ojec was o c ea e a
de ailed 3D model o he Peking o be isi ed and expe ienced
i ually om a Fi s Pe son View (FPV). To his end, digi al 3D
models om companies in ol ed in he es o a ion o he ship
we e used o he c ea ion o he hull. To o e come he di e ing
s a es o de elopmen and complexi y o hese 3D models, o he
sou ces such as a dense poin cloud o he hull om e es ial
lase scanning, as well as he o iginal cons uc ion plan om
1910, we e also exploi ed. F om all hese da a sou ces, he mos
ex ensi e and de ailed a eas we e selec ed and he ship i ually
cons uc ed o e se e al de elopmen s ages.
Fo he modelling o he deck supe s uc u e (e.g. Figu e 3
bo om), de ails we e ca ied o e om he Peking’s iden ical
sis e ship, he Passa (Figu e 3 op), ancho ed in T a emünde
( he po o he Hansea ic ci y o Lübeck) as a museum ship. In
addi ion, he o iginal ship cons uc ion egula ions o he Peking
p o ided impo an in o ma ion. The gene al p ocess o CAD
modelling on he basis o a ious da a has al eady been deal wi h
in de ail in he li e a u e and in o he p ojec s. Two examples o
a de ailed 3D modelling wo k low can be ound in Ke s en,
Linds aed (2012a) o Ke s en e al (2014).
Figu e 3: View o e he main deck o he sis e ship Passa ( op)
and o e he i ual main deck o he Peking (bo om)
The Peking was no accessible o his p ojec ’s du a ion as i is
in he shipya d o es o a ion (see Ul ich 2020a). The only wo
elemen s o he ship a ailable in Hambu g ( he auxilia y s ee ing
wheel in he Museum o Hambu g His o y and he igu ehead in
he In e na ional Ma i ime Museum Hambu g) we e eco ded
using pho og amme y and in eg a ed wi hin he i ual ship as
in e ac ion poin s. A o al o 544 wo king hou s we e spen on
he isualisa ion o he ship and i s su oundings including he
de elopmen o in e ac i e elemen s. A la ge pa o his wo k
(238 hou s) was spen on CAD modelling; a igu e simila o
o he modelling p ojec s (e.g. he "Old-Segebe g Town House"
in Ke s en e al. (2014) and he "Impe ial Ca hed al Königslu e "
in Ke s en, Linds aed (2012b)). The ime spen de eloping he
VR applica ion (222 hou s) is co espondingly ex ensi e, since
indi idual concep s i s had o be de eloped. Fo simila p ojec s
in he u u e he numbe s o hou s necessa y can be assumed o
be lowe due o he expe ience gained on his p ojec .
Mul iple isualisa ion modes a e p esen ed o he iewe by
means o in e ac i e elemen s wi hin he VR applica ion. In his
p ojec wo objec s we e selec ed as examples, which a e
p esen ed as poin cloud, iangula meshing, CAD model and
pho og aphy. Fo his pu pose he o iginal igu ehead and he
auxilia y s ee ing wheel o he Peking we e pho og amme ically
cap u ed wi h a Nikon D800 and p ocessed acco dingly o
gene a e he co esponding da a o ma s. In he cou se o he
pho og amme ic e alua ion an accu acy o 0.2 mm ( igu ehead)
and 1.8 mm (s ee ing wheel) was achie ed o scaling he poin
clouds, hough his high le el o p ecision has no signi ican
in luence on he modelling o he ship.
To imp o e he un- ime e iciency o he VR applica ion, i was
decided no o anima e he sails pe manen ly o simula ing wind
condi ions, bu ins ead s a he expe ience wi h hem u led a
he booms only a use ´s eques . Th ough a simple in e ac ion
wi hin he i ual wo ld (see also chap e 2.3.), a ma inee (Epic
Games 2020), an anima ion sequence, can be igge ed,
ac i a ing he hois ing o selec ed sails. Wi hin i e seconds,
selec ed g oups o sails a e i e a i ely scaled un il he sails a e
ully se , simula ing unin e up ed mo emen (Figu e 4). By
ac i a ing and in e ac i ely hois ing he sails, he use is
encou aged o ge in o ma ion and/o o lea n knowledge abou
he sails independen ly, including hei posi ion and designa ion
(see chap e 2.3.).
2.2 Dynamic componen s o he VR applica ion
I is also possible in VR o simula e na u al mo emen s o objec s
due o en i onmen al s imuli such as o make he scene y appea
mo e ali e. Con en ional applica ions ha ep oduce eali y as a
isualised 3D model may ha e scien i ic accu acy, bu
imme sion o use s is limi ed h ough a lack o o he senso y
s imuli. In his VR expe ience, he wa es and swell o he wa e
in he ha bou is simula ed by applying a p ede e mined anima ed
o se , such ha ce ain poin s on he wa e ’s su ace mo e
e ically in space o e ime. The e ec is heigh ened by he use
o special ligh maps ha p o ide o he game engine in o ma ion
on he no mal di ec ion and specula i y o he wa e ’s su ace,
depending on he angle o iew o he obse e .
Fu he mo e, he e ec o sails lapping in he wind is simula ed
using he Ve le algo i hm (Jakobsen 2001). Fo his pu pose,
planes we e gene a ed and hen subdi ided o p oduce housands
o aces. Each o hese aces was classi ied in o a numbe o
e ex g oups, some o which we e designa ed as s a ic while
o he s as mobile, and hus could de ia e om he assigned
posi ion unde he in luence o ex e nal o ces such as wind and
g a i y. These condi ions we e c ea ed in he game engine, hus
allowing he sails o be a ec ed co espondingly.
ISPRS Annals o he Pho og amme y, Remo e Sensing and Spa ial In o ma ion Sciences, Volume V-4-2020, 2020
XXIV ISPRS Cong ess (2020 edi ion)
This con ibu ion has been pee - e iewed. The double-blind pee - e iew was conduc ed on he basis o he ull pape .
h ps://doi.o g/10.5194/isp s-annals-V-4-2020-155-2020 | © Au ho s 2020. CC BY 4.0 License.
157
2.3 Implemen a ion o in e ac i e elemen s
In addi ion o he isualisa ion, in e ac ion poin s we e in eg a ed
o boos he imme si e e ec o he en i onmen . These
in e ac ions, as well as he esul ing p ocesses, ha e been
designed wi h ega ds o di e en o ms o knowledge ans e as
well as o he equi emen s o in e ac i i y in o de o in es iga e
he sui abili y o VR sys ems o his pu pose.
Figu e 5. The in e ac i e menu "Flags o he Peking" ( op) and
a ge ed locomo ion h ough elepo a ion in he VR model
(bo om)
In he ollowing, all h ee in e ac i e menus de eloped o he
applica ion a e desc ibed and explained. Wi hin he VR wo ld,
he use is able o elepo om one loca ion o ano he by means
o a hand con olle (Figu e 5 bo om). Upon en e ing ce ain
ma ked a eas (indica ed by o a ing ques ions ma ks, see Figu e
9 a he a e deck), in e ac i e menus appea allowing iewe s o
access addi ional in o ma ion by selec ing om di e en op ions
and h ough his gain new knowledge abou he ship. The
in e ac ion always esul s in a change in he en i onmen and he
display o addi ional in o ma ion in he o m o images, 3D
models and anima ions. This p ocess ep esen s a conside able
ad an age o e he ga he ing o in o ma ion in eali y, since on a
eal sailing ship such e ec s o anima ions a e no possible a he
push o a bu on.
Figu e 5 ( op) shows he i s in e ac i e menu. Th ough his
in e ac ion, he use can iew each o he lags o he Peking and
ob ain mo e in o ma ion abou each. The s uc u e o he menu is
e y simila o he wo examples ha ollow, minus a sho
in oduc o y ex . By p essing one o he bu ons, he
co esponding lag is hois ed on he lagpole a he s e n o he
ship and an explana o y ex appea s on he igh -hand side o he
in e ace (Figu e 5 op).
Figu e 6. The in e ac i e menu "Flags o he Peking" ( op) and
a ge ed locomo ion h ough elepo a ion in he VR model
(bo om)
Figu e 4. Hois ing o he p e- oyal sail as a ma inee sequence
ISPRS Annals o he Pho og amme y, Remo e Sensing and Spa ial In o ma ion Sciences, Volume V-4-2020, 2020
XXIV ISPRS Cong ess (2020 edi ion)
This con ibu ion has been pee - e iewed. The double-blind pee - e iew was conduc ed on he basis o he ull pape .
h ps://doi.o g/10.5194/isp s-annals-V-4-2020-155-2020 | © Au ho s 2020. CC BY 4.0 License.
158
A second in e ac i e menu allows use s o access in o ma ion
abou he sails o he Peking (Figu e 6). Like he o he menus, he
layou is di ided in o h ee sec ions. The sec ion heading is
loca ed a he op o he in e ace. Below his he e is always an
in oduc o y pa ag aph. Mos o he sc een space o he in e ace
is dedica ed o he in e ac i e elemen i sel . Besides being able
o iew a se ies o his o ical images in he bo om le -hand
co ne , he use is able o selec one, se e al o all checkboxes o
he g aphic on he igh -hand side o he in e ace (Figu e 6
bo om). Depending on which checkboxes a e icked, he sails o
he espec i e mas a e hen highligh ed on he diag am, so ha
he name and posi ion o he sails can be lea ned. A he same
ime, he hois ing anima ion plays on he 3D model in he i ual
wo ld, as desc ibed in chap e 2.1 (Figu e 6 op). This p ocess
can also be e e sed by clicking again on he selec ed checkbox.
The hi d menu o e s he possibili y o display objec s o he ship
( igu ehead and auxilia y s ee ing wheel) using di e en
isualisa ion me hods. The in e ac ion is designed in such a way
ha he use can ac i a e di e en op ions when in he immedia e
icini y o he igu ehead a he on o he ship (Figu e 7
bo om) o he auxilia y wheel on he midship deck (Figu e 7
op). The s uc u e o he in e ace is simila o he o he
in e ac i e menus. Wi h he help o se e al checkboxes, he
iewe can selec a p e e ed isualisa ion o m, whe eupon he
objec appea s acco dingly in on o he use . Fo he poin
cloud and meshing o ma , i is also possible o show di e en
le els o de ail. In addi ion, an explana o y panel appea s o he
le o he objec , di ided in o ex ual and isual pa s and
explaining he c ea ion p ocess o he espec i e da a o ma s
o e se e al pages. This p o ides he use wi h explana ions o
how pho og amme y and CAD modelling can be used o
gene a e such i ual objec s.
Figu e 7. In e ac i e menus "Peking wheel" ( op) and "Peking
igu ehead" (bo om)
3. RESULT
Following he de elopmen o he VR applica ion o he Peking,
a di e en ia ed analysis o he esul s ook place. Fo his pu pose
di e en c i e ia ha e been aken in o conside a ion. Quali a i e
ea u es, such as he in e ac i e elemen s, a e examined mo e
closely be o e he equi ed compu ing powe is e lec ed om a
quan i a i e poin o iew.
3.1 In e ac i e knowledge ans e in he case o he Peking
This chap e is di ided in o wo pa s, wi h he ocus on
knowledge ans e . Fi s , some cen al heo ies o knowledge
ans e a e lis ed and examined wi h ega d o he VR applica ion
c ea ed. In he second pa a s epwise scale o in e ac i i y is
in oduced, which is compa ed o he in e ac i e elemen s
implemen ed in his VR expe ience.
In he ollowing, cen al heo ies o knowledge ans e (Benke
2001; Issing, Klisma 2002; Dö ne 2013) a e lis ed oge he wi h
a sho explana ion and a sho conside a ion as o wha ex en
hey could be implemen ed in he VR applica ion:
•Si ua edness and au hen ici y – These ac o s play an
impo an ole in he success o he lea ning p ocess.
Knowledge ans e is acili a ed i , on he one hand, he
lea ning con en is pu in o con ex wi h espec o exis ing
knowledge and, on he o he hand, i lea ning akes place
in a speci ic o au hen ic en i onmen .
- In he VR applica ion, he ou -mas ed ba que o e s an
au hen ic en i onmen and knowledge acquisi ion
akes place using amilia s uc u es. All in e ac ion
menus ha e a consis en scheme (simila keys always
gene a e addi ional in o ma ion and cause a change in
he i ual wo ld), suppo ing he use in lea ning he
p inciple o ac ion.
•Mul iple con ex s – Ano he ac o ha acili a es lea ning
is he occasional change o pe spec i e and a ia ion o
si ua ions and asks.
- Due o he p ope mo ion in he i ual en i onmen ,
he use can a y his pe spec i e a will.
•Social con ex – In addi ion, he ans e o knowledge is
a ou ably in luenced when he e is an exchange wi h o he
people, ega dless o hei expe ise.
- Social in e ac ion wi h o he people is cu en ly only
possible o a limi ed ex en .
•Sel -con ol and coope a ion – Fu he mo e, he lea ne
is mo i a ed o acqui e mo e in o ma ion i he o she has
ee choice o lea ning me hod. Coope a ion wi h
addi ional pe sons also helps o open up new pe spec i es.
- Wi h he de eloped VR applica ion, he iewe is ee
o choose hei own lea ning s a egy.
Ano he issue is in e ac i i y, o which he e is no uni o m
classi ica ion due o he many disciplines in ol ed. Issing and
Klisma (2002) es ablish he ollowing scale, which ep esen s he
g adual inc ease o in e ac i i y and is compa ed sec ion by
sec ion wi h he VR applica ion desc ibed abo e.
•Access o speci ic in o ma ion
- In he VR applica ion se e al in e ac ion possibili ies
a e implemen ed allowing u he in o ma ion o be
displayed.
•Yes/no and mul iple choice answe op ions
- All in e ac i e menus allow he selec ion o indi idual
op ions, as well as allowing o he combined selec ion
o se e al checkboxes.
•Ac i a ion o ce ain addi ional in o ma ion
- The in e ac i e componen s a e designed o p o ide
addi ional explana ions and in o ma ion.
•Complex ques ions wi h in elligen eedback
- The use in his VR applica ion can only choose
be ween ce ain answe op ions and canno de ine
independen ques ions.
• F ee unbounded dialogue wi h he sys em
- This unc ion has no been implemen ed.
ISPRS Annals o he Pho og amme y, Remo e Sensing and Spa ial In o ma ion Sciences, Volume V-4-2020, 2020
XXIV ISPRS Cong ess (2020 edi ion)
This con ibu ion has been pee - e iewed. The double-blind pee - e iew was conduc ed on he basis o he ull pape .
h ps://doi.o g/10.5194/isp s-annals-V-4-2020-155-2020 | © Au ho s 2020. CC BY 4.0 License.
159
3.2 Technical equi emen s
The p esen a ion o digi al elemen s in i ual eali y sys ems
equi es e y low la encies o gene a e a smoo h VR expe ience
ee om mo ion sickness and nausea. In o de o c ea e he ideal
condi ions o VR, a "mo ion- o-pho on ime" ( ime be ween
senso de ec ion o he mo emen and he eac ion on he sc een)
o less han 20 milliseconds (ms), co esponding o 50 FPS
( ames pe second), is aimed o (McCa ey 2017). To
in es iga e he pe o mance o he compu e o he VR
applica ion, h ee scenes we e selec ed as examples based on he
di e en complexi y o he scenes (Figu e 8). A compu e loca ed
in he Pho og amme y & Lase Scanning Lab o Ha enCi y
Uni e si y Hambu g was used o he subsequen in es iga ion.
As summa ised in Tab. 1, he compu e equipmen used exceeds
he ecommended sys em equi emen s, which is a good
quali ica ion o op imal VR isualisa ion.
Figu e 8. Pe o mance o di e en scena ios: View o e he
ha bou scene ( op), iew o he whole ship (cen e) and physics
simula ion o a sail (bo om)
Rende ing a iew o he ha bou wi h only a ew en i onmen al
p ops and a low le el o de ail, peak alues o up o 54 FPS/19
ms (Figu e 8 op) a e achie ed. As he numbe o models and
ex u es inc eases, he pe o mance co espondingly dec eases,
as is he case when he en i e ship is in iew (∅: 21 FPS/48 ms -
Figu e 8 cen e). Due o he simula ion o physics p ocesses (such
as he wind in he sails), he equi ed compu ing powe inc eases
g ea ly and hus he isualisa ion is delayed, o he poin ha
when looking a he sails (∅: 15 FPS/67 ms - Figu e 8 bo om)
he use can clea ly pe cei e he la encies a close ange due o
he dynamic p ocess in he scene y.
4. CONCLUSION & OUTLOOK
The objec i e o his p ojec was o isualise he ou -mas ed
ba que Peking in i s s a e a ound he yea s 1927/1928 wi hin a
i ual eali y applica ion. A his poin in ime, he ship was s ill
sailing on he Hambu g-Chile ou e as a sailing ca go ship. As an
impo an pa o Hambu g's his o y, his ship ep esen s a unique
subjec o an imme si e i ual expe ience (Figu e 9 and Figu e
10). In he cou se o his p ojec , he o mula ed heo e ical
equi emen s o knowledge ans e h ough in e ac i i y we e
examined and o he mos pa success ully implemen ed. I
could hus be shown ha Vi ual Reali y is capable o enabling a
new o m o knowledge ans e . The e is po en ial o u he
op imiza ion o his applica ion wi h ega ds o allowing
in e ac ions wi h o he people, a ea u e ha was no
implemen ed in his i s e sion o he VR applica ion. Howe e ,
echnologies do exis ha allow coope a ion and communica ion
be ween se e al use s a di e en loca ions in VR and ha e
al eady been success ully es ed in o he p ojec s a Ha enCi y
Uni e si y Hambu g (Ke s en e al. 2018; Tschi schwi z e al.
2019). Rega ding in e ac i i y, i can be concluded ha VR
sys ems a e only in e ac i e o a ce ain deg ee and, impo an ly,
ha he handling o independen ly- o mula ed ques ions canno
ye be implemen ed comp ehensi ely. The VR applica ion and
he in e ac i e elemen s o knowledge ans e we e es ed by
di e en use s who a e amilia wi h he ship. The eedback o
hese use s was e y posi i e bu no documen ed by a
ques ionnai e. Howe e , a Hambu g jou nalis om he daily
newspape Hambu ge Abendbla desc ibes he i ual isi o
he Peking as a e y ealis ic expe ience wi h op ions o b oaden
one's knowledge ho izon (Ul ich 2020b).
The pe o mance o he VR sys em is s ongly dependen on he
numbe o implemen ed elemen s, in e ac ions and dynamic
componen s. Maximum ame a es o 60 FPS a e achie ed,
while in some sequences only an a e age o 15 ames pe second
is displayed. In pa icula , poin cloud isualisa ions and he
physics simula ions o he ship’s sails equi e la ge amoun s o
compu ing powe . Howe e , pe o mance op imiza ion was no a
p ima y goal in his p ojec .
Ha dwa e Minimal sys em equi e-
men s
Recommended sys em
equi emen s
Used sys em equi e-
men s
P ocesso In el
®
Co e™ i5-4590
3.3 GHz (3.7 GHz)
In el
®
Co e™ i5-4590
3.3 GHz (3.7 GHz)
In el
®
Co e™ i7-6700K
4.0 GHz (4.2 GHz)
G aphic ca d NVIDIA GeFo ce™
GTX 970
NVIDIA GeFo ce™
GTX 1070
NVIDIA GeFo ce™
GTX 1080
Memo y 4 GB 4 GB 16 GB
Ope a ing sys-
em
Windows 7 SP1,
Windows 8.1, Windows 10 Windows 10 Windows 10
Tab. 1: Minimum, ecommended and used sys em equi emen s o he HTV Vi e P o used (HTC Co po a ion 2020)
ISPRS Annals o he Pho og amme y, Remo e Sensing and Spa ial In o ma ion Sciences, Volume V-4-2020, 2020
XXIV ISPRS Cong ess (2020 edi ion)
This con ibu ion has been pee - e iewed. The double-blind pee - e iew was conduc ed on he basis o he ull pape .
h ps://doi.o g/10.5194/isp s-annals-V-4-2020-155-2020 | © Au ho s 2020. CC BY 4.0 License.
160
Fu he mo e, he e a e nume ous oppo uni ies o de eloping
he p ojec u he , such as in e ac ions, mul iple use s, se ious
games, and s o y- elling. Ano he op ion would be o allow o
he isualisa ion o be iewed in a mobile-based AR applica ion.
In his a ian , a p o agonis in VR would con ol he ac ion while
onlooke s would be able simul aneously o iew he scene y
hough would no be able o in e ene (e.g. acco ding o G oo e
Jones 2017). In summa y, he VR applica ion desc ibed he e is
an example o how i ual eali y can be used as a new means o
knowledge ans e , using in e ac i i y oge he wi h anima ion
o enhance and acili a e he lea ning expe ience. I he e o e has
an inc easingly impo an ole o play in he u u e o educa ional
media.
ACKNOWLEDGEMENTS
The au ho s would like o hank U sula Richenbe ge , di ec o o
he Ha enmuseum, o he gene al suppo o he p ojec . We
acknowledge he in o ma ion, echnical d awings and 3D CAD
model o he Peking which was p o ided by Helmu Radebold
(TECHNOLOG se ices GmbH, Hambu g), he 3D model o he
ou -mas ed ba que which was made a ailable by La s
Spiecke mann (De le Löll Ingenieu bü o GmbH, Peenemünde,
Ge many), he e es ial lase scanning da a o he Peking which
was deli e ed by he enginee ing o ice O e a h & Sand
Ve messungsbü o, Rendsbu g, and o he assis ance du ing he
pho og amme ic da a acquisi ion o he auxilia y s ee ing wheel
by D . Ral Wiechmann, Museum o Hambu g His o y.
Figu e 9. O e iew o he deck o he ou -mas ed ba que Peking in he VR applica ion
Fi
g
u e 10. The Pekin
g
isualized in he VR a
pp
lica ion wi h sails se
ISPRS Annals o he Pho og amme y, Remo e Sensing and Spa ial In o ma ion Sciences, Volume V-4-2020, 2020
XXIV ISPRS Cong ess (2020 edi ion)
This con ibu ion has been pee - e iewed. The double-blind pee - e iew was conduc ed on he basis o he ull pape .
h ps://doi.o g/10.5194/isp s-annals-V-4-2020-155-2020 | © Au ho s 2020. CC BY 4.0 License.
161
REFERENCES
Benke , S., 2001: Wissens e mi lung mi neuen Medien –
Un e suchungen am Beispiel Nied igene gie- und Sola echnik.
Disse a ion, Uni e si ä -Gesam schule Siegen,
h p://webdoc.sub.gwdg.de/ebook/diss s/Siegen/Benke 2001.pd
.
Deggim, S., Ke s en, T., Tschi schwi z, F., Hin ichsen, N., 2017:
Segebe g 1600 – Recons uc ing a His o ic Town o Vi ual
Reali y Visualisa ion as an Imme si e Expe ience. In . A ch.
Pho og amm. Remo e Sens. Spa ial In . Sci., XLII-2/W8, 87-94.
doi.o g/10.5194/isp s-a chi es-XLII-2-W8-87-20
Dö ne , R., 2013: Vi ual und Augmen ed Reali y (AR/VR)
G undlagen und Me hoden de Vi uellen und Augmen ie en
Reali ä . Sp inge -Ve lag Be lin Heidelbe g.
Epic Games, 2020: Un eal Engine 4 Documen a ion.
h ps://docs.un ealengine.com/en-US/Resou ces/Showcases/
Ma ineeFigh Scene/index.h ml, las access 10.01.2020.
F eunde de Vie mas ba k Peking e.V., 2020: Fou -Mas ed
Ba que PEKING. h ps://peking- eunde.de/en/index.php, las
access 10.01.2020.
G oo e Jones, 2017: AR + VR Mixed Reali y: Look In o VR
Wo lds Wi h an iPad.
h ps://www.g oo ejones.com/mixed_ eali y_wi h_an_ipad_and
_h c_ i e/, las access 10.01.2020.
HTC Co po a ion, 2020: Wha a e he sys em equi emen s
h ps://www. i e.com/ca/suppo / i e-p o-
hmd/ca ego y_how o/wha -a e- he-sys em- equi emen s.h ml,
las access 10.01.2020.
Issing, L., Klisma, P., 2002: In o ma ion und Le nen mi
Mul imedia und In e ne : Leh buch ü S udium und P axis.
Bel z Weinheim.
Jakobsen, T., 2001: Ad anced Cha ac e Physics. Game
de elope s con e ence, (3), IO In e ac i e, Copenhagen,
Denma k, 383-401.
Ke s en, T., Hin ichsen, N., Linds aed , M., Webe , C., Sch eye ,
K., Tschi schwi z, F., 2014: A chi ec u al His o ical 4D
Documen a ion o he Old-Segebe g Town House by
Pho og amme y, Te es ial Lase Scanning and His o ical
Analysis. P og ess in Cul u al He i age. Documen a ion,
P ese a ion, and P o ec ion. 5 h In e na ional Con e ence,
Eu oMed 2014, Limassol, Cyp us, No embe 3-8, 2014,
Ioannides, M., Magnena -Thalmann, N., Fink, E., Za nic, R.,
Yen, A.-Y., Quak, E. (Eds.), Lec u e No es in Compu e Science
(LNCS), Vol. 8740, Sp inge In e na ional Publishing
Swi ze land 2014, 35-47.
Ke s en, T., Linds aed , M., 2012a: Image-Based Low-Cos
Sys ems o Au oma ic 3D Reco ding and Modelling o
A chaeological Finds and Objec s. P og ess in Cul u al He i age
P ese a ion, Lec u e No es in Compu e Science (LNCS), Vol.
7616, Ioannides, M. e al. (eds.), Sp inge , Cham, 1-10.
Ke s en, T., Linds aed , M., 2012b: Vi ual A chi ec u al 3D
Model o he Impe ial Ca hed al (Kaise dom) o Königslu e ,
Ge many h ough Te es ial Lase Scanning. Eu oMed 2012 -
In . Con e ence on Cul u al He i age, Ioannides, M.; F i sch, D.;
Leissne , J.; Da ies, R.; Remondino, F.; Ca o, R. (Eds.), Lec u e
No es in Compu e Science (LNCS), Volume 7616, Sp inge -
Ve lag Be lin Heidelbe g, 201-210.
Ke s en, T., Tschi schwi z, F., Deggim, S., Linds aed , M., 2018:
Vi ual Reali y o Cul u al He i age Monumen s – om 3D Da a
Reco ding o Imme si e Visualisa ion. Digi al He i age -
P og ess in Cul u al He i age: Documen a ion, P ese a ion, and
P o ec ion, Pa II, Lec u e No es in Compu e Science (LNCS),
Vol. 11197, Ioannides, M. e al. (eds.), Sp inge , Cham, 74-83.
McCa ey, M., 2017: Un eal Engine VR Cookbook: De eloping
Vi ual Reali y wi h UE4. Addison-Wesley P o essional, 1s
edi ion, 288 p.
Tschi schwi z, F., Riche zhagen, C., P zybilla, H.-J., Ke s en, T.,
2019: Duisbu g 1566: T ans e ing a His o ic 3D Ci y Model
om Google Ea h in o a Vi ual Reali y Applica ion. PFG –
Jou nal o Pho og amme y, Remo e Sensing and
Geoin o ma ion Science, 87(1-2), 47-56.
Ul ich, F., 2020a: Die "Peking" wi d wiede zu G ande Dame.
Hambu ge Abendbla , 4 Janua y 2020,
h ps://www.abendbla .de/hambu g/a icle228054579/peking-
es au ie ung-schi - ach segle -ha en.h ml, las access
12.01.2020.
Ul ich, F., 2020b: Mi Vi ual-Reali y-B ille an Bo d de
"Peking" gehen. Hambu ge Abendbla , 14 Ma ch 2020,
h ps://www.abendbla .de/hambu g/a icle228694871/hambu g-
hcu- o sche - i uell- undgang-peking.h ml, las access
15.03.2020.
Walmsley, A. P., Ke s en, T., 2019: Low-cos De elopmen o
an In e ac i e, Imme si e Vi ual Reali y Expe ience o he
His o ic Ci y Model S ade 1620. In . A ch. Pho og amm. Remo e
Sens. Spa ial In . Sci., XLII-2/W17, 405-411.
doi.o g/10.5194/isp s-a chi es-XLII-2-W17-405-20.
ISPRS Annals o he Pho og amme y, Remo e Sensing and Spa ial In o ma ion Sciences, Volume V-4-2020, 2020
XXIV ISPRS Cong ess (2020 edi ion)
This con ibu ion has been pee - e iewed. The double-blind pee - e iew was conduc ed on he basis o he ull pape .
h ps://doi.o g/10.5194/isp s-annals-V-4-2020-155-2020 | © Au ho s 2020. CC BY 4.0 License.
162