scieee Science in your language
[en] (orig)

Using Object Detection on Social Media Images for Urban Bicycle Infrastructure Planning: A Case Study of Dresden

Abstract

With cities reinforcing greener ways of urban mobility, encouraging urban cycling helps to reduce the number of motorized vehicles on the streets. However, that also leads to a significant increase in the number of bicycles in urban areas, making the question of planning the cycling infrastructure an important topic. In this paper, we introduce a new method for analyzing the demand for bicycle parking facilities in urban areas based on object detection of social media images. We use a subset of the YFCC100m dataset, a collection of posts from the social media platform Flickr, and utilize a state-of-the-art object detection algorithm to detect and classify moving and parked bicycles in the city of Dresden, Germany. We were able to retrieve the vast majority of bicycles while generating few false positives and classify them as either moving or stationary. We then conducted a case study in which we compare areas with a high density of parked bicycles with the number of currently available parking spots in the same areas and identify potential locations where new bicycle parking facilities can be introduced. With the results of the case study, we show that our approach is a useful additional data source for urban bicycle infrastructure planning because it provides information that is otherwise hard to obtain.

Read accessible full text

Using Object Detection on Social Media Images for Urban Bicycle Infrastructure Planning: A Case Study of Dresden

Author: Knura, Martin Michael,Kluger, Florian,Zahtila, Moris,Schiewe, Jochen,Rosenhahn, Bodo,Burghardt, Dirk
Publisher: MDPI
DOI: 10.3390/ijgi10110733
Source: https://repos.hcu-hamburg.de/bitstream/hcu/682/1/ijgi-10-00733-v2.pdf
In e na ional Jou nal o
Geo-In o ma ion
A icle
Using Objec De ec ion on Social Media Images o U ban
Bicycle In as uc u e Planning: A Case S udy o D esden
Ma in Knu a 1,*,† , Flo ian Kluge 2,† , Mo is Zah ila 3,† , Jochen Schiewe 1, Bodo Rosenhahn 2
and Di k Bu gha d 3


Ci a ion: Knu a, M.; Kluge , F.;
Zah ila, M.; Schiewe, J.; Rosenhahn,
B.; Bu gha d , D. Using Objec
De ec ion on Social Media Images o
U ban Bicycle In as uc u e
Planning: A Case S udy o D esden.
ISPRS In . J. Geo-In . 2021,10, 733.
h ps://doi.o g/10.3390/ijgi10110733
Academic Edi o : Jean-Claude Thill,
Ran Tao, Zhaoya Gong and Wol gang
Kainz
Recei ed: 17 Sep embe 2021
Accep ed: 23 Oc obe 2021
Published: 28 Oc obe 2021
Publishe ’s No e: MDPI s ays neu al
wi h ega d o ju isdic ional claims in
published maps and ins i u ional a il-
ia ions.
Copy igh : © 2021 by he au ho s.
Licensee MDPI, Basel, Swi ze land.
This a icle is an open access a icle
dis ibu ed unde he e ms and
condi ions o he C ea i e Commons
A ibu ion (CC BY) license (h ps://
c ea i ecommons.o g/licenses/by/
4.0/).
1Lab o Geoin o ma ics and Geo isualiza ion (g2lab), Ha enCi y Uni e si y Hambu g,
Henning-Vosche au-Pla z 1, 20457 Hambu g, Ge many; jochen.schiewe@hcu-hambu g.de
2Ins i u e o In o ma ion P ocessing, Leibniz Uni e si y Hanno e , Appels . 9a, 30167 Hanno e , Ge many;
[email p o ec ed].de (F.K.); [email p o ec ed].de (B.R.)
3Ins i u e o Ca og aphy, D esden Uni e si y o Technology, Helmhol zs . 10, 01062 D esden, Ge many;
[email p o ec ed] (M.Z.); di k.bu gha [email p o ec ed] (D.B.)
*Co espondence: ma in.knu a@hcu-hambu g.de
† These au ho s con ibu ed equally o his wo k.
Abs ac :
Wi h ci ies ein o cing g eene ways o u ban mobili y, encou aging u ban cycling helps
o educe he numbe o mo o ized ehicles on he s ee s. Howe e , ha also leads o a signi ican
inc ease in he numbe o bicycles in u ban a eas, making he ques ion o planning he cycling
in as uc u e an impo an opic. In his pape , we in oduce a new me hod o analyzing he
demand o bicycle pa king acili ies in u ban a eas based on objec de ec ion o social media images.
We use a subse o he YFCC100m da ase , a collec ion o pos s om he social media pla o m Flick ,
and u ilize a s a e-o - he-a objec de ec ion algo i hm o de ec and classi y mo ing and pa ked
bicycles in he ci y o D esden, Ge many. We we e able o e ie e he as majo i y o bicycles while
gene a ing ew alse posi i es and classi y hem as ei he mo ing o s a iona y. We hen conduc ed
a case s udy in which we compa e a eas wi h a high densi y o pa ked bicycles wi h he numbe
o cu en ly a ailable pa king spo s in he same a eas and iden i y po en ial loca ions whe e new
bicycle pa king acili ies can be in oduced. Wi h he esul s o he case s udy, we show ha ou
app oach is a use ul addi ional da a sou ce o u ban bicycle in as uc u e planning because i
p o ides in o ma ion ha is o he wise ha d o ob ain.
Keywo ds:
objec de ec ion; social media; u ban planning; bicycle in as uc u e; compu e ision;
olun ee ed geog aphical in o ma ion; isual analy ics
1. In oduc ion
Today, as ci ies g ow and de elop a high-speed a es, many o hem ac i ely ein o ce
g eene ways o u ban mobili y o igh agains pollu ion, a ic jams, noise, e c. [
1
]. One
o he encou aged ways o u ban commu ing is cycling o i s bene icial e ec on bo h he
en i onmen and pe sonal heal h [
2
]. While his s a egy helps o educe he numbe o
mo o ized ehicles on s ee s, i also leads o a signi ican inc ease in he numbe o bicycles
in u ban a eas, which aises he impo ance o bicycle in as uc u e planning as a opic.
Ci ies usually pay a en ion o p o iding a la ge numbe o bicycle pa king a popula
loca ions such as ain s a ions, shopping malls and highly equen ed squa es; howe e ,
nume ous bicycles a e o en andomly pa ked in he su ounding a eas whe e he e a e
ewe bicycle acks a ailable [
3
]. Acco dingly, planning he cycling in as uc u e is an
impo an opic o bo h u ban planne s and cyclis s.
T adi ional me hods o collec ing ield da a in u ban planning a e spo obse a ions
and su eys. Spo obse a ions a e usually conduc ed by coun ing objec s (e.g., passenge s,
bicycles, e c.) a u ban loca ions o in e es . This me hod is esou ce-consuming ega ding
ime and s a , so he collec ed da a usually do no co e longe ime in e als. In con as ,
ISPRS In . J. Geo-In . 2021,10, 733. h ps://doi.o g/10.3390/ijgi10110733 h ps://www.mdpi.com/jou nal/ijgi
ISPRS In . J. Geo-In . 2021,10, 733 2 o 25
conduc ing su eys usually implies ec ui ing passenge s and asking hem o answe a
ques ionnai e, which makes i di icul o collec a high numbe o answe s and in oduces
a bias owa ds ci izens who ha e a posi i e gene al a i ude owa ds pa icipa ion in a
su ey. In bo h cases, spo obse a ions and su eys, he e is a clea gap ha conce ns
he a ailabili y o he da a a ailable o u ban planne s, and hus also o planning he
bicycle in as uc u e.
To ackle he opic o cycling in ci ies and imp o e he quali y o in o ma ion ha u ban
planne s use o making decisions ela ed o spa ial in es men s, esea che s la gely u ned
o newly a ailable sou ces o da a. The majo i y o his esea ch ocuses on analyzing he
da a om bicycle-sha ing sys ems (BSS). The ela ed da a sou ces a e mainly he pooling
s a ions, which allow analyses based on he numbe s o a ailable bicycles and ee pa king
spo s a BSS s a ions [
4
] o check-ins and check-ou s on BSS s a ions [
5
–
7
]. While being
aluable o he logis ics o he BSSs, hese numbe s do no necessa ily gi e insigh s use ul
o planning he in as uc u e o ci izens who commu e by using p i a ely owned bicycles.
Planning o pa king acili ies o bicycles ha do no belong o he BSS is he e o e no
easible wi h hese da a alone. Ano he inexpensi e me hod o da a collec ion is GPS
acking o idden bicycles (e.g., ia sma phone), which is, howe e , mo e sui able o
analyzing ail pa e ns [
8
]. Some esea ch ela ed o u ban planning also analyzed he
mobile-phone da a gene a ed by mobile ne wo ks [
9
]. While collec ing elecommunica ions
ac i i y can p o ide an ex ensi e da ase , i does no di e en ia e bicycle use s om
o he passenge s.
In his pape , we add ess he gap in da a collec ion o u ban planning by ocusing on
social media da a. Because o he con inuous inc ease in he numbe s o sma phone owne s
and social media use s, we iden i y ano he oppo uni y o collec he needed bicycle-
ela ed da a and de elop a no el me hod o analyzing he demand o bicycle pa king
in as uc u e in u ban a eas. We p opose o use his me hod alongside o he s es ablished
in u ban planning in o de o en ich he da a co e age and p o ide mo e comp ehensi e
in o ma ion o making decisions ela ed o u ban in as uc u e in es men s, e.g., bicycle
pa king. We s a in Sec ion 2wi h he hypo hesis ha social media pos s can be use ul
o analyzing loca ions in ci ies in ela ion o bicycle usage. Sec ion 3in oduces ou
me hod and da a used o de ec bicycles on pho os om social media pos s, and
Sec ion 4
p esen s he p elimina y esul s o he bicycle de ec ion p ocess. Wi hin ou case s udy in
Sec ion 5
, we show ha ou da a p ocessing can p o ide subs an ial alue o planning
bicycle pa king acili ies in he ci y o D esden and discuss ad an ages and d awbacks o
ou app oach in Sec ion 6be o e concluding in Sec ion 7.
2. Rela ed Wo k
Fo he mos e ec i e p omo ion o cycling in a ci y, planning bicycle in as uc u e
should be demand-d i en, and so u ban planne s need o know he main cha ac e is ics
o he bicycle a ic lows in hei ci y [
10
]. Al hough he e is an inc easing in e es in
bicycles as pa o mul i-modal u ban in as uc u e, bicycle- ela ed esea ch in ecen
yea s ocused mainly on aspec s such as bicycle sa e y [
11
], posi i e impac s o cycling on
public heal h [
12
], a el mode choice [
13
] and ou e choice analysis [
10
,
14
]. By con as ,
less a en ion is paid o a ic enginee ing opics such as a ic coun s, a el imes, and
capaci ies [15].
In gene al, bicycle a ic olume da a a e ha d o ob ain. As opposed o mo o ized
a ic, bicycle a ic olume is s ongly a ec ed by he p esence and quali ies o bicycle
in as uc u e, ele a ion, mo o ized ehicles, wea he condi ions, e c. [
16
]. His o ically, e-
sea ch on cycling ac i i y elied on indi idual-le el su eys on household a el—me hods
ha a e esou ce in ensi e and can p oduce s a is ically un ep esen a i e samples dis-
o ing he indings o he quali a i e analysis [
17
]. Mode n me hods o bicycle a ic
es ima ion all in o wo ca ego ies: long- e m coun e s ha un con inuously, and sho -
e m measu emen s o ypically 1 o 28 days. To de i e obus demands based on sho e
obse a ion pe iods, he alues can be mul iplied by scaling ac o s and ac o g oups
ISPRS In . J. Geo-In . 2021,10, 733 3 o 25
accoun ing o daily, weekly and seasonal bicycle olume a iance gained h ough he
con inuous measu emen s [18].
In p ac ice, he ac ual coun ing and acing o bicycles can be execu ed using di e en
da a collec ion me hods, which should ollow quali y assu ance p ocedu es [
19
]. These
me hods include:
• Use o s a iona y senso s o coun passing bicycles,
• Analysis o public su eillance ideos h ough objec de ec ion,
• GPS- acking h ough de ices used by cyclis s,
• T acking o GPS de ices di ec ly moun ed on bicycles.
Adap ing adi ional me hods o mo o ehicle a ic moni o ing, nume ous echnical
solu ions and comme cial p oduc s o coun cyclis s wi h s a iona y senso s a e a ailable.
Fo example, e . [
20
] used da a om pneuma ic ubes on s ee s and adio beams on cycle
pa hs o hei s udy, while he da a o [
18
] we e ob ained om induc i e loop coun e s.
Simila o senso s, he isual de ec ion o bicycles using s a iona y came as is adap ing
well-es ablished echniques, in his case om compu e ision [
15
,
21
], and can p o ide
ehicle de ec ion, classi ica ion, coun ing and speed measu emen s in eal- ime [22].
In con as o s a iona y senso s o came as, GPS acking de ices a e capable o
collec ing da a om a comple e jou ney and can be di ided in o wo ca ego ies, depending
on he me hod o ob aining he da a. Fi s , he GPS da a can be ob ained h ough a de ice
used by he cyclis s, e.g., a sma phone applica ion. These da a a e no mally sha ed om
olun ee s ei he o scien i ic esea ch [
10
,
23
], o o comme cial use h ough mobile apps
such as S a a [
11
]. Second, he acking de ice can be di ec ly moun ed on o he bicycle.
Dockless BSS p o ides eal- ime GPS da a o e e y bicycle, which p o ides de ailed
insigh s in o bicycle-sha ing use s’ empo al and spa ial mobili y pa e ns [
24
,
25
]. Fo
example, e . [16] used GPS da a o BSS p o ided by he company Wa elo.
S a iona y senso s, a ic su eillance came as and GPS acking de ices di e no
only in he me hod o ob aining in o ma ion bu also in he cha ac e is ics o he da a
hey p o ide, namely he gained spa ial in o ma ion, he co e age o a ge g oups and
he su eyed bicycle s a e. In gene al, s a iona y senso s ha e he ad an age o co e ing
e e y single passing bicycle, while hey a e ixed o a de ined loca ion and he e o e only
p o ide poin - ela ed da a o mo ing bicycles. Visual analysis o a ic ideos can iden i y
mo ing and pa ked bicycles wi hin he ame and is able o gene a e ajec o y da a wi hin
he co e ed a ea when cyclis s a e acked o e consecu i e ames. While bo h ypes
o GPS acking de ices p o ide ajec o y da a o he whole ip, a majo disad an age
o his da a collec ion me hod is he c ea ion o biased “ olun a y esponse samples”,
because i only includes da a o people who ha e chosen o olun ee [
26
]. Fu he mo e,
as he acking de ice is no moun ed on o he bicycle, he s a us and posi ion o he
bicycle while he bicyclis is no using he bicycle is unknown. In con as , he s a us and
posi ion o in eg a ed GPS de ices can cons an ly be measu ed, which allows de ec ing he
loca ion whe e he bicycle is pa ked. Howe e , unlike in Asia, u ban mobili y planning
policies in Eu ope ocus on p i a e bicycle use [
27
], and public bicycles om BSS a e mo e
equen ly used o i s - and las -mile connec ion and leisu e ac i i ies and less equen ly
o commu ing [24,28].
As shown abo e, ob aining da a on pa ked bicycles is s ill challenging. In o ma ion
e ie al using social media da a can be a complemen a y way o da a collec ion. Social
media usage is widesp ead geog aphically as well as empo ally and has become a na -
u al pa o people’s daily li es. As a consequence, da a a e gene a ed implici ly by he
use s, p o iding an “in- he-wild sensing” o he ci y wi hou es ic ions o labo a o y
en i onmen s [29].
Social media pos s usually con ain ex and ime in o ma ion, wi h
po en ially mo e isual (images, ideos) and spa ial da a a ached, which allows loca ion
ex ac ion [30,31].
While he e a e se e al app oaches o ecognize low-le el (e.g., walking, si ing, e c.)
and high-le el (e.g., ea ing, shopping, e c.) ac i i ies mainly based on di e en sou ces
o social media da a [
32
,
33
], we wan o ex ac bicycle- ela ed in o ma ion solely using
ISPRS In . J. Geo-In . 2021,10, 733 4 o 25
images om social media pos s. Rega ding he iden i ied da a cha ac e is ics o bicycle-
ela ed measu es s a ed abo e, his has wo ad an ages. Fi s , using images om social
media po en ially allows us o co e he whole a ea o he ci y, depending on he equency
o pos s, and ob ain in o ma ion on a la ge a ie y o bicycle usage. Second, we can
dis inguish be ween mo ing and pa ked bicycles using simila objec de ec ion me hods as
implemen ed o s a iona y a ic su eillance ideos.
3. Me hod
Ou app oach o coun ing bicycles in images om social media pos s consis s o wo
s eps. Fi s , we applied a s a e-o - he-a objec de ec ion algo i hm (Sec ion 3.2) in o de o
de ec and localize bicycles and pe sons in each image. Using he de ec ed pe sons, we hen
classi ied each de ec ed bicycle as ei he mo ing o s a iona y (Sec ion 3.2.1). Fo e alua ion
(Sec ion 3.3) and pa ame e selec ion (Sec ion 3.4), we u he mo e labeled an app op ia e
da ase (Sec ion 3.1).
3.1. Da ase
In o de o quan i a i ely e alua e he easibili y o using social media da a o bicycle
a ic analysis, we used he YFCC100m [
34
] da ase because i is one o he la ges open-
sou ce da ase s o i s kind wi h a collec ion o 100 million pos s om he social media si e
Flick . Each pos con ains an image o ideo as well as addi ional in o ma ion, such as
loca ion, ime o cap u e and ags. All images we e aken in he yea s be ween 2004 and
2014 and a e sca e ed ac oss he whole wo ld. As we a e mainly in e es ed in da a om
u ban a eas, we selec ed a subse o images aken in a single ci y. This subse con ains
30,922 images
wi h loca ion me ada a indica ing ha hey we e eco ded in he ci y o
D esden, Ge many.
3.1.1. Bicycle Anno a ions
We manually anno a ed all bicycles in he subse o images. Each bicycle is labeled
wi h a bounding box and assigned one o wo ca ego ies: s a iona y i he bicycle is cu en ly
pa ked, o mo ing i i is being idden, wheeled o o he wise in use. O he 30,922 images,
2219
(
7.2%
)
con ain a leas one bicycle, wi h 1457
(
4.7%
)
images con aining s a iona y
bicycles and 976
(
3.2%
)
images con aining mo ing bicycles. As Figu e 1shows, mos
images (1204, 54.3%) con ain exac ly one bicycle. Howe e , images wi h signi ican ly la ge
numbe s o bicycles occu as well, e.g., 100 images (4.5%) depic mo e han six bicycles. In
o al, we labeled 4913 bicycles, o which 3038 (61.8%)a e s a iona y and 1875 (38.2%)a e
mo ing. Figu e 2shows a ew examples.
Figu e 1.
This his og am shows he numbe s o images in he D esden subse o he YFCC100m
da ase con aining be ween one and six, and mo e han six bicycles.
ISPRS In . J. Geo-In . 2021,10, 733 5 o 25
Figu e 2.
Examples om ou anno a ed D esden subse o he YFCC100m da ase . We manually
labeled bo h mo ing (yellow boxes) and s a iona y (cyan boxes) bicycles.
3.2. Objec De ec ion
In o de o au oma ically and eliably coun he numbe o mo ing and s a iona y
bicycles in an image, we u ilized a s a e-o - he-a objec de ec ion algo i hm. The ask
o objec de ec ion comp ises localiza ion o objec s in he image, usually by es ima ing
he coo dina es o bounding boxes aming he objec s, as well as classi ying each objec
using a se o p ede ined ca ego ies. Nume ous app oaches o objec de ec ion ha e been
p esen ed in ecen yea s [
35
–
39
]. They all use con olu ional neu al ne wo ks (CNNs) and
a e ained on he la ge-scale COCO (Common Objec s in Con ex ) [
40
] da ase . COCO
con ains mo e han 200,000 images labeled wi h objec bounding boxes o 80 di e en
ca ego ies such as ca , bicycle, pe son, couch, o ange, e c. Fo all expe imen s in his
wo k, we used he ecen ly p esen ed E icien De [
35
] objec de ec ion algo i hm, which
has been p e- ained on he COCO da ase , as i p o ides s a e-o - he-a pe o mance.
Compa ed o he p e ious bes me hod [
41
], E icien De achie es a signi ican ly highe
mean a e age p ecision (mAP) on he challenging COCO da ase (54.4% s. 50.7%) while
being compu a ionally mo e e icien . Compu ing objec de ec ions o one image on an
N idia Ti an V GPU akes 285 ms wi h E icien De , while [
41
] equi es 489 ms, i.e., almos
wice as long.
Gi en an image
I
, he objec de ec ion algo i hm compu es a se
P
o objec p oposals
Pi= (bi
,
ci
,
si)∈ P
. Each objec p oposal is de ined by a bounding box ( ec angle)
bi
wi h
image coo dina es
[xi,1
,
yi,1
,
xi,2
,
yi,2]
, an objec class
c
(e.g., bicycle), and a con idence sco e,
s
which can be loosely in e p e ed as an es ima e o he likelihood ha he objec p oposal
is co ec . In p ac ice, objec p oposals ha ha e a con idence sco e below a h eshold
θs
a e
disca ded. This h eshold mus be chosen app op ia ely in o de o minimize he numbe
o alse de ec ions while maximizing he numbe o co ec de ec ions.
In he ollowing, we a e only in e es ed in bicycle de ec ions
Pb∈ Pb⊆ P
and pe son
de ec ions Pp∈ Pp⊆ P, wi h Pb∩ Pp=∅:
∀Pi∈ P :(ci=bicycle ⇔Pi∈ Pb)
∧(ci=pe son ⇔Pi∈ Pp).(1)
3.2.1. Mo ing Bicycles
In o de o di e en ia e be ween mo ing and s a iona y bicycles, we le e age he
abili y o he objec de ec o o localize people in addi ion o bicycles. We assume ha

ISPRS In . J. Geo-In . 2021,10, 733 6 o 25
i a bicycle is loca ed igh below a pe son o igh nex o a pe son, his bicycle is being
handled by ha pe son and is hus non-s a iona y o mo ing. In ha case, he cen e o he
bounding box o a de ec ed pe son
Pp
mus be loca ed abo e he bounding box cen e o
bicycle Pb. We desc ibe his ela ion ia he ollowing indica o unc ion:
χ(Pb,Pp) = (1 i yp,1 +yp,2 >yb,1 +yb,2 ,
0 else. (2)
Since a pe son mus be loca ed in e y close p oximi y o a mo ing bicycle, we assume
a minimal o e lap o hei espec i e bounding boxes. We measu ed his o e lap using he
in e sec ion-o e -union (IoU) me ic, which compu es he a io o he o e lapping a ea o
he bounding boxes o hei uni ied a ea:
IoU(Pb,Pp) = A(bb∩bp)
A(bb∪bp)∈[0,1]. (3)
Fo e e y bicycle de ec ion
Pb∈ Pb
and e e y pe son de ec ion
Pp∈ Pp
, we de ine
an o e lap ma ix Cwi h:
Cbp =χ(Pb,Pp)·IoU(Pb,Pp). (4)
Using he Hunga ian me hod [
42
], we ind a maximum o e lap assignmen
H
based
on
C
. I a bicycle
Pb
is assigned o a pe son
Pp
wi h
Cbp >θp
, we de ine he bicycle as
mo ing and as s a iona y o he wise:
∀Pi∈ Pb:((∃Pj∈ Pp([i,j]∈ H ∧ Cij >θp)) ⇔Pi∈ Pbm)
∧(Pi/∈ Pbm ⇔Pi∈ Pbs),(5)
wi h
Pbm
and
Pbs
deno ing he se s o mo ing and s a iona y bicycle de ec ions, espec-
i ely. Figu e 3shows a ew examples o bicycles ha ha e been classi ied as s a iona y o
mo ing using his p ocedu e. We deno e he maximum assigned o e lap wi h a pe son o
a bicycle de ec ion Pbas Cb=maxpCbp.
Figu e 3.
Examples o co ec ly iden i ied s a iona y ( op, cyan boxes) and mo ing (bo om, yellow
boxes) bicycles, wi h all de ec ed pe sons ma ked in magen a boxes.
ISPRS In . J. Geo-In . 2021,10, 733 7 o 25
3.3. E alua ing De ec ions
In o de o e alua e he bicycle de ec ion me hod and o op imize i s pa ame e s, we
compa ed he p oposed bicycle de ec ions wi h he g ound u h anno a ions (c .
Sec ion 3.1.1
).
Gi en g ound u h anno a ions
Ti= ( ˆ
bi
,
ˆ
ci
,
ˆ
si)∈ T
and p oposed de ec ions
Pi∈ P
o
he same image, we de ine an o e lap ma ix Dwi h:
Dij =IoU(Pi,Tj)∀Pi∈ P,Tj∈ T . (6)
We ind a maximum o e lap assignmen based on
D
using he Hunga ian me hod [
42
].
I a p edic ion
Pi
is assigned o an anno a ion
Tj
wi h
Dij >θIoU
and same objec class
ci=ˆ
cj
, we ega d i as a ue posi i e
Pi∈ P p
. O he wise, i is a alse posi i e
Pi∈ P p
.
Likewise, i an anno a ion
Tj
is no assigned o a p edic ion, i coun s as a alse nega i e
Tj∈ T n
. As localiza ion accu acy is o li le ele ance o ou applica ion—we only
need o know he numbe o bicycles in an image—we se he IoU h eshold ela i ely
low, i.e.,
θIoU =
0.1. A e assigning p edic ions and anno a ions o each image, we can
compu e p ecision and ecall o e all images in o de o asses he quali y o he p edic ions.
P ecision is de ined as he a io o he numbe o co ec ly de ec ed objec s ( ue posi i es)
o he numbe o all de ec ions ( ue posi i es and alse posi i es):
p ecision =|P p|
|P| =|P p|
|P p|+|P p|. (7)
Recall is he a io o he numbe o co ec ly de ec ed objec s ( ue posi i es) o he
numbe o all p esen objec s ( ue posi i es and alse nega i es), i.e., all anno a ed objec s:
ecall =|P p|
|T | =|P p|
|P p|+|T n|. (8)
We pu posely do no use he mean a e age p ecision me ic (mAP, c . Sec ion 3.2) com-
monly u ilized in objec de ec ion li e a u e o e alua ion wi h he COCO
da ase [35,41].
The mAP me ic compu es he mean o he a ea unde he p ecision- ecall cu e o e a
ange o
θIoU ∈[
0.5,0.95
]
. While his me ic is well sui ed o compa ing he pe o mance
o objec de ec ion algo i hms independen o con idence h eshold
θs
and pa ially inde-
penden o IoU h eshold
θIoU
, i does no p o ide in o ma ion abou he accu acy o an
algo i hm in a p ac ical se ing, whe e hese h esholds mus be se o a speci ic alue.
3.4. De e mining Th esholds
We empi ically de e mine a con idence h eshold
θs
and a pe son assignmen h eshold
θpin o de o s ike an op imal balance be ween p ecision and ecall.
3.4.1. Con idence Th eshold
We adjus p ecision and ecall o all bicycle de ec ions—bo h mo ing and s a iona y—
by changing he con idence h eshold
θs
. We compu e ecall and p ecision o all alues o
θs∈[
0,1
]
and show he esul s in Figu e 4. The i s g aph in Figu e 4shows co esponding
ecall and p ecision alues, and he second and hi d g aphs show ecall and p ecision
alues co esponding o di e en h eshold alues. We iden i y a poin on he ecall-
p ecision cu e which is as close o he op- igh co ne as possible, i.e., maximizing bo h
p ecision and ecall. This poin co esponds o a h eshold o oughly
θs=
0.4, esul ing in
a p ecision o 0.96 and ecall o 0.81.
ISPRS In . J. Geo-In . 2021,10, 733 8 o 25
Figu e 4.
P ecision and ecall o bicycle de ec ions in ela ion o he con idence h eshold
θs
: he i s
g aph shows he ecall–p ecision cu e, while he second and hi d g aphs ep esen he ela ionships
o ecall and p ecision o he con idence h eshold sepa a ely.
3.4.2. Pe son Assignmen Th eshold
In o de o de e mine an op imal pe son assignmen h eshold
θp
, we conside ed all
ue posi i e bicycle de ec ions
Pb∈ P p
and hei assigned maximum pe son o e lap
Cb
.
Fo all h esholds
θp∈[
0,1
]
, we compu ed he ac ion o de ec ions ha a e co ec ly
classi ied as ei he mo ing o s a iona y. As Figu e 5shows, his classi ica ion accu acy
peaks a oughly 89.5%. We hus se he pe son assignmen h eshold o he co esponding
alue o θp=0.15.
Figu e 5.
Mo ing s. s a iona y: we plo he classi ica ion accu acy o a ange o pe son assignmen
h esholds θpin o de o iden i y an op imal alue.
4. Bicycle De ec ion Resul s
4.1. De ec ion Accu acy
In o de o assess he o e all accu acy o ou app oach, we compa e ou bicycle
de ec ions wi h he g ound u h bicycle anno a ions om ou da ase (c . Sec ion 3.1). As
he con usion ma ix in Table 1shows, we de ec ed a o al o 4157 bicycles in D esden, om
which 1589 we e classi ied as mo ing and 2568 as s a iona y. O hese 4157 de ec ions, only
160 we e inco ec , esul ing in a alse disco e y a e o 3.85% and equi alen ly a p ecision
o 96.1%. We co ec ly iden i ied 3997 o he 4913 bicycles in he da ase , hus achie ing a
ecall o 81.4%. This means ha we ha e adjus ed ou bicycle de ec ion me hod o ope a e
a he cau iously, i.e., he numbe o alse posi i es is signi ican ly lowe han he numbe
o alse nega i es. The as majo i y o alse nega i es can be di ided in o h ee ca ego ies:
small (i.e., low esolu ion) bicycles, pa ly occluded bicycles, and unusual pe spec i es.
Figu e 6shows one example image o each ca ego y. In such cases, he bicycles may be
di icul o ecognize e en o a human anno a o .
ISPRS In . J. Geo-In . 2021,10, 733 9 o 25
Table 1.
This con usion ma ix shows he numbe o bicycles o ce ain g ound u h classes ( ows)
being classi ied in o es ima ed classes (columns) by ou me hod. The
∑
-en ies indica e column- and
ow-wise sums. None indica es ei he no bicycle p esen o no co esponding bicycle de ec ed and
we e omi ed om he o e all sums.
T ue
Es ima ed Mo ing S a iona y None ∑
mo ing 1368 226 281 1875
s a iona y 194 2209 635 3038
none 27 133 - (160)
∑1589 2568 (916) 4157
4913
Figu e 6.
Mos common cases o alse nega i es, i.e., uniden i ied bicycles, om le o igh : small size o un a o able
ligh ing condi ions, pa ial occlusions, unusual pose o bicycle o came a.
The smalle numbe o alse posi i es all in o he ollowing ou ca ego ies: pa s o
comple e bicycles (i.e., possibly duplica es), o he wheeled objec s (such as mo o cycles,
wheelchai s o baby s olle s), a ic signs wi h bicycle pic og ams, and miscellaneous. We
p esen one example o each kind in Figu e 7.
Figu e 7.
Mos common cases o alse posi i es, i.e., w ongly de ec ed bicycles, om le o igh : smalle pa s o comple e
bicycles; o he wheeled objec s such as baby s olle s, wheelchai s and mo o cycles; a ic signs wi h bicycle pic og ams;
miscellaneous objec s such as musical ins umen s, chai s and came a ipods.
Wi hin he se o co ec ly iden i ied bicycles, we classi y mos o he mo ing bicycles
(1368 o 1594, 85.8%) and mos o he s a iona y bicycles (2209 o 2403, 91.9%) co ec ly.
False classi ica ions as mo ing mos commonly occu when a pe son is coinciden ally
loca ed in close p oximi y o a s a iona y bicycle, o when such a pe son is alsely de ec ed.
False classi ica ions as s a iona y occu when he o e lap be ween he bicycle and pe son
de ec ions is oo small, when he pe son was no de ec ed a all, o when he bicycle is
mo ing wi hou a pe son (e.g., moun ed on a ca ). We p o ide one example o each case
in Figu e 8.
ISPRS In . J. Geo-In . 2021,10, 733 16 o 25
5.2. Numbe o Pa ked Bicycles
NPB
s. Pe cen age o Pho os Con aining Pa ked Bicycles
PPB
s.
Numbe o A ailable Pa king Spo s NPS
A e iden i ying o which combina ions o
NPB
and
PPB
o e laps exis and whe e,
we u he analyze he o e laps in ela ion o he numbe o bicycle pa king spo s
NPS
(da a
downloaded om Open S ee Map ia he O e pass API. h ps://o e pass- u bo.eu/,
accessed on 5 June 2021) in o de o de ec loca ions o a po en ial pa king space de ici . Fo his
pu pose, we i s classi y g id cells in o h ee ca ego ies: (I) Cells con ain su icien pa king
capaci y; (II) Cells pa ially con ain pa king capaci y; (III) Cells con ain no pa king capaci y; and
one subca ego y: (a) Cells ha e close access o he neighbo ing cell’s pa king capaci y.
We classi y each cell in o one o he h ee ca ego ies o pa king capaci y based on he
ela ion o
NPB
and
NPS
o ha cell (Table 4). As
NPB
and
NPS
a e quan ized in o se s
o alue anges, we conside he uppe bounds o each pa king acili y. Fo example, i
NPS
is in he ange o 12 o 37, we assume
NPS =
37. I he uppe bound o
NPS
equals o
exceeds he uppe bound o
NPB
in he analyzed cell, hen we assume ha he cell con ains
su icien pa king capaci y (I). I he uppe bound o
NPS
is lowe han he uppe bound o
NPB
o a cell, we conside ha he cell pa ially includes pa king capaci y (II). O he wise,
we assume ha he cell con ains no pa king capaci y (III). Fo example, he e a e h ee
cells wi h
PPB
o 18.01 o 35.0% con aining 36 o 65 pa ked bicycles
NPB
. Two ou o h ee
cells do no con ain any pa king (
NPS =
0), and one con ains wo pa king acili ies: one o
capaci y up o 12 bicycles and he o he o capaci y 12 o 37 bicycles (Figu e 13). Since he
uppe bound o
NPS
is 49, i does no each he uppe bound o
NPB
o 65; in his manne ,
we conside he cell is pa ially p o ided wi h pa king capaci y.
Figu e 13.
Example o isual analysis o bicycle pa king capaci y in D esden by o e lapping 100
×
100 m g id cells o he NPB (g ay) and PPB (hashed) laye s in QGIS ( e sion 3.16).
Conside ing ha we implemen ed he abo e ca ego iza ion o iden i y how c i ical
he condi ion wi hin he cell ega ding he lack o pa king spo s gene ally is, we also
in oduced he subca ego y a o he cells ha ha e close access o he neighbo ing cell
pa king capaci y. The mo i a ion o his is he ac ha we we e able o iden i y cases
whe e he cell belonged o a ca ego y II o III bu pa king o he neighbo ing cell was
loca ed a he exac bo de be ween i s na i e cell and he analyzed cell. The e o e, he
subca ego y se es us o decide whe he he cell we analyze is less c i ical because he
pa king can be easily eached ou side he cell. Fo example, he e a e i e cells wi h a
PPB
o 8.1 o 18.0% con aining 36 o 65 de ec ions o pa ked bicycles
NPB
. Two ou o i e
cells con ain a su icien numbe o pa king spo s and h ee a e pa ially co e ed wi h

ISPRS In . J. Geo-In . 2021,10, 733 17 o 25
pa king capaci y. Howe e , wo ou o he h ee cells ha a e pa ially co e ed wi h pa king
capaci y allow easy access o he neighbo ing cell’s pa king. We conclude ha , e en hough
he whole ca ego y is o high ele ance, i is ai ly well co e ed wi h pa king acili ies
and, consequen ly, does no equi e immedia e a en ion. The esul s o he analysis a e
p esen ed in Tables 4and 5.
Table 4.
Numbe o 100
×
100 m g id cells ha : con ain su icien pa king capaci y (I); a e pa ially co e ed wi h pa king
capaci y (II); a e pa ially co e ed wi h pa king capaci y bu some cells ha e close access o he neighbo ing cell’s pa king
capaci y (IIa); con ain no pa king capaci y (III); o con ain no pa king capaci y bu some cells ha e close access o he
neighbo ing cell’s pa king capaci y (IIIa). Shades o g ay addi ionally show ele ances assigned in Table 2.
NPB
PPB [%] 0.1–3.0 3.1–8.0 8.1–18.0 18.1–35.0
1–3 / / / /
4–8
I: 30/61
II: 0/61
III: 31/61; IIIa: 6/31
I: 14/31
II: 0/31
III: 17/31; IIIa: 1/17
/ /
9–18
I: 3/8
II: 1/8
III: 4/8; IIIa: 2/4
I: 15/29
II: 2/29
III: 12/29; IIIa: 1/12
I: 1/7
II: 2/7
III: 4/7; IIIa: 2/4
/
19–35 / /
I: 6/17
II: 4/17; IIa: 1/4
III: 7/17; IIIa: 3/7
I: 0/1
II: 0/1
III: 1/1; IIIa: 1/1
36–65 /
I: 0/1
II: 0/1
III: 1/1; IIIa: 1/1
I: 2/5
II: 3/5; IIa: 2/3
III: 0/5
I: 0/3
II: 1/3
III: 2/3
Table 5.
Final designa ion o impo ance o 100
×
100 m g id cells in D esden (ma ked in shades o ed): low ( ed 10%),
mode a e ( ed 35%), and high impo ance ( ed 55%). The designa ion o impo ance is based on de ec ed su iciency o
pa king spo s ( his able) and assigned ele ance (Table 2).
NPB
PPB [%] 0.1–3.0 3.1–8.0 8.1–18.0 18.1–35.0
1–3 / / / /
4–8
Mode a ely insu icien
o insu icien numbe
o pa king spo s
Insu icien numbe o
pa king spo s / /
9–18
Mode a ely insu icien
numbe o pa king
spo s
Insu icien numbe o
pa king spo s
Mode a ely insu icien
o insu icien numbe
o pa king spo s
/
19–35 / /
Mode a ely insu icien
o insu icien numbe
o pa king spo s
Mode a ely insu icien o
insu icien numbe o
pa king spo s
36–65 /
Mode a ely insu icien
o insu icien numbe
o pa king spo s
Mode a ely insu icien
numbe o pa king
spo s
Insu icien numbe o
pa king spo s
5.3. Summa y o Resul s
Based on he in o ma ion gained om he p e ious s eps, we we e able o classi y
u ban a eas acco ding o he pa king su iciency in o a eas wi h mode a ely insu icien ,
mode a ely insu icien o insu icien o insu icien numbe o pa king spo s. Wi h his
app oach, we a e able o iden i y he mos c i ical a eas in D esden ela ing o bicycle
pa king. In Table 5we p esen he esul s o each combina ion o
NPB
and
PPB
: o each
cell, we epo he su iciency o pa king spo s and ma k in shades o ed whe he he a ea
inally has a low, mode a e, o high impo ance. By compa ing Tables 3and 4, we assess ha
he a eas a ound he cen al ain s a ion and he cen e o Al s ad a e he mos c i ical
in D esden. Fo emos , wi hin hese loca ions, he e is less han 50% o Ca ego y I cells
o he o e all cell numbe , while he numbe o Ca ego y III cells exceeds 50% o i e
ISPRS In . J. Geo-In . 2021,10, 733 18 o 25
ou o six ca ego ies. The e o e, we iden i y ha hese cells possess an insu icien o
mode a ely insu icien o insu icien numbe o pa king spo s. Second, we conside he
Flick da a ela ed o hese loca ions ele an because a signi ican pe cen age o pos ed
pho os con ains de ec ions o pa ked bicycles (up o 35%). Thi d, he e is a high numbe o
pa ked bicycle de ec ions in hese pho os (up o 65). Finally, we p e iously classi ied hose
cells as cells wi h high ele ance, which adds o he impo ance o esul s. We conclude ha
hese loca ions quali y as a p io i y o be u he inspec ed by u ban planne s in D esden
using o he a ailable da a sou ces. Following he same app oach, i is equally possible o
classi y each g id cell o a mo e de ailed o e iew, which we skip o his pape .
Alongside, we iden i y ha some a eas also appea c i ical acco ding o he numbe o
bicycle pa king spo s, bu due o he low pe cen age o pho os con aining pa ked bicycle
de ec ion, we classi y hem in o low ele ance cells. Subsequen ly, we conside hem much
less c i ical, and, inally, assign hem low impo ance. Needless o say, his does no mean
ha hose cells canno be inspec ed u he a e he mo e c i ical loca ions ha e been
esol ed.
Ou esul s also show ha some cells con ain signi ican ly mo e han enough pa king
capaci y ha i appea s o be in demand (Figu e 14). We de ec six cells o ha ype and
sugges hem as loca ions ha could be u he inspec ed o gain insigh s ha could p o e
use ul o imp o ing u u e decisions ela ed o he planning o he bicycle pa king.
Figu e 14.
Example o a isually iden i ied 100
×
100 m g id cell (le ) ha con ains signi ican ly mo e
han enough bicycle pa king capaci y ha i appea s o be in demand. The e a e se en pa king a eas
o capaci y up o 12 bicycles, while he e a e only 4 o 8 bicycles de ec ed inside he cell (NPB).
We also obse ed ha social media da a p o ide mo e da a o some a eas and ba ely
any o some o he s. Tha indica es ha mo e popula loca ions o e mo e ele an bicycle-
ela ed da a, while unpopula a eas emain poo ly co e ed. This popula i y ela es o he
popula i y wi hin he used Flick da ase . Fo example, he pa o he Regie ungs ie el
dis ic ha is su ounded by he s ee s Albe s aße, Wiga ds aße, and Glaciss aße
demons a es a signi ican numbe o a ailable bicycle pa king spo s; howe e , we did no
de ec any pa ked bicycles he e. Conside ing he numbe o pa king spo s, we conclude
ha he a ea is egula ly equen ed by cyclis s bu no in e es ing enough o pos ing i
on Flick . The bicycle pa king acks he e a e ins alled a ound a ca pa king a ea, se e al
esiden ial buildings, schools, and ins i u ions, such as he Saxon S a e Minis y o Jus ice.
The same e ec is also isible, e.g., along he Holbeins aße and Ta zbe g s ee s in he
Johanns ad dis ic whe e he acks a e ins alled in on o esiden ial buildings, an
ISPRS In . J. Geo-In . 2021,10, 733 19 o 25
a hle ic acili y, esea ch ins i u es, and a ci y’s communal se ice company. Acco ding
o a signi ican numbe o ins alled acks, i is appa en ha hese loca ions a e also well
equen ed by cyclis s bu a ely pos ed on social media, such as Flick .
In his chap e , we p esen ed an analysis o he u ban space o D esden. We demon-
s a ed he way social media da a can be used o gain in o ma ion ela ed o he bicycle
pa king si ua ion in an u ban a ea. Addi ionally, we de ec ed u ban a eas ha , in ou
opinion, need p io i ized a en ion om u ban planning expe s in he sense o u he
analysis ega ding po en ially missing bicycle pa king. In he ollowing chap e , we discuss
he esul s o ou esea ch and in oduce hem in he con ex o hei use ulness o he
desc ibed ask in u ban planning.
6. Discussion
6.1. Objec De ec ion on Social Media Da a as an Addi ional Da a Sou ce o Ob aining
Bicycle-Rela ed In o ma ion in U ban A eas
We in oduced a new me hod o ob aining bicycle- ela ed da a in u ban a eas and
demons a ed i in he ci y o D esden. In he case s udy, we showed ha ou me hod
p o ides aluable in o ma ion o planning u ban in as uc u e as we we e able o iden i y
a eas wi h a lack o pa king acili ies o bicycles. Since ou app oach is ocused on images
om social media ins ead o comme cial da a sou ces o su eys, we a e able o co e bo h
indi idually owned and publicly sha ed bicycles wi hin a geog aphical sp ead o e he ci y
ha is ypical o social media da a [
45
]. In Sec ion 4.4, we b ie ly compa e he dis ibu ion
o de ec ed bicycles o o he da a sou ces and desc ibe he dockless bicycle-sha ing sys em
(BSS) da a as a biased in- he-wild sensing o he same a ea as ou me hod. Rega ding
he loca ion, some o he a eas ha we iden i ied as ha ing a mode a ely insu icien o
insu icien numbe o pa king acili ies a e also isible as dense bicycle clus e s in he da a
o MOBI, such as he cen al ain s a ion. Up o his poin , ou me hod can be seen as a
subs i u e o collec ing da a om bicycle sha ing sys ems. This can al eady be in e es ing
o ci ies wi hou a BSS o companies planning o expand hei BSS o a new ci y as a sou ce
o modeling a bicycle ne wo k and s a ion loca ion inding [46].
Compa ed o a BSS, we can p o ide addi ional alue o u ban planne s o a eas ha
ha e a highe equency o bicycle de ec ions bu a e no su icien ly co e ed by he BSS
se ice. This o en ela es o he mos scenic a eas whe e sha ed bicycles a e no allowed o
be d opped o . In D esden, o example, we iden i ied cen al a eas in he dis ic Al s ad
o ha e a mode a ely insu icien o insu icien numbe o bicycle pa king acili ies, bu
e u ning BSS bicycles was no allowed he e. In some a eas in D esden ha a e also no
co e ed by he e u n zones o he local BSS company, we did no iden i y lacking pa king
acili ies: hese a e, e.g., he ci y pa k G oße Ga en and he cycling ou e along he Elbe
i e . The e we e a eas ha we iden i ied in ou case s udy as no in e es ing enough o
pos ing hem on Flick (i.e., social media). We conside his o be a a he mino d awback
compa ed o BSS da a because only some a eas we e equen ly isible in he MOBI da ase
(e.g., Johanns ad dis ic ), while he e we e no BSS bicycles p esen in o he a eas (e.g., in
he Regie ungs ie el dis ic ).
Addi ionally, we used a Flick da ase ha con ains da a om 2004 o 2014, bu he
popula i y o social media has kep g owing e e since, conside ing he ac ha he numbe
o mobile subsc ip ions inc eased om 2.33 billion in 2014 o 6.4 billion in 2021 [
47
]. We
hus a gue ha ou me hod can de ini ely p o ide addi ional alue o u ban planne s,
especially by using he mos ecen da a and om mo e popula social media pla o ms ha
also ely on pos ing images, such as
Ins ag am [48,49]
. In ha case, i would be necessa y
o addi ionally p ep ocess he da a o comply wi h he p i acy egula ions by anonymizing
hem [50], e.g., as ecen ly p oposed by [51,52].
Rega ding he e iciency o he bicycle de ec ion, ou app oach achie es a ecall o
81.4% (c . Sec ion 4.1) and hus does no ind e e y bicycle, bu i is signi ican ly mo e
e icien han manual iden i ica ion by humans. We ound ha , on a e age, ca e ul manual
anno a ion (c . Sec ion 3.1) akes oughly 30s pe image. While such manual de ec ions
may p o ide a signi ican ly highe ecall han ou ully au oma ic app oach, i would be
ISPRS In . J. Geo-In . 2021,10, 733 20 o 25
e y cos ly o apply a a la ge-scale (e.g., housands o images) se ing. Ou me hod, on
he o he hand, only equi es a mode a ely powe ul compu e wi h compa a i ely small
unning cos s.
In gene al, da a a ailabili y is he only limi ing ac o o ans e abili y in ou ap-
p oach, emphasizing he oppo uni ies social media da a can b ing o u ban analysis [
53
].
Requi emen s ega ding compu ing capaci y a e a he low o applying he me hod o
o he ci ies, as he p e- ained objec de ec ion algo i hm is u ilized o iden i ying and
classi ying bicycles, and con en ional GIS ope a ions enable spa ial explo a ion, analysis
and isualiza ion [
54
]. In compa ison o he o he me hods o ob aining bicycle a ic
da a men ioned in Sec ion 2, ou app oach is comple ely easible wi hou any s uc u al
ins alla ion, e.g., s a iona y coun ing s a ions o bicycle-moun ed GPS senso s.
6.2. Rele ance o Time in Ou App oach
As we used he YFCC100m da ase , which co e s a ime span o 10 yea s, we only
wo ked wi h empo ally comp essed loca ion da a. Compa ed o o he bicycle- ela ed
da a sou ces, his is a i s a majo d awback o ou app oach. Ne e heless, di e en
spa io- empo al analyses would s ill be easible: Fi s , i is possible o analyze cumula ed
equencies o bicycle de ec ions in he da ase wi h espec o empo al ca ego ies such as
weekdays, mon hs o yea s [
55
]. These spa ial- empo al pa e ns can p o ide insigh s in o
daily and seasonal ou ines o u ban cyclis s, and complemen and e i y he con inuous
da a s eams o s a iona y coun e s and BSS da a [
25
,
56
]. Second, ou me hod could be
used as an indica o o he success o exis ing in as uc u e, such as pa king acili ies o
bicycle highways. I would be possible o compa e he spa ial pa e n o de ec ed bicycles
be o e and a e he da e o cons uc ion and, he e o e, de ec changes in bicycle- ela ed
a ic lows o he densi y o de ec ed bicycles o each g id cell we used in ou case s udy.
The capabili y o social media o acqui e in o ma ion abou in e en ions in di e en e en s
has al eady been shown in nume ous s udies, e en hough mos o hem examined mo e
signi ican in e en ions such as in cases o a ic inciden s o na u al disas e s [57,58].
6.3. In luence o Bicycle De ec ion E o s and Po en ial Imp o emen s
In Sec ion 4.1, we p esen he esul s o ou objec de ec ion me hodology o iden-
i ying mo ing and s a iona y bicycles. In addi ion o a quan i a i e e alua ion, we also
p o ide examples o ailu e cases and iden i y he mos equen ca ego ies o alse neg-
a i es and alse posi i es. Al hough we conclude—based on ou case s udy— ha he
in o ma ion ex ac ed om social media da a is sui able o iden i ying a lack o pa king
acili ies o bicycles, we a e awa e o he laws o ou objec de ec ion pipeline. Fu he on,
we discuss hei impac on he indings o he case s udy as well as po en ial imp o emen s
wi hin ou app oach.
Wi h ega ds o con en , he de ec ion e o s can be subdi ided in o s ic ly bicycle-
ela ed e o s (i.e., missed bicycles o duplica e de ec ions) and hose o con usion wi h
o he objec s such as a ic signs o chai s. Fo he o me , we a gue ha he impac o
he alse de ec ions on he indings o he case s udy is ela i ely small, as we uned he
algo i hm o ope a e using mo e conse a i e h esholds and, he e o e, we a he end o
unde es ima e he numbe o bicycles. Fo images wi h mul iple bicycles de ec ed, his will
dec ease he o al numbe o bicycles, bu he numbe o images wi h bicycle de ec ions
will no be a ec ed. Wi h Tables 2and 3in mind, changing a class in he e ical di ec ion
o he able will mos likely no change he assigned ele ance o he g id cell. On he o he
hand, a alse nega i e (i.e., missed de ec ion) o a lone bicycle in an image can change he
ele ance acco ding o Table 2, bu acco ding o he dis ibu ion o he classes in Table 3, a
ele ance change will mos likely occu only be ween classes o low and medium ele ance.
I we o e es ima e he numbe o bicycles in ce ain images, o occasionally de ec alse
posi i es o o he wheeled objec s such as mo o cycles, we a gue ha assigning a highe
ele ance o hese cells is an accep able d awback o he ocus o ou case s udy, whe e we
quali y loca ions as a p io i y o be u he inspec ed by u ban planne s.
ISPRS In . J. Geo-In . 2021,10, 733 21 o 25
In con as o bicycle- ela ed de ec ions, o imp o e ou app oach, we conside mini-
mizing he alse posi i e de ec ions o miscellaneous objec s such as a ic signs. As we
men ion in Sec ion 3.2, we use an objec de ec o ha has been ained on he e y di e se
COCO [
40
] da ase , which con ains a la ge numbe o objec classes in images aken ac oss
all con inen s. Ou a ge applica ion, howe e , is na owe : we a e only in e es ed in he
de ec ion o bicycles and pe sons, and in ou case s udy, he en i onmen is limi ed o
he ci y o D esden. In such a case, ine- uning he objec de ec ion neu al ne wo k on he
na owe a ge domain has been shown o imp o e pe o mance [
59
]. In addi ion, i can
be easible o combine ou me hod wi h o he de ec ion algo i hms om compu e ision.
Fo example, one can employ an algo i hm ha de ec s bicycle a ic signs [
60
,
61
] in o de
o il e ou his ca ego y o alse posi i e de ec ions. Simila ly, one could employ objec
de ec ion o image classi ica ion [
62
] algo i hms ained on o he classes han bicycle and
pe son in o de o es ima e he likelihood o a bicycle de ec ion being a alse posi i e due
o con usion. Bicycle de ec ions, bo h co ec and alse, may also occu in images aken
indoo s. As hese a e o no in e es o ou applica ion, i would be easonable o disca d
such images au oma ically using an algo i hm ha can dis inguish indoo om ou doo
scenes [
63
]. Fo imp o ing he mo ing s. s a iona y classi ica ion accu acy, i would be
easible o ain an objec de ec ion algo i hm o di ec ly p o ide his classi ica ion ins ead
o elying on pe son de ec ions as we desc ibe in Sec ion 3.2.1. Whe he his would ac ually
wo k be e , howe e , depends on a a ie y o ac o s, such as he size and di e si y o
he aining da ase , he a chi ec u e o he con olu ional neu al ne wo k, and app op ia e
da a augmen a ion du ing aining [64].
Imp o ing bicycle de ec ion om social media pos s migh also include p ocessing
ags, ex ual desc ip ions, and emo icons used in a pos o ex ac use eac ions [
65
].
Sen imen analysis and ca ego iza ion o emo ions associa ed wi h a pos can be applied
o iden i y i pos ings ela ed o bicycles a e mo e posi i e o nega i e conno ed and in
ha way ob ain de ailed con ex ual in o ma ion ela ed o a pos and speci ic a eas [
66
,
67
].
Lea ning abou he con ex o an image could allow o, e.g., elimina e alse de ec ions, such
as musical ins umen s and ipods on conce s ages.
I an image con ains bicycles ha a e loca ed a a a dis ance, using only he GPS
loca ion associa ed wi h he image may esul in poo localiza ion o he bicycles. I would
be easible, howe e , o use isual localiza ion [
68
] and geome ic cues [
69
] in o de o
es ima e he pose o he came a and, subsequen ly, ex ac 3D in o ma ion abou he scene
om he image [
70
–
72
]. This would p o ide a mo e p ecise localiza ion o he de ec ed
bicycles.
7. Conclusions
In his pape , we in oduced a new me hod o ob aining bicycle- ela ed da a om
social media pos s. In he i s s ep, we used a p e- ained s a e-o - he-a objec de ec ion
algo i hm o de ec bicycles on a egional subse o he YFCC100m da ase . In he second
s ep, we di e en ia ed be ween mo ing and s a iona y bicycles as we le e aged he abili y
o he de ec ion algo i hm o de ec people and assume ha i a bicycle is loca ed igh
nex o o below a pe son, i is non-s a iona y o mo ing. Wi h ou me hod, we de ec ed
4157 bicycles in he ci y o D esden wi h an o e all p ecision o 96.1% and a ecall o 81.4%,
and classi ied 85.8% o he mo ing bicycles and 91.9% o he s a iona y bicycles co ec ly.
We hen conduc ed a case s udy, whe e we analyzed he gene al si ua ion in D esden
ela ed o pa king acili ies o bicycles using he esul s o he objec de ec ion. As a esul ,
we we e able o classi y u ban a eas acco ding o he su iciency o pa king acili ies and
he eby iden i y a eas ha need p io i ized a en ion om u ban planne s. Using he same
app oach, i would be possible o de ec u he mic o-loca ions wi hin hese u ban a eas.
Ou me hod p o ed as ele an because we we e able o gain meaning ul insigh s in o
he u ban a ea o D esden using social media da a. We conclude ha i p o ides signi ican
alue in planning he bicycle in as uc u e in a ci y, pa icula ly conside ing ha da a o
ha pu pose is o he wise di icul and expensi e o collec . We we e able o sho en he

ISPRS In . J. Geo-In . 2021,10, 733 22 o 25
da a acquisi ion mul iple imes in compa ison o adi ional me hods o da a collec ion in
u ban planning. Addi ionally, we can also p o ide a much la ge empo al co e age.
Clea limi a ions o using social media da a lie in he ac ha he da a a ailabili y
and co e age la gely depend on he usage o social media. The spa ial co e age is wo se
o unpopula han o popula u ban a eas, and empo al co e age (i.e., days, mon hs,
yea s, e c.) is wo se o yea s when social media was less popula . Howe e , bo h da a
a ailabili y and co e age depend on usage ends o he social media pla o m whose da a
we e used. Ha ing ha in mind, usage o he newes social media da a should enable e en
mo e p ecise spa io- empo al analyses. This p ecision may addi ionally be inc eased by
implemen ing u he objec de ec ion algo i hms in da a p ocessing.
By choosing D esden as ou case s udy, we bene i ed om a manageable amoun o
da a, as well as om ou own local expe ise. In he u u e, we in end o po en ially enla ge
he amoun o bicycle de ec ions o deal wi h by ocusing on a la ge ci y. Ano he way o
enla ge ou da ase would be o in eg a e da a om mo e social media pla o ms such as
Ins ag am o Twi e , depending on he a ailabili y o he da a. We also conside imple-
men ing o he da abases o in e es , especially hose p o iding s ee -le el images such
as Mapilla y. Fu he mo e, dealing wi h a highe numbe o de ec ions and la ge u ban
a eas o in e es equi es mo e sophis ica ed app oaches o localiza ion and isualiza ion,
so we in end o wo k on me hods o o ien a e he images by ma ching de ec ed objec s and
ci y u ni u e (e.g., benches, ligh ning objec s, e c.) and imp o e he echniques o isual
analysis and explo a ion.
Au ho Con ibu ions:
Concep ualiza ion, Mo is Zah ila, Flo ian Kluge and Ma in Knu a; me hod-
ology, Mo is Zah ila, Flo ian Kluge and Ma in Knu a; so wa e, Flo ian Kluge ; alida ion, Mo is
Zah ila, Flo ian Kluge and Ma in Knu a; o mal analysis, Mo is Zah ila, Flo ian Kluge and
Ma in Knu a; in es iga ion, Mo is Zah ila, Flo ian Kluge and Ma in Knu a; esou ces, Bodo
Rosenhahn, Jochen Schiewe and Di k Bu gha d ; da a cu a ion, Flo ian Kluge and Ma in Knu a;
w i ing—o iginal d a p epa a ion, Mo is Zah ila, Flo ian Kluge and Ma in Knu a; w i ing—
e iew and edi ing, Mo is Zah ila, Flo ian Kluge , Ma in Knu a, Bodo Rosenhahn, Jochen Schiewe
and Di k Bu gha d ; isualiza ion, Mo is Zah ila and Ma in Knu a; supe ision, Bodo Rosenhahn,
Jochen Schiewe and Di k Bu gha d ; p ojec adminis a ion, Mo is Zah ila, Flo ian Kluge , Ma in
Knu a, Bodo Rosenhahn, Jochen Schiewe and Di k Bu gha d ; unding acquisi ion, Bodo Rosenhahn,
Jochen Schiewe and Di k Bu gha d . All au ho s ha e ead and ag eed o he published e sion o
he manusc ip .
Funding:
This collabo a ion was ealized wi hin he DFG P io i y P og amme (SPP 1894/2) and
suppo ed by g an s COVMAP (RO 2497/12-2), TOVIP (SCHI 1008/11-1) and EVA-VGI 2 (BU
2605/8-2).
Da a A ailabili y S a emen :
Da a and sou ce code is a ailable a h ps://gi hub.com/ kluge /
bicycle_de ec ion.
Con lic s o In e es : The au ho s decla e no con lic o in e es .
Re e ences
1.
Suman an, V.; Fine, C.; Gonsal ez, D. Fas e , Sma e , G eene : The Fu u e o he Ca and U ban Mobili y; The MIT P ess: Camb idge,
MA, USA, 2017. [C ossRe ]
2.
Qiu, L.Y.; He, L.Y. Bike Sha ing and he Economy, he En i onmen , and Heal h-Rela ed Ex e nali ies. Sus ainabili y
2018
,10,
1145. [C ossRe ]
3.
Puche , J.; Buehle , R. Making Cycling I esis ible: Lessons om The Ne he lands, Denma k and Ge many. T ansp. Re .
2008
,
28, 495–528. [C ossRe ]
4.
F oehlich, J.; Neumann, J.; Oli e , N. Sensing and P edic ing he Pulse o he Ci y h ough Sha ed Bicycling. In P oceedings o
he 21s In e na ional Jon Con e ence on A i ical In elligence, Pasadena, CA, USA, 14–17 July 2009; pp. 1420–1426.
5.
Zhou, X. Unde s anding Spa io empo al Pa e ns o Biking Beha io by Analyzing Massi e Bike Sha ing Da a in Chicago. PLoS
ONE 2015,10, e0137922. [C ossRe ]
6.
Co co an, J.; Li, T.; Rohde, D.; Cha les-Edwa ds, E.; Ma eo-Babiano, D. Spa io- empo al pa e ns o a Public Bicycle Sha ing
P og am: The e ec o wea he and calenda e en s. J. T ansp. Geog . 2014,41, 292–305. [C ossRe ]
ISPRS In . J. Geo-In . 2021,10, 733 23 o 25
7.
E ienne, C.; La i a, O. Model-Based Coun Se ies Clus e ing o Bike Sha ing Sys em Usage Mining: A Case S udy wi h he VéLib’
Sys em o Pa is. ACM T ans. In ell. Sys . Technol. 2014,5, 1–21. [C ossRe ]
8.
Ko pilo, S.; Vi anen, T.; Leh ä i a, S. Sma phone GPS acking—Inexpensi e and e icien da a collec ion on ec ea ional
mo emen . Landsc. U ban Plan. 2017,157, 608–617.[C ossRe ]
9.
Reades, J.; Calab ese, F.; Se suk, A.; Ra i, C. Cellula Census: Explo a ions in U ban Da a Collec ion. IEEE Pe asi e Compu .
2007,6, 30–38. [C ossRe ]
10.
Hube , S.; Lissne , S.; Schnabel, A.; Lindemann, P.; F iedl, J. Modelling bicycle ou e choice in Ge man ci ies using open da a, MNL
and he bikeSim web-app. In P oceedings o he 2021 7 h In e na ional Con e ence on Models and Technologies o In elligen
T anspo a ion Sys ems (MT-ITS), He aklion, G eece, 16–17 June 2021. [C ossRe ]
11.
Chen, C.; Ande son, J.C.; Wang, H.; Wang, Y.; Vog , R.; He nandez, S. How bicycle le el o a ic s ess co ela e wi h epo ed
cyclis acciden s inju y se e i ies: A geospa ial and mixed logi analysis. Accid. Anal. P e .
2017
,108, 234–244. [C ossRe ]
[PubMed]
12.
Gö schi, T.; Ga a d, J.; Giles-Co i, B. Cycling as a Pa o Daily Li e: A Re iew o Heal h Pe spec i es. T ansp. Re .
2016
,
36, 45–71. [C ossRe ]
13.
Buehle , R. De e minan s o anspo mode choice: A compa ison o Ge many and he USA. J. T ansp. Geog .
2011
,19, 644–657.
[C ossRe ]
14.
Sco , D.M.; Lu, W.; B own, M.J. Rou e choice o bike sha e use s: Le e aging GPS da a o de i e choice se s. J. T ansp. Geog .
2021,90, 102903. [C ossRe ]
15.
Hoogendoo n, S.; Daamen, W. Bicycle Headway Modeling and I s Applica ions. T ansp. Res. Rec.
2016
,2587, 34–40. [C ossRe ]
16.
Pogodzinska, S.; Kiec, M.; D’Agos ino, C. Bicycle T a ic Volume Es ima ion Based on GPS Da a. T ansp. Res. P ocedia
2020
,
45, 874–881.
17.
Geh ke, S.R.; Rea don, T.G. Di ec demand modelling app oach o o ecas cycling ac i i y o a p oposed bike acili y. T ansp.
Plan. Technol. 2021,44, 1–15. [C ossRe ]
18.
Bei el, D.; McNee, S.; Mi anda-Mo eno, L.F. Quali y Measu e o Sho -Du a ion Bicycle Coun s. T ansp. Res. Rec.
2017
,2644, 64–71.
[C ossRe ]
19.
Tu ne , S.; Lasley, P. Quali y Coun s o Pedes ians and Bicyclis s: Quali y Assu ance P ocedu es o Nonmo o ized T a ic
Coun Da a. T ansp. Res. Rec. 2013,2339, 57–67. [C ossRe ]
20.
Hankey, S.; Lu, T.; Mondschein, A.; Buehle , R. Spa ial models o ac i e a el in small communi ies: Me ging he goals o a ic
moni o ing and di ec -demand modeling. J. T ansp. Heal h 2017,7, 149–159. [C ossRe ]
21.
Gup e, S.; Masoud, O.; Ma in, R.; Papanikolopoulos, N. De ec ion and classi ica ion o ehicles. IEEE T ans. In ell. T ansp. Sys .
2002,3, 37–47. [C ossRe ]
22.
Ghosh, A.; Sabuj, M.S.; Sone , H.H.; Sha abda, S.; Fa id, D.M. An Adap i e Video-based Vehicle De ec ion, Classi ica ion,
Coun ing, and Speed-measu emen Sys em o Real- ime T a ic Da a Collec ion. In P oceedings o he 2019 IEEE Region 10
Symposium (TENSYMP), Kolka a, India, 7–9 June 2019; pp. 541–546. [C ossRe ]
23.
Gillis, D.; Gau ama, S.; Van Gheluwe, C.; Semanjski, I.; Lopez, A.J.; Lauwe s, D. Measu ing Delays o Bicycles a Signalized
In e sec ions Using Sma phone GPS T acking Da a. ISPRS In . J. Geo-In . 2020,9, 174. [C ossRe ]
24.
Chen, Z.; an Lie op, D.; E ema, D. Dockless bike-sha ing sys ems: Wha a e he implica ions? T ansp. Re .
2020
,40, 333–353.
[C ossRe ]
25.
Ma, X.; Ji, Y.; Yuan, Y.; Van Oo , N.; Jin, Y.; Hoogendoo n, S. A compa ison in a el pa e ns and de e minan s o use demand
be ween docked and dockless bike-sha ing sys ems using mul i-sou ced da a. T ansp. Res. Pa A Policy P ac .
2020
,139, 148–173.
[C ossRe ]
26.
Basi i, A.; Haklay, M.; Foody, G.; Mooney, P. C owdsou ced geospa ial da a quali y: Challenges and u u e di ec ions. In . J.
Geog . In . Sci. 2019,33, 1588–1593. [C ossRe ]
27.
Wang, L. Planning o cycling in a g owing megaci y: Explo ing planne s’ pe cep ions and sha ed alues. Ci ies
2020
,106, 102857.
[C ossRe ]
28.
Weng, J.; Bäume , T.; Mülle , P. Bike-Sha ing Sys ems as In eg al Componen s o Inne -Ci y Mobili y Concep s: An Analysis
o he In ended Use Beha iou o Po en ial and Ac ual Bike-Sha ing Use s. In Inno a ions o Me opoli an A eas: In elligen
Solu ions o Mobili y, Logis ics and In as uc u e Designed o Ci izens; Planing, P., Mülle , P., Dehda i, P., Bäume , T., Eds.; Sp inge :
Be lin/Heidelbe g, Ge many, 2020; pp. 121–132. [C ossRe ]
29. Zhu, Z.; Blanke, U.; Cala oni, A.; T ös e , G. Human Ac i i y Recogni ion Using Social Media Da a. In P oceedings o he 12 h
In e na ional Con e ence on Mobile and Ubiqui ous Mul imedia, Luleå, Sweden, 2–5 Decembe 2013. [C ossRe ]
30. S ock, K. Mining loca ion om social media: A sys ema ic e iew. Compu . En i on. U ban Sys . 2018,71, 209–240. [C ossRe ]
31.
Middle on, S.E.; Ko dopa is-Zilos, G.; Papadopoulos, S.; Kompa sia is, Y. Loca ion Ex ac ion om Social Media: Geopa sing,
Loca ion Disambigua ion, and Geo agging. ACM T ans. In . Sys . 2018,36, 1–27. [C ossRe ]
32.
Gong, J.; Li, R.; Yao, H.; Kang, X.; Li, S. Recognizing Human Daily Ac i i y Using Social Media Senso s and Deep Lea ning. In . J.
En i on. Res. Public Heal h 2019,16, 3955. [C ossRe ]
33.
Cao, R.; Tu, W.; Yang, C.; Li, Q.; Liu, J.; Zhu, J.; Zhang, Q.; Li, Q.; Qiu, G. Deep lea ning-based emo e and social sensing da a
usion o u ban egion unc ion ecogni ion. ISPRS J. Pho og amm. Remo e Sens. 2020,163, 82–97. [C ossRe ]
ISPRS In . J. Geo-In . 2021,10, 733 24 o 25
34.
Thomee, B.; Shamma, D.A.; F iedland, G.; Elizalde, B.; Ni, K.; Poland, D.; Bo h, D.; Li, L.J. YFCC100M: The new da a in
mul imedia esea ch. Commun. ACM 2016,59, 64–73. [C ossRe ]
35.
Tan, M.; Pang, R.; Le, Q.V. E icien de : Scalable and e icien objec de ec ion. In P oceedings o he IEEE/CVF Con e ence on
Compu e Vision and Pa e n Recogni ion, Sea le, WA, USA, 16–18 June 2020; pp. 10781–10790.
36. Redmon, J.; Fa hadi, A. Yolo 3: An inc emen al imp o emen . a Xi 2018, a Xi :1804.02767.
37.
Du, X.; Lin, T.Y.; Jin, P.; Ghiasi, G.; Tan, M.; Cui, Y.; Le, Q.V.; Song, X. SpineNe : Lea ning scale-pe mu ed backbone o ecogni ion
and localiza ion. In P oceedings o he IEEE/CVF Con e ence on Compu e Vision and Pa e n Recogni ion, Sea le, WA, USA,
16–18 June 2020; pp. 11592–11601.
38.
He, K.; Gkioxa i, G.; Dollá , P.; Gi shick, R. Mask -cnn. In P oceedings o he IEEE In e na ional Con e ence on Compu e Vision,
Venice, I aly, 22–29 Oc obe 2017; pp. 2961–2969.
39.
Lin, T.Y.; Goyal, P.; Gi shick, R.; He, K.; Dollá , P. Focal loss o dense objec de ec ion. In P oceedings o he IEEE In e na ional
Con e ence on Compu e Vision, Venice, I aly, 22–29 Oc obe 2017; pp. 2980–2988.
40.
Lin, T.Y.; Mai e, M.; Belongie, S.; Hays, J.; Pe ona, P.; Ramanan, D.; Dollá , P.; Zi nick, C.L. Mic oso coco: Common objec s in
con ex . In Eu opean Con e ence on Compu e Vision; Sp inge : Be lin/Heidelbe g, Ge many, 2014; pp. 740–755.
41.
Zoph, B.; Cubuk, E.D.; Ghiasi, G.; Lin, T.Y.; Shlens, J.; Le, Q.V. Lea ning da a augmen a ion s a egies o objec de ec ion. In
Eu opean Con e ence on Compu e Vision; Sp inge : Be lin/Heidelbe g, Ge many, 2020; pp. 566–583.
42. Kuhn, H.W. The Hunga ian me hod o he assignmen p oblem. Na . Res. Logis . Q. 1955,2, 83–97. [C ossRe ]
43.
Landeshaup s ad D esden, S.u.T. Daue zähls ellen ü den Rad e keh . A ailable online: h p://www.d esden.de/media/pd /
S assenbau/Daue zaehls ellen_S ad plan.pd (accessed on 5 Augus 2021).
44. Jenks, G.F. The da a model concep in s a is ical mapping. In . Yea b. Ca og . 1967,7, 186–190.
45.
Jiang, B.; Ma, D.; Yin, J.; Sandbe g, M. Spa ial Dis ibu ion o Ci y Twee s and Thei Densi ies. Geog . Anal.
2016
,48, 337–351.
[C ossRe ]
46.
Bahado i, M.S.; Gonçal es, A.B.; Mou a, F. A Sys ema ic Re iew o S a ion Loca ion Techniques o Bicycle-Sha ing Sys ems
Planning and Ope a ion. ISPRS In . J. -Geo-In . 2021,10, 554. [C ossRe ]
47.
Tele onak iebolage LM E icsson E icsson Mobili y Visualize . A ailable online: h ps://www.e icsson.com/en/mobili y- epo /
mobili y- isualize ? =1& =1& =1& =8&s=1&u=1&y=2014,2021&c=1 (accessed on 14 Sep embe 2021).
48.
Domínguez, D.R.; Díaz Redondo, R.P.; Vilas, A.F.; Khali a, M.B. Sensing he ci y wi h Ins ag am: Clus e ing geoloca ed da a o
ou lie de ec ion. Expe Sys . Appl. 2017,78, 319–333. [C ossRe ]
49.
Gun e , U.; Önde , I. An Explo a o y Analysis o Geo agged Pho os F om Ins ag am o Residen s o and Visi o s o Vienna. J.
Hosp. Tou . Res. 2021,45, 373–398. [C ossRe ]
50.
Beigi, G.; Shu, K.; Zhang, Y.; Liu, H. Secu ing Social Media Use Da a: An Ad e sa ial App oach. In P oceedings o he 29 h on
Hype ex and Social Media, Bal imo e, MD, USA, 9–12 July 2018; pp. 165–173. [C ossRe ]
51.
Dunkel, A.; Löchne , M.; Bu gha d , D. P i acy-Awa e Visualiza ion o Volun ee ed Geog aphic In o ma ion (VGI) o Analyze
Spa ial Ac i i y: A Benchma k Implemen a ion. ISPRS In . J. Geo-In . 2020,9, 607. [C ossRe ]
52.
Löchne , M.; Fa hi, R.; Schmid, D.; Dunkel, A.; Bu gha d , D.; Fied ich, F.; Koch, S. Case S udy on P i acy-Awa e Social Media
Da a P ocessing in Disas e Managemen . ISPRS In . J. Geo-In . 2020,9, 709. [C ossRe ]
53.
Ma í, P.; Se ano-Es ada, L.; Nolasco-Ci ugeda, A. Social Media da a: Challenges, oppo uni ies and limi a ions in u ban
s udies. Compu . En i on. U ban Sys . 2019,74, 161–174. [C ossRe ]
54.
Ali and, M.; Hochmai , H.H. Spa io empo al analysis o pho o con ibu ion pa e ns o Pano amio and Flick . Ca og . Geog . In .
Sci. 2017,44, 170–184. [C ossRe ]
55.
McKenzie, G.; Janowicz, K.; Gao, S.; Yang, J.A.; Hu, Y. POI Pulse: A Mul i-g anula , Seman ic Signa u e–Based In o ma ion
Obse a o y o he In e ac i e Visualiza ion o Big Geosocial Da a. Ca og aphica 2015,50, 71–85. [C ossRe ]
56.
No dback, K.; Ma shall, W.E.; Janson, B.N.; S olz, E. Es ima ing Annual A e age Daily Bicyclis s: E o and Accu acy. T ansp. Res.
Rec. 2013,2339, 90–97. [C ossRe ]
57.
Rashidi, T.H.; Abbasi, A.; Magh ebi, M.; Hasan, S.; Walle , T.S. Explo ing he capaci y o social media da a o modelling a el
beha iou : Oppo uni ies and challenges. T ansp. Res. Pa C Eme g. Technol. 2017,75, 197–211. [C ossRe ]
58.
Resch, B.; Uslände , F.; Ha as, C. Combining machine-lea ning opic models and spa io empo al analysis o social media da a o
disas e oo p in and damage assessmen . Ca og . Geog . In . Sci. 2018,45, 362–376. [C ossRe ]
59.
Gi shick, R.; Donahue, J.; Da ell, T.; Malik, J. Rich ea u e hie a chies o accu a e objec de ec ion and seman ic segmen a ion.
In P oceedings o he IEEE Con e ence on Compu e Vision and Pa e n Recogni ion, Columbus, OH, USA, 23–28 June 2014;
pp. 580–587.
60.
Reinde s, C.; Acke mann, H.; Yang, M.Y.; Rosenhahn, B. Objec ecogni ion om e y ew aining examples o enhancing
bicycle maps. In P oceedings o he 2018 IEEE In elligen Vehicles Symposium (IV), Suzhou, China, 26–30 June 2018; pp. 1–8.
61.
Reinde s, C.; Acke mann, H.; Yang, M.Y.; Rosenhahn, B. Lea ning con olu ional neu al ne wo ks o objec de ec ion wi h e y
li le aining da a. In Mul imodal Scene Unde s anding; Else ie : Ams e dam, The Ne he lands, 2019; pp. 65–100.
62.
K izhe sky, A.; Su ske e , I.; Hin on, G.E. Imagene classi ica ion wi h deep con olu ional neu al ne wo ks. Ad . Neu al In .
P ocess. Sys . 2012,25, 1097–1105. [C ossRe ]
63.
Zhou, B.; Laped iza, A.; Khosla, A.; Oli a, A.; To alba, A. Places: A 10 million Image Da abase o Scene Recogni ion. IEEE
TRansac ions Pa e n Anal. Mach. In ell. 2017,40, 1452–1464. [C ossRe ]
ISPRS In . J. Geo-In . 2021,10, 733 25 o 25
64.
Kluge , F.; Reinde s, C.; Rae z, K.; Schelske, P.; Wand , B.; Acke mann, H.; Rosenhahn, B. Region-based cycle-consis en da a
augmen a ion o objec de ec ion. In P oceedings o he 2018 IEEE In e na ional Con e ence on Big Da a (Big Da a), Sea le, WA,
USA, 10–13 Decembe 2018; pp. 5205–5211.
65.
Dunkel, A.; And ienko, G.; And ienko, N.; Bu gha d , D.; Hau hal, E.; Pu es, R. A concep ual amewo k o s udying collec i e
eac ions o e en s in loca ion-based social media. In . J. Geog . In . Sci. 2019,33, 780–804. [C ossRe ]
66.
Hau hal, E.; Bu gha d , D. Mapping Space-Rela ed Emo ions ou o Use -Gene a ed Pho o Me ada a Conside ing G amma ical
Issues. Ca og . J. 2016,53, 78–90. [C ossRe ]
67. Hau hal, E.; Bu gha d , D.; Dunkel, A. Analyzing and Visualizing Emo ional Reac ions Exp essed by Emojis in Loca ion-Based
Social Media. ISPRS In . J. Geo-In . 2019,8, 113. [C ossRe ]
68.
Sa lin, P.E.; Cadena, C.; Siegwa , R.; Dymczyk, M. F om coa se o ine: Robus hie a chical localiza ion a la ge scale. In
P oceedings o he IEEE/CVF Con e ence on Compu e Vision and Pa e n Recogni ion, Long Beach, CA, USA, 16–20 June 2019;
pp. 12716–12725.
69.
Kluge , F.; Acke mann, H.; Yang, M.Y.; Rosenhahn, B. Tempo ally consis en ho izon lines. In P oceedings o he 2020 IEEE
In e na ional Con e ence on Robo ics and Au oma ion (ICRA), Pa is, F ance, 31 May–31 Augus 2020; pp. 3161–3167.
70.
Kluge , F.; Acke mann, H.; Yang, M.Y.; Rosenhahn, B. Deep lea ning o anishing poin de ec ion using an in e se gnomonic
p ojec ion. In Ge man Con e ence on Pa e n Recogni ion; Sp inge : Be lin/Heidelbe g, Ge many, 2017; pp. 17–28.
71.
Kluge , F.; B achmann, E.; Acke mann, H.; Ro he , C.; Yang, M.Y.; Rosenhahn, B. Consac: Robus mul i-model i ing by
condi ional sample consensus. In P oceedings o he IEEE/CVF Con e ence on Compu e Vision and Pa e n Recogni ion, Sea le,
WA, USA, 14–19 June 2020; pp. 4634–4643.
72.
Kluge , F.; Acke mann, H.; B achmann, E.; Yang, M.Y.; Rosenhahn, B. Cuboids Re isi ed: Lea ning Robus 3D Shape Fi ing o
Single RGB Images. In P oceedings o he IEEE/CVF Con e ence on Compu e Vision and Pa e n Recogni ion, Nash ille, TN,
USA, 19–25 June 2021; pp. 13070–13079.