A Seman ic Web me hodological amewo k o e alua e he
suppo o in eg i y in hesau us ools
M Me cedes Ma ínez-González
Uni e si y o Valladolid, Spain
me cedes@in o .u a.es
Ma ía-Luisa Al i e-Díez
Uni e si y o Leon, Spain
[email p o ec ed]
The inal, published e sion o his a icle is a ailable online.
Please check he inal publica ion eco d o he la es e isions
o his a icle. [Ma ínez-González, M. M., & Al i e-Díez, M.-L.
(2019). A seman ic web me hodological amewo k o e alua e
he suppo o in eg i y in hesau us ools. Jou nal o
In o ma ion Science.
h ps://doi.o g/10.1177/0165551519837195]
Abs ac
Wi h he Seman ic Web, hesau i eco e a ele an ole suppo ing seman ic sea ches and
o he added- alue se ices. Thesau us s anda ds de ine wha cons uc s a hesau us can
ha e and he in eg i y ules i mus comply wi h. Thesau us edi o s can be helped in hei
wo k i hesau us ools o e hem suppo o in eg i y, wa ning when in eg i y ules a e
iola ed and/o helping hem o co ec hese mis akes.
The mos ecen hesau us s anda d is ISO 25964, which supe sedes ISO 2788, e ol ing
owa ds concep -based hesau i, be e aligned wi h he Seman ic Web app oach han he
e m-based hesau i o ISO 2788. Howe e , he W3C ecommenda ion o KOS
(Knowledge O ganiza ion Sys em) ep esen a ion in he seman ic web con ex is SKOS,
which is in ac p io o ISO 25964. This pape ocuses on hesau us in eg i y and he
e olu ion om ISO 2788 o ISO 25964. I s e ec on in eg i y issues is analyzed. A
me hodological p oposal o e alua ing in eg i y suppo in hesau us ools, a ising om
he esul s o his wo k, is p esen ed. I s a ge audience is p o essionals in cha ge o
hesau us edi ion. Besides being adap ed o he mos ecen hesau us s anda d, ISO
25964, i also includes he compa ison o ISO s anda ds wi h SKOS. The pape is
comple ed wi h he p esen a ion o he esul s o applying i o h ee hesau us ools.
Keywo ds
ISO 2788; ISO 25964; Seman ic Web; SKOS; so wa e e alua ion; hesau us in eg i y;
hesau us ools
1. In oduc ion
The Seman ic web and linked da a ha e b ough abou a enewed in e es in hesau i as
concep ual ools ha can be used o imp o e seman ic in e ope abili y [1, 2, 3, 4]. This
“ e i al” is e lec ed in he upda e o he hesau us ISO s anda d. Be ween 2011 and
2013, ISO published ISO 25964 [5, 6], he hesau us s anda d ha supe sedes ISO
2788:1986 [7]. I is an e olu ion om he app oach o e m-based hesau i, p esen in ISO
2788, o concep -based hesau i [8, 9]. This concep -based app oach was al eady used in
SKOS [10], and is close o he idea o concep ual sea ches ha unde lies seman ic
in o ma ion e ie al [11, 12]. Wi h he e olu ion om ISO 2788 o ISO 25964, he
hesau us communi y emb aces he Seman ic Web ision. All o his in an en i onmen o
seman ic in e ope abili y, in which hesau i a e eused in open con ex s. Reuse is
de ini ely s eng hened when using s anda ds o sha e hesau i [1, 8]1.
This new ISO s anda d appea ed a e he W3C ecommenda ion o ep esen ing
KOS in he seman ic web: SKOS (Simple Knowledge O ganiza ion Sys ems) [13].
Du ing he pe iod when ISO 2788 was he a ailable s anda d o hesau i, se e al hesau i
we e ep esen ed using SKOS and ools we e adap ed o use RDF/SKOS as he
unde lying language2 o s o e and sha e he hesau i hei use s c ea ed. Howe e , SKOS
is in ended o use in a wide se o KOS. An example o i s signi icance and ele an
sp ead can be ound in he W3C websi e -SKOS Da ase s-3, in which hesau i, subjec
headings, glossa ies, lis s o au ho i ies, classi ica ions, axonomies, nomencla u es, e c.,
a e collec ed. I should be no ed a his poin ha he hesau i wi h he longes ajec o y
and managed by p es igious in e na ional ins i u ions, such as Eu oVoc (Eu opean Union
Publica ions O ice), UNESCO Thesau us (Uni ed Na ions Educa ional, Scien i ic and
Cul u al O ganiza ion -UNESCO-) o AGROVOC (Food and Ag icul u e O ganiza ion
-FAO-), among o he s, a e ep esen ed in SKOS (see No e 1).
I is wo h ema king ha he es ic i e o ien a ion equi ed by ocabula y con ol
(e.g., polysemy is no allowed, ambigui y is con olled) p e ails in hesau i s anda ds.
Howe e , SKOS has a mo e gene al oca ion (pu pose), as i was c ea ed no only o
ep esen ing con olled ocabula ies, such as hesau i, bu also o less es ic i e
ocabula ies such as olksonomies and glossa ies.
Wi h his con ex , he compa ison o he ISO hesau i s anda ds and he SKOS
ecommenda ions when using SKOS o hesau i ep esen a ion is equi ed. The
equi alence be ween hesau i cons uc s, as de ined by ISO 2788, and SKOS cons uc s
was i s co e ed by guidelines p o ided in he SKOS P ime Guide [14]. The
equi alence be ween ISO 25964 and SKOS is deal wi h in [15].
In eg i y is he quali y ha gua an ees ha a gi en hesau us is consis en wi h ega d
o he o mal de ini ion o wha a hesau us can be (da a model). In eg i y is a c ucial
issue du ing he p ocess o hesau i c ea ion and edi ion, because in inging in eg i y
ules can be done unconsciously (as shown by he esul s o assessing SKOS ocabula ies
published in [16]). In an ideal scena io, a hesau us ool would deal wi h in eg i y in such
a way ha any upda es ha would esul in in eg i y iola ion would be au oma ically
ejec ed by he ool. In addi ion, i should be able o inse au oma ically any ela ionships
ha can be de i ed om hose inse ed by end use s o o dele e, in cascade, he
ela ionships in which a dele ed cons uc pa icipa es. When ools au oma ically check
in eg i y, use s a e g ea ly helped in co ec ing e o s commi ed when c ea ing a
hesau us, so hey can be mo e con iden abou he wo k done. As wi h on ologies [17],
he in e es o assis ing he end use wi h a sui able checking ool inc eases as he size o
he KOS being edi ed is g ea e .
In his pape , a me hodological p oposal o e alua ing in eg i y suppo in hesau us
ools is p esen ed. This in eg i y e alua ion is pa o a gene al amewo k [18] aimed a
e alua ing he unc ionali ies equi ed o hesau us ools. I s main public is he hesau us
communi y, i.e., in o ma ion managemen p o essionals in ol ed in he de elopmen ,
main enance and edi ion o hesau i, who need eliable ools o hese asks. I is wo h
no ing ha i is mo e o ien ed owa ds he p ope design o hesau us managemen ools
and hei use s’ expe ience, a he han a pu ely heo e ical o logical pe spec i e.
This pape ocuses on he in eg i y issue, while he p e ious esea ch p esen ed he
gene al amewo k and co e ed 7 issues (Pu pose, Sys em equi emen s, Func ionali ies,
Thesau us cons uc s suppo ed, In eg i y managemen , In o ma ion in e ope abili y,
So wa e in e ope abili y and in eg a ion). Thus, his pape p o ides an enhanced, in-
dep h and de ailed analysis o he in eg i y p oblem and he es s designed o e alua e i s
suppo in hesau us ools, none o which could be included in he gene al o e iew
p esen ed in e e ence [18]. Besides, in his pape , he amewo k adap a ion om ISO
2788 ( e m-based hesau i) o ISO 25964 (concep -based hesau i) is discussed. The es s
we e ini ially designed acco ding o he ISO 2788 s anda d, which is s ill suppo ed by
hesau us ools. They we e la e e ised in acco dance wi h ISO 25964. As o he
compa ison o hesau us in eg i y condi ions wi h he in eg i y condi ions o SKOS, i is
wo h analyzing hesau us issues ha a e also p esen in SKOS and hose ha a e speci ic
o hesau i, as his indica es which es s should be supe ised mo e ca e ully in a p ac ical
e alua ion. These di e ences p o ide he key o iden i ying es s whose esul s may mo e
easily di e om wha would be expec ed acco ding o hesau i s anda ds, ha is,
p oducing nega i e esul s in ools using SKOS as he unde lying ep esen a ion
language.
This is a quali a i e, no quan i a i e me hodology. The e a e wo main easons o
his. Fi s , he impo an issue o a hesau us edi o p o essional is o be assis ed in he
c ea ion o a seman ically co ec KOS (which is a ques ion wi h a bina y answe : yes,
he ool suppo s i /no, he ool does no suppo i ). Second, he size o hesau i is no a
p oblem o ools4. As al eady shown in ou p e ious wo k [18], he mos popula
hesau i a e loaded and ea ed wi hou p oblems by mos hesau us ools, which means
ha he e a e no pe o mance p oblems when dealing wi h eal hesau i.
The me hodological amewo k was applied o h ee ools, PoolPa y, SKOSEd, and
VocBench o check i s applicabili y. Fo his wo k, in which he new ISO 25964 s anda d
is aken in o accoun , ools al eady using SKOS a e conside ed mo e sui able. As has
been e i ied wi h such hesau i as Eu oVoc, AGROVOC o he UNESCO hesau us, and
he wo k o he ISO wo king g oup (see [15]) shows, he endency is o use SKOS o he
ep esen a ion o hesau i. While SKOSEd is, as i s name indica es, a ool c ea ed o edi
and manage SKOS sys ems, PoolPa y is a ool o iginally designed mo e speci ically o
hesau i, while VocBench is a so wa e ool o managing OWL on ologies, SKOS(XL)
hesau i and gene ic RDF da ase s.
The e a e o he su eys o hesau us ools [19, 20]. In hese su eys, such ea u es as
he c ea ion and managemen o hesau i, and hose ela ed o so wa e ou pu (display o
hesau i on he sc een o p in e , o ins ance), we e ouched upon. The p oposal
p esen ed he e is o iginal due o i s Seman ic Web o ien ed app oach. Mo eo e , his
p oposal deals in dep h wi h in eg i y, aking in o accoun ISO 2788 and ISO 25964.
Besides, i is wo h no ing ha , in he Seman ic Web, hesau i and on ologies ha e
di e en oles [21], hus he compa ison wi h on ology ools is beyond he scope o his
wo k. This wo k also di e s om wo ks ha es he quali y o KOS ep esen ed wi h
SKOS [16]. While, in hese la e wo ks, he goal is o analyze he quali y o he SKOS
ep esen a ion o con olled ocabula ies (which include o he KOS han hesau i) and o
p o ide sugges ions o co ec he p oblems de ec ed, in ou me hodological amewo k,
he in e es ocuses on helping hesau i edi o s o selec ools ha assis hem in hesau us
edi ion.
Sec ion 2 p o ides a b ie in oduc ion so as o unde s and he scope o in eg i y in
o de o check he ela ionships be ween cons uc s in a hesau us; likewise, in eg i y
condi ions in ISO s anda ds and he SKOS Recommenda ion a e compa ed in de ail.
Sec ion 3 is de o ed o he me hodological amewo k, in which an in dep h e iew o he
amewo k o in eg i y suppo is o e ed. This esea ch akes in o accoun he e olu ion
om he ISO 2788 o ISO 25964 hesau us s anda d. The analysis o co espondences
be ween ISO 25964 and SKOS is also included in his sec ion. In sec ion 4, he esul s o
applying he me hodological p oposal o he expe imen al e alua ion o PoolPa y,
SKOSEd and VocBench a e discussed. Sec ion 5 collec s he main conclusions ob ained.
2. Thesau us in eg i y
Nex , he main cons uc s o hesau i a e p esen ed, as well as he meaning and
impo ance o in eg i y in a hesau us (sec ion 2.1). Then (heading 2.2), he in eg i y
condi ions o hesau i, bo h in ISO 2788 and ISO 25964, a e discussed. The in eg i y
condi ions es ablished in SKOS ollow hem in heading 2.3. I is use ul o ha e he lis ing
o SKOS es ic ions, as hey a e help ul o suppo he analysis o he possibili ies o
inding suppo by de aul on ools using SKOS o ep esen ing hesau i, and o
cha ac e izing he hesau us es ic ions ha any hesau us ool should gua an ee on i s
own as an added alue. This analysis is gi en unde heading 2.4.
2.1 P elimina y app oach
Thesau i s anda ds es ablish he ypes o cons uc s ha make up he pa s o a hesau us.
Wi h ISO 2788, he main cons uc s o hesau i a e Te ms: wo ds o ph ases ha ep esen
an idea. In ISO 25964, he main cons uc s o hesau i a e Concep s. Concep s a e
ep esen ed by e ms. The e a e wo ypes o e ms: P e e ed e ms and Non- p e e ed
e ms. One single p e e ed e m is chosen o ep esen an idea o concep . Se e al non-
p e e ed e ms can be associa ed wi h a concep . Equi alence ela ionships ela e he
e ms associa ed o he same concep : UF (Used Fo ), o Non-P e e ed Te ms, and USE
(Uses), o P e e ed Te ms.
Hie a chical ela ionships p o ide he s uc u e o a hesau us: BT (B oade Te m),
NT (Na owe Te m), Top Te m/Top Concep . A BT concep has a scope including he
scope o i s na owe concep s. No e ha he name o he ela ionships is no changed
om ISO 2788 o ISO 25964, while in his las ecommenda ion hey should be ead as
B oade concep and Na owe concep . ISO 25964 in oduces he possibili y o
quali ying hese ela ionships wi h op ional “ oles”, some hing no possible in ISO 2788.
The e a e h ee ypes o oles, which can be used o dis inguish he h ee ypes o
hie a chical ela ionship: ins an ial (ins ance o ), pa i i e (pa o ), and gene ic (kind o ).
De ailed discussion can be ound in [15, 22]. A op concep is no na owe han any o he
p e e ed e m/concep in he same hesau us. In some hesau i, he e is also a mul iple
hie a chy o polyhie a chy.
Ano he impo an ype o ela ionships is Associa i e ela ionships: RT (Rela ed
Te m), used o p e e ed e ms/concep s ha a e no ela ed by hie a chical ela ionships
bu ha e, howe e , some ype o ela ionship (e.g., book has some hing o do wi h au ho ,
while hey should no be ela ed by an NT/BT ela ionship).
Concep s can be g ouped in o mic o hesau i (also called subjec ields, ields o
knowledge o domains). I is no common, bu nes ing be ween mic o hesau i is possible
(see, e.g., he Eu oVoc5 hesau us). ISO 25964 in oduces a new cons uc : concep
g oups. Mic o hesau i a e concep g oups. Ano he way o g oup concep s in ISO 25964
is A ays: hese a e g oups o sibling concep s.
In addi ion, ISO 25964 in oduces he compound equi alence, which was no in ISO
2788. These a e ela ionships used o ep esen compound concep s ha do no exis in a
hesau us, bu can be exp essed as a combina ion o wo o mo e simple concep s (e.g.,
“coal mining” is a compound o “coal” and “mining”).
Ul ima ely, No es se e o cla i y he meaning and applica ion o a e m o concep :
Scope no es, His o ical no es, Edi o no es, Usage no es, e c.
The ocabula y o SKOS includes a ious elemen s ha wo k oge he o ep esen
KOS. These elemen s include concep s, labels, ela ionships, mapping p ope ies,
collec ions, and no es. When mapping o SKOS, skos:Concep Scheme, a s uc u e ha
compiles and o ganizes a se o concep s, can be used o ep esen a hesau us. Each
concep is ep esen ed wi h skos:Concep , and each o hem in u n is iden i ied wi h a
URI. In SKOS, a label is he desc ip o o a concep . Labels can be p e e ed
(skos:p e Label), al e na i e (skos:al Label), o hidden (skos:hiddenLabel). In SKOS, i is
possible o s a e ha a concep is a op concep by using he skos: opConcep O p ope y.
The labels skos:b oade and skos:na owe asse hie a chical ela ionships be ween
concep s.
Fu he , he skos: ela ed label can be used o asse an associa i e ela ionship
be ween wo concep s. The SKOS Collec ions, skos:Collec ion, a e g oups o concep s
which do no need o be ela ed by hie a chical ela ionships. Membe s o a SKOS
Collec ion may come om di e en Concep Schemes. Fo he in e es o hesau us
managemen , his means ha a SKOS Collec ion can be used o ep esen domains o o
g oup concep s om di e en hesau i.
Rega ding in eg i y, such s anda ds as ISO 2788, ISO 25964, o SKOS, es ablish
ce ain in eg i y condi ions ha a hesau us, o a KOS ep esen ed wi h SKOS, should
always espec . The in eg i y condi ions a e “s a emen s wi hin he o mal de ini ion o a
da a model, which a e used o es ablish whe he o no gi en da a a e consis en wi h
espec o he da a model” [13]. In eg i y condi ions de e mine wha is, o is no , alid in
a hesau us o KOS.

2.2 ISO in eg i y condi ions
The in eg i y condi ions o hesau i can be de i ed om he ISO s anda d and a e
p esen ed nex . The new ISO 25964 keeps he es ic ions ha could be in e ed om ISO
2788. Howe e , hey ha e o be adap ed o he change om he e m-based app oach o
he concep -based app oach. In he ollowing, he condi ions a e ou lined.
1. Uniqueness: he e canno be duplica ed elemen s in a hesau us. This means:
a) Each concep o idea has a single e m ha ep esen s i in each language.
Wi h ISO 2788, his implies ha each non-p e e ed e m is linked o only
one p e e ed e m. In ISO 25964, he e mus be only one P e e ed Te m
o each concep in each language.
b) Mic o hesau i (concep g oups in ISO 25964) canno be epea ed.
c) Concep s canno be epea ed. In ISO 2788, p e e ed e ms canno be
epea ed.
d) P e e ed Te ms/concep s, mic o hesau i/g oups o concep s, and a ays,
a e disjoin , i.e., a P e e ed Te m/concep canno also be a
mic o hesau i/g oup o concep s o an a ay.
e) P e e ed e ms canno be used as non-p e e ed e ms. In o he wo ds,
p e e ed e ms and non-p e e ed e ms a e disjoin se s.
2. Only P e e ed e ms/concep s can pa icipa e in hie a chical and associa i e
ela ionships. This means ha , e.g., a Non-p e e ed e m pa icipa ing in some o
hese ela ionships is no allowed acco ding o ISO 2788, o ha a e m canno
pa icipa e in hese ela ionships i s a ed acco ding o ISO 25964.
3. Some ela ionships a e incompa ible: BT and NT ela ionships a e no compa ible
wi h RT ela ionships. Two p e e ed e ms/concep s al eady ela ed by a BT o
NT ela ionship canno be s a ed o be ela ed by an RT ela ionship.
4. Cycles in ol ing hie a chical ela ionships a e o bidden. Fo example, i A BT B
is ue, B BT A is o bidden. This also holds when hie a chical and associa i e
ela ionships a e in ol ed in he cycle. In addi ion, a op e m canno be na owe
han ano he e m.
5. Some ela ionships equi e he exis ence o an in e se ela ionship. Fo example,
i A NT B, hen B BT A should be in e ed.
6. When a e m is dele ed, all he ela ionships i pa icipa es in, should also be
dele ed.
2.3 SKOS in eg i y condi ions
SKOS es ablishes i s own in eg i y condi ions, exp essed in he SKOS Recommenda ion
[13] by a se o axioms. The ones ele an o his wo k a e included6:
S9 - skos:Concep Scheme is disjoin wi h skos:Concep .
S13 - skos:p e Label, skos:al Label and skos:hiddenLabel a e pai wise disjoin
p ope ies.
S14 - A esou ce has no mo e han one alue o skos:p e Label pe language ag.
S19 - The d s:domain o skos:seman icRela ion is he class skos:Concep .
S20 - The d s: ange o skos:seman icRela ion is he class skos:Concep .
S27 - skos: ela ed is disjoin wi h he p ope y skos:b oade T ansi i e.
S37 - skos:Collec ion is disjoin wi h each o skos:Concep and
skos:Concep Scheme.
2.4. Compa ison o in eg i y es ic ions in ISO and SKOS
A compa ison o he in eg i y es ic ions be ween ISO s anda ds and SKOS is no
included in he documen s p oduced by he ISO wo king g oup. Howe e , i is help ul o
p e iew which hesau us in eg i y es ic ions could be expec ed o be suppo ed in SKOS
ools, and which should be an added alue o hesau us ools. Table 1 summa izes he se
o simila i ies and di e ences be ween SKOS and ISO ha a e ele an o in eg i y
checking. While i is logical o expec o ind suppo o he es ic ions co e ed in bo h
s anda ds in any ool, i is no he same o es ic ions speci ic o hesau i.
Table 1: In eg i y in ISO s anda ds and SKOS: simila i ies and di e ences.
ISO es ic ion SKOS equi alence
Cond. 1a: Only one P e e ed Te m o each
concep SKOS axiom S14
Cond. 1b: Mic o hesau i/concep g oups canno
be epea ed No in SKOS
Cond. 1c: P e e ed e ms/concep s canno be
epea ed No in SKOS
Cond. 1d: P e e ed Te ms/concep s and
Mic o hesau i/concep g oups a e disjoin SKOS axioms S9 and S37
Cond. 1e: P e Te ms, Non-P e Te ms, ... disjoin
se s SKOS axiom S13
Cond. 2: Only P e Te ms/Concep s pa icipa e in
seman ic ela ionships SKOS axioms S19 and S20
Cond. 3: Incompa ible seman ic ela ionships SKOS axiom S27
Cond. 4: Fo bidden cycles No in SKOS
Cond. 5: In e se ela ionships No in SKOS
As can be no ed om Table 1:
Axiom S14 gua an ees ha he e is no mo e han one p e e ed e m (p ope y
hasP e e edLabel in ISO 25964) o each concep , ha is, i gua an ees condi ion
1a.
SKOS axioms S9 and S37 gua an ee ha a p e e ed e m/concep canno be, a
he same ime, a mic o hesau us/g oup o concep s (condi ion 1d). This is ue
bo h wi h hesau i in which mic o hesau i ha e been ep esen ed wi h
skos:Concep Scheme, e.g., he UKAT hesau us, and wi h hesau i in which
skos:Collec ion has been used o his aim, which is he p oposal made in [15].
Axiom S13 gua an ees ha e ms used as p e e ed labels a e no also used as
non-p e e ed labels (condi ion 1e), o , in he ISO 2788 o m, ha a p e e ed
e m is no also a non-p e e ed e m.
Axioms S19 and S20 gua an ee ha only p e e ed e ms/concep s pa icipa e in
seman ic ela ionships (condi ion 2).
Axiom S27 ensu es he incompa ibili y o basic ela ionships (condi ion 3).
Howe e , as men ioned be o e, i is in e es ing o de ec he in eg i y condi ions om
hesau i ha a e no included in SKOS, as hey a e he ones ha will mo e p obably
de e mine he di e ences be ween a SKOS-o ien ed ool and a hesau us-o ien ed ool. In
addi ion, he in oduc ion o he ela ions USE+ and UF+ be ween e ms o ep esen
compound concep s in ISO 25964 adds a new challenge o hesau us ools. The ISO
es ic ions ha canno ind an equi alen es ic ion in SKOS, p esen ed in Table 1, a e
in e p e ed as ollows:
1. In SKOS, he epe i ion o labels does no imply a duplici y o concep s; hence,
e en i no ecommended, duplici y is no es ic ed [14, Sec ion 2.2.1, Appendix].
Fo example, i wo SKOS concep s sha e he same P e e ed label, i is no
inconsis en in SKOS. Howe e , wo concep s sha ing a P e e ed e m should no
be possible in a hesau us. Consequen ly, condi ions 1b and 1c do no ha e an
equi alen es ic ion in SKOS. E en i some wo ks abou SKOS alida ion ha e
conside ed his possibili y as an imp o emen in quali y checking o KOS, o
which hei edi o s a e wa ned [16, 23], his is no he same as a es ic ion in he
sense es ablished in ISO hesau i s anda ds. SKOS does no ha e an equi alen
in eg i y es ic ion and, consequen ly, i has no been assumed by SKOS ools.
2. In SKOS, cycles in hie a chical ela ionships a e possible, in opposi ion o
condi ion 4 o hesau i. Fo example, A skos:b oade B and B skos:b oade A (see
sec ion 8.6.8 o [13]) is consis en in SKOS, some hing ha would be inconsis en
in an ISO alid hesau us.
3. In SKOS, he e is no in eg i y condi ion associa ed o he ac ha skos:na owe
and skos:b oade a e in e se ela ionships. The e a e only logical dependencies
ha pe mi he p esence o a s a emen such as A skos:na owe B en ails B
skos:b oade A o be in e ed (see sec ion 1.5 o [13]). Howe e , he p esence o
only one o hem is consis en wi h he SKOS da a model, which wo ks wi h he
“open wo ld assump ion”. Tha is, he in eg i y condi ion 5 is no equi ed by he
SKOS ecommenda ion.
4. In SKOS, only concep s can pa icipa e in ela ionships, so i is no possible o
ela e labels, as his would imply he USE+ and UF+ ela ionships o ISO 25964.
In SKOS-XL, labels a e p omo ed o objec s, which implies ha hey can be
ela ed; his is close o he possibili y o ela ing e ms as conside ed in ISO
2594. Howe e , e en his ex ension o SKOS has limi a ions o o e he ull
powe o ISO 25964 [24].
In sho , a SKOS ool should no ejec a KOS (Knowledge O ganiza ion Sys em)
wi h cycles o epea ed labels, e en i i checks and wa ns abou hese quali y issues, as
some ools al eady do [16, 23]. Indeed, cycles can be co ec ly included in some KOS (le
us conside , o example, classi ica ions, glossa ies, e c.), and a e no e en a eason o
wa ning. Howe e , a hesau us ool should ejec a hesau us wi h some o hese
p oblems. In addi ion, some en ailmen s ha should be au oma ed o hesau i, such as
he inclusion o ecip ocal NT/BT ela ionships, should no be gene alized o KOS. A
hesau us ool should au oma ically add ecip ocal ela ionships, which canno be
eques ed o a KOS ool. In consequence, he ype o ool used condi ions he
expec a ions a hesau us edi o should ha e du ing he p ocess o c ea ing/edi ing a
hesau us conce ning he suppo p o ided by he ool.
3. Me hodological amewo k
The a ge issue o his pape is in eg i y managemen , a c ucial issue o ensu e he
co ec ness and quali y o any hesau us. The me hodological amewo k, as has al eady
been poin ed ou , has i s s a ing poin in a p e ious p oposal [18]. Now, howe e , a
e iew o he amewo k o in eg i y suppo is o e ed. This esea ch akes in o accoun
he ISO 25964 hesau us s anda d, which was no a ailable when he p e ious amewo k
was de eloped. Sec ion 3.1 p esen s he me hodology ollowed o he adap a ion o he
e alua i e amewo k. In heading 3.2, he changes om ISO 2788 o ISO 25964 a e
analyzed. In sec ion 3.3, he es s in he in eg i y sui e a e shown, while heading 3.4
in oduces he hesau i used o he e alua ion.
3.1 Me hodology o he adap a ion o he e alua ion amewo k
om ISO 2788 o ISO 25964
ISO 25964 was used as a guide o he e ision ca ied ou . O he possibili ies could
ha e been based on he e ision o he hesau us ools. Howe e , as he adap a ion o he
ISO 25964 s anda d is s ill in p og ess, using he s anda d as a guide was he only
gua an ee o ob ain a e ision in which all changes a e included, i espec i e o whe he
hey ha e al eady been e lec ed in he ools. The s eps ollowed o he e ision a e:
1. Re ision o ISO 25964 and he publica ions ea ing he main no el ies i includes
wi h espec o ISO 2788.
2. Iden i ying he se o cons uc s in oduced in ISO 25964 o he i s ime, o ha
ha e changes wi h espec o he p e ious s anda d.
3. Loca ing he in eg i y ules p esen in ISO 25964.
4. Upda es o he in eg i y ules al eady p esen in ISO 2788 o be complian wi h
ISO 25964.
5. Compa ison o ISO 25964 in eg i y ules and SKOS ules.
6. Re ision o in eg i y es s o e lec he conclusions om he p e ious s eps.
3.2 Analysis o he changes needed o adap he in eg i y sui e o
ISO 25964
Some modi ica ions om ISO 2788 o ISO 25964 ha e in ol ed changes in he in eg i y
sui e ha a e eally signi ican .
Wi h ISO 25964, i is necessa y o check he elimina ion o cons uc s whose
p esence becomes mo e ele an in his new s anda d: a ays, compound
equi alence, and e ms. I is necessa y o check ha hei dele ion is ca ied ou in
an o de ed manne , i.e., he ela ionships hey pa icipa e in a e dele ed in cascade.
The new es s, 15, 16, 19, and 20, ha e been included in he sui e (see Table 2).
desi ed si ua ions and he esponsibili y o he consis ency o he hesau us is ans e ed
o he edi o him/he sel .
4.3. VocBench
VocBench11 is a web-based, mul ilingual, collabo a i e de elopmen pla o m o
managing OWL on ologies, SKOS(XL) hesau i and gene ic RDF da ase s. VocBench
uses Seman ic Tu key, an open-sou ce pla o m o Knowledge Acquisi ion and
Managemen , om he ART Resea ch G oup a he Uni e si y o Rome To Ve ga a. The
es s ha e been applied o VocBench 3, he e sion eleased in Sep embe 2018.
The esul s o VocBench a e shown in he six h column o Table 3. This ool suppo s
some es s e e ing o he ISO 25964 ha did no suppo he p e ious ones, such as
hose ela ed wi h a ays. The in eg i y check in VocBench is ca ied ou in wo ways, a
he ime o c ea ion o he cons uc , which is e lec ed in he M+I alues in Table 3, o
h ough a speci ic menu called “In eg i y Cons ain Valida o ”, which collec s a se o
alida ion i ems ha can be used o assess some in eg i y cons ain s, o example
“Concep s ela ed disjoin ela ions”, “Hie a chical edundancies”, o “Cyclic hie a chical
concep s”. When he in eg i y alida ion was o e ed by means o his menu, i has been
e lec ed in he able wi h he alue ‘M’.
Acco ding o he help o he p og am, he in e ence o ela ions in VocBench depends
on he RDF s o e used. In he es s execu ed o his p oo o concep , he implemen a ion
has been made ollowing he de aul se ings o e ed by VocBench, which a e adequa e
o in oducing he Minimal ad-hoc hesau us (Figu e 1 (b)).
The suppo o in eg i y checking in VocBench is qui e comple e. Pe haps he mos
ema kable obse a ion conce ns i s managemen o cycles. The e is no op ion in his ool
o de ec he ype o hie a chical cycles in oduced in es 10, which conce ns a
combina ion o RT and NT ela ionships o make up a cycle. Ne e heless, an op ion
appea s in he “In eg i y Cons ain Valida o ” menu o alida ing he in eg i y when a
cycle exi s/occu s be ween wo concep s ela ed by skos: ela ed and
skos:b oade T ansi i e ela ionships. This is a bi puzzling because i is possible, in his
ool, o use he p ope ies skos: ela ed and skos: ansi i e o ob ain he ype o cycle
es ed in es 10. E en i his does no imply ha he ool ails in his es (as he in e ence
o e ed by he RDF s o e used may be able o de ec he cycle in oduced wi h he
skos: ela ed - skos:b oade T ansi i e check), we belie e ha o e ing he possibili y o
checking in eg i y on he same p ope ies used du ing he c ea ion o he hesau us,
skos: ela ed and skos: ansi i e in his case, would acili a e he end-use ’s unde s anding
o he unc ionali y o he applica ion.
Finally, a easonable beha io o VocBench is obse ed in he es s ha a ec he
dele ion ac ions. The applica ion ejec s dele ions ha equi e in eg i y and, in o he
cases, p esen s a comple e se o alida ion i ems inside he menu “In eg i y Cons ain
Valida o ”.

4.4. Analysis
Some es s p epa ed o he new ele an cons uc s in ISO 25964, such as es 18, a e no
applicable in he ools e alua ed ( hey ha e been ma ked as 'No appl.' in able 3), as he
ools we e s ill no comple ely adap ed o he ISO 25964 s anda d a he momen o hese
p oo s. In ac , ISO 25964 is ex emely wide, and mo e es ic i e and speci ic han
SKOS. The co espondences o he new cons uc s o ISO 25964 o SKOS cons uc s (i
should be bo ne in mind ha SKOS is used by hese ools o ep esen and s o e hesau i)
a e no as clea as hey a e o basic cons uc s ha we e al eady in ISO 2788, and whose
co espondences we e documen ed in [14]. A ques ion ha could a ise is: Is i wo h
including in he amewo k es s ha canno be applied o he ools e alua ed? The
answe is ha i is wo h ha ing hese es s in he amewo k: he di icul ies o
implemen ISO 25964 in i s en i e y canno condi ion he de ini ion o he amewo k.
Con e sely, he amewo k should con o m o he s anda d and be p epa ed o he
momen when he ools will be eady o suppo ISO 25964 comple ely. A e all, i is a
amewo k o e alua e he suppo o ISO s anda ds in hesau us ools.
Table 3: In eg i y suppo in PoolPa y, SKOSEd and VocBench.
Tes ISO 2788 ISO 25964 PoolPa
y
SKOSE
d
VocBench
1 2 P e Te ms o 1 Non-
P e Te m
2 P e Labels o a concep M+I M+I M+I
2 Mic o hesau us =
Mic o hesau us
Concep g oup = Concep
g oup
M-I M-I M+I
3 P e Te m = P e Te m Concep = Concep M M-I M+I
4 P e Te m =
Mic o hesau us
Concep = Concep g oup M-I (No
Appl.)
M
5 P e Te m = NonP e Te m P e Label = NonP e Label M+I M-I M+I
6a RT/NT/BT +
NonP e Te m and Non
P e Te m
RT/NT/BT + Te m M+I M+I M+I
6b NT/BT/RT + P e Te m
and NonP e Te m
RT/NT/BT + Te m M+I M+I M+I
7 RT + NT/BT RT + NT/BT M+I M-I M
8 NT + BT NT + BT M+I M-I M
9 NT + Top Te m NT + Top Concep M+I M-I M
10 NT + RT (cyclic) NT + RT (cyclic) M M-I M
11 NT + NT (cyclic) NT + NT (cyclic) M+I M-I M
12 Dele e NT/BT Dele e NT/BT M+I M M+I
13 Dele e RT Dele e RT M+I M M+I
14 Dele e P e Te m Dele e concep M+I M M+I
15 Dele e NonP e Te m Dele e (No (No (No
SimpleNonP e Te m Appl.) Appl.) Appl.)
16 Dele e Mic o hesau us Dele e concep g oup M+I M M+I
17 Dele e Top e m Dele e op concep M+I M M+I
18 Dele e a ay M+I (No
Appl.)
M+I
19 Dele e compound concep (No
Appl.)
(No
Appl.)
(No
Appl.)
20 Dele e submic o hesau us Dele e SubG oupO /-
Supe G oupO el
(No
Appl.)
(No
Appl.)
(No
Appl.)
Tes ing h ee di e en ools has helped o co obo a e he in e es o compa ing he
in eg i y es ic ions o ISO 25964 and SKOS. In ac , some esul s o he expe imen s on
hese ools (di e ences in beha io in some es s) had been o eseen as possible, due o
he compa ison discussed in sec ion 2.4. Mo eo e , hanks o ha compa a i e analysis,
an explana ion abou hese di e ences in beha io was al eady a ailable. The
expe imen s ha e con i med he suspec ed limi a ions wi h new cons uc s and s uc u es
in ISO 25964, o ha ge a g ea e ele ance han hey had in ISO 2788: collec ions,
polyhie a chy, a ays, compound concep s, e c.
PoolPa y has a good in eg i y suppo , well aligned wi h hesau us s anda ds, and he
use in e ace is clea and in ui i e. Limi a ions a e ound in he duplica ion o labels
when collec ions a e in ol ed, and in he consequences o he policy chosen o dele ions
when polyhie a chy is p esen in he hesau us.
SKOSEd does no gua an ee some in eg i y ha would be expec ed in hesau us. Two
easons explain his. Fi s , he SKOS ecommenda ion is less es ic i e han hesau us
ecommenda ions; his compa ison was de eloped in sec ion 2.3. The second one is
ela ed o he limi a ions o he OWL SKOS on ology loaded in P o égé: some SKOS
axioms a e missing in he SKOS on ology ha is e ec i ely loaded on P o égé, a lack
which is i sel ela ed o some limi a ions o OWL [28, 29]. The analysis o OWL
limi a ions is beyond he scope o his pape , o which he in e es ed eade is e e ed o
hese e e ences and li e a u e conce ning OWL easoning.
VocBench suppo s new cons uc s o ISO 25964, such as a ays and g oups o
concep s, besides o e ing a se o alida ion u ili ies ha can be used indi idually and an
ex ensi e and sui able lis , al hough i does no ma ch exac ly wi h he es s used he e.
Checking he esul s o es s 6a, 6b and 7 would p obably be easie o he end-use i he
in e se ela ionships in e ed we e immedia ely p esen ed in he in e ace ha shows he
desc ip ion o each cons uc . This would make i easie o he end-use o check hey
ha e been co ec ly in e ed.
Finally, we conside ha he es sui e designed o check he in eg i y managemen in
he hesau us edi ing ools has been e ec i e and he e o e allows us o know he deg ee
o help hese ools p o ide he use o gua an ee he consis ency and quali y o he
hesau us.
5. Conclusions
This pape p esen s a me hodological e alua ion amewo k o in eg i y suppo in
hesau us ools, whose a ge communi y is hesau i edi o s, conce ned wi h ob aining
hesau i ha a e complian wi h pe inen hesau i ecommenda ions. I is o ien ed
owa ds he design o hesau us managemen ools and hei use s’ expe ience. In eg i y is
one o he mo e impo an issues when c ea ing and edi ing hesau i, as iola ing in eg i y
ules can be done unconsciously. Thus, he help p o ided by ools in de ec ing possible
iola ions and p e en ing hem is aluable, as his will con ibu e o he quali y o he
hesau i c ea ed wi h hem. Being able o e i y wha help can be ob ained om a
p ospec i e ool o be used o hesau us edi ing can i sel be help ul o hesau us edi o s
con on ed wi h he ask o selec ing a ool. This is wha is o e ed in his amewo k. In
addi ion, his wo k can be ele an o SKOS o hesau us de elope s in e es ed in c oss-
using hei abili ies, applying a SKOS ool o ake ca e o , o publish, a hesau us in he
seman ic web o ice e sa.
This is a quali a i e me hodology, which is jus i ied by wo main a gumen s. Fi s , he
ele an issue o i s a ge public ( hesau us edi o p o essionals) is being able o de ec
and co ec inconsis encies in he hesau us being edi ed. Whe he he ool used is capable
o no o helping hem in his ask is he ele an ques ion. Second, as has al eady been
a gued in he In oduc ion, he size o a hesau us is no a p oblem o hesau us
managemen ools.
The inclusion o SKOS and ISO 25964 is a ele an no el y o his p oposal, as
compa ed wi h some p e ious p oposals ela ed o he e alua ion o hesau i o hesau i
ools and gene al amewo ks o he Seman ic Web. This is a guide o compa ing
hesau us ools ha hesau i edi o s can apply di ec ly, some hing which is o he wise no
a ailable.
E en i SKOS is used by he ools e alua ed o ep esen hesau i, i is impo an o
ema k ha his p oposal is no concei ed o SKOS ools, bu o hesau i ools. A
p oposal o SKOS ools should di e in he issues e alua ed and he es s, and he
di e ences in in eg i y would be signi ican . The analysis ca ied ou shows ha some
issues cha ac e is ic o hesau i, such as es ic ions in cycles, a e no well suppo ed
when SKOS is used o hei ep esen a ion. This was also e i ied wi h he expe imen al
e alua ion on SKOSEd and PoolPa y. This o e s some indica ions o he e o needed
in he mapping o ISO 25964 and SKOS.
This p oposal was i s designed aking in o accoun he ISO 2788 s anda d, which is
s ill suppo ed by hesau us ools, and e ised o con o m o ISO 25964. The changes ha
ISO 25964 in oduces wi h espec o ISO 2788, and he modi ica ions i implies on his
amewo k, ha e been analyzed. I was impo an o keep bo h pe spec i es in pa allel, as
a comple e adap a ion o hesau i and ools o ISO 25964 may be a long p ocess. The
u u e will show how hesau i ools adap o he new ISO s anda d.
The p oposal made in his pape would ind an ideal complemen in he s udy o
unc ionali ies and use in e ac ion wi h hesau us managemen ools. We conside he
powe ul app oach o VocBench o suppo he collabo a i e wo k essen ial in he edi ion
o la ge hesau i. The suppo o in eg i y in hese ools should always come wi h good
quali y in use in e aces. This is conside ed as u u e wo k.
No es
1. Fo example, Eu oVoc, he hesau us main ained by he EU Publica ions O ice, is
used in a la ge numbe o egional pa liamen s adap ed o he speci ic needs o each
ins i u ion ela ed o indexing and e ie al, ha is, hey spawn a ian s o
cus omiza ions o he o iginal hesau us. Adap a ions o a ian s o he ERIC
Thesau us a e c ea ed o a ious educa ional scena ios, as signi ican poli ical o
geog aphical di e ences should be add essed in he ocabula y, while a ian s om
he UNESCO hesau us, in a wide hema ic a ea, se e as addi ional examples. These
examples illus a e ha eusing sha ed hesau i is indeed a common p ac ice.
2. The e m “language” is used he e wi h he same meaning ha he SKOS
Recommenda ion uses i in i s In oduc ion: "SKOS also p o ides a ligh weigh ,
in ui i e language o de eloping and sha ing new knowledge o ganiza ion sys ems"
[13].
3. SKOS Da ase s. W3C. h ps://www.w3.o g/2001/sw/wiki/SKOS/Da ase s
4. The size o some o he mos well-known and used hesau i illus a e his: he UKAT
hesau us has 13,976 desc ip o s (p e e ed e ms) and 6,639 non-p e e ed e ms, and
he ile size is 9.9MB; Eu oVoc, he hesau us main ained by he Publica ions O ice
o he Eu opean Union, has 6,883 p e e ed e ms and 8,348 non-p e e ed e ms, he
ile being 20.4MB.
5. h p://eu o oc.eu opa.eu/
6. We ha e conside ed all hose ules ha can be used o alida e he co ec ion o he
da a acco ding o he da a model, e en hough hey a e no lis ed in he SKOS
Recommenda ion as “In eg i y Condi ions”.
7. h p://www.poolpa y.biz/
8. Da e o e alua ion: Feb ua y 2017.
9. h ps://code.google.com/p/skosedi o /
10. The e is no equi alen p ope y o ela ed Concep s in he SKOS Recommenda ion,
i.e., he e is no skos: ela edT ansi i e p ope y.
11. h p:// ocbench.uni oma2.i /
Funding
This esea ch ecei ed no speci ic g an om any unding agency in he public,
comme cial o no - o -p o i sec o s.
Re e ences
[1] Ga cía-Ma co FJ. The e olu ion o hesau i and he his o y o knowledge
o ganiza ion: be ween he swo d o mapping knowledge and he wall o keeping i
simple. B azilian Jou nal o In o ma ion Science: Resea ch T ends 2016; 10(1): 1-
11. doi: 10.22566/b ajis. 10i1.5786
[2] Ga cía-Ma co FJ. Enhancing he Visibili y and Rele ance o Thesau i in he Web:
Sea ching o a Hub in he Linked Da a En i onmen . Knowledge O ganiza ion
2016; 43(3):193-202.
[3] Isaac A. and Bake T. Linked da a p ac ice a di e en le els o seman ic p ecision:
The pe spec i e o lib a ies, a chi es and museums. Bulle in o he Associa ion o
In o ma ion Science and Technology 2015; 41(4): 34-39.
doi:10.1002/bul .2015.1720410411.
[4] Mas o a A, Peponakis M and Kapidakis S. SKOS concep s and na u al language
concep s: An analysis o la en ela ionships in KOSs. Jou nal o In o ma ion
Science 2016; 43(4): 492 - 508. doi:10.1177/0165551516648108.
[5] ISO 25964-1:2011 In o ma ion and Documen a ion - Thesau i and In e ope abili y
wi h O he Vocabula ies - Pa 1: Thesau i o In o ma ion Re ie al. Gene a,
In e na ional O ganiza ion o S anda diza ion, 2011.
[6] ISO 25964-2:2011 In o ma ion and Documen a ion - Thesau i and In e ope abili y
wi h O he Vocabula ies - Pa 2: In e ope abili y wi h o he ocabula ies. Gene a,
In e na ional O ganiza ion o S anda diza ion, 2013.
[7] ISO 2788:1986 Documen a ion - Guidelines o he Es ablishmen and De elopmen
o Monolingual Thesau i. Gene a, In e na ional O ganiza ion o S anda diza ion,
1986.
[8] Cla ke SGD and Zeng ML. F om ISO 2788 o ISO 25964: The E olu ion o
Thesau us S anda ds owa ds In e ope abili y and Da a Modeling. In o ma ion
S anda ds Qua e ly (ISQ) 2012; 24(1): 20-26. doi: 10.3789/isq 24n1.2012.04.
[9] Pas o -Sánchez JA. P oposal o ep esen he UNESCO hesau us o he Seman ic
Web applying ISO-25964. B azilian Jou nal o In o ma ion Science: Resea ch
T ends 2015; 9 (2): 1-8. doi:10.5016/10.5016/1981-16.
[10] Pas o -Sánchez JA, Ma ínez-Méndez FJ and Rod íguez-Muñoz JV. Ad an ages o
hesau i ep esen a ion wi h he Simple Knowledge O ganiza ion Sys em (SKOS)
compa ed wi h p oposed al e na i es. In o ma ion Resea ch 14 (4),
h p://in o ma ion .ne /i /14-4/pape 422.h ml (2009, accessed 4 Ap il 2017).
[11] Hildeb and M, Ossenb uggen JV, Ha dman L and Jacobs G. Suppo ing subjec
ma e anno a ion using he e ogeneous hesau i: A use s udy in web da a euse.
In e na ional Jou nal o Human-Compu e S udies 2009; 67(10): 887-902.
doi:10.1016/j.ijhcs.2009.07.008.
[12] Ju isica I, Mylopoulos, J and Yu, ESK. On ologies o knowledge managemen : An
in o ma ion sys ems pe spec i e. Knowledge and In o ma ion Sys ems 2004; 6(4):
380-401. doi:10.1007/s10115-003-0135-4.
[13] Miles A and Bechho e S. SKOS Simple Knowledge O ganiza ion Sys em
Re e ence. W3C Recommenda ion 18 Augus 2009,
h p://www.w3.o g/TR/2009/PR-skos- e e ence-20090818/ (2009, accessed 22
Ma ch 2017).
[14] Isaac A and Summe s E. SKOS Simple Knowledge O ganiza ion Sys em P ime .
W3C Wo king G oup, No e 18 Augus 2009, h p://www.w3.o g/TR/skos-p ime /
(2009, accessed 25 Ma ch 2017).
[15] Isaac A. Co espondence be ween ISO 25964 and SKOS/SKOS-XL models,
h p://www.niso.o g/apps/g oup_public/documen .php?documen _id=12351 (2013,
accessed 6 Ap il 2017).
[16] Suominen O and Made C. Assessing and imp o ing he quali y o SKOS
ocabula ies. Jou nal o Da a Seman ics 2014; 3(1): 47-73. doi:10.1007/s13740-013-
0026-0.

[17] Noy NF, Sin ek M, Decke S, C ubézy M, Fe ge son RW and Musen MA. C ea ing
Seman ic Web Con en s wi h P o égé-2000. IEEE In elligen Sys ems 2001; 16(2):
60-71. doi: 10.1109/5254.920601
[18] Ma ínez-González MM and Al i e-Díez ML. On he e alua ion o hesau us ools
compa ible wi h he seman ic web. Jou nal o In o ma ion Science 2014; 40(6): 711-
722. doi:10.1177/0165551514545603.
[19] Se e ino F. The Te m De elopmen in he Thesau i o In e na ional O ganisa ions.
The Eu opean Jou nal o De elopmen al Resea ch 2007; 19: 327-351.
doi:10.1080/09578810701289261.
[20] Will LD. So wa e o Building and Edi ing Thesau i,
h p://www. axobank.o g/con en / hesau i-and- ocabula y-con ol- hesau us-
so wa e (2017, accessed 22 Ma ch 2017).
[21] Kless D, Mil on S, Kazmie czak E and Linden hal J. Thesau us and on ology
s uc u e: Fo mal and p agma ic di e ences and simila i ies. Jou nal o he
Associa ion o In o ma ion Science and Technology 2015; 66 (7): 1348-1366.
doi:10.1002/asi.23268.
[22] Alexie V, Isaac A and Linden hal J. On he composi ion o ISO 25964 hie a chical
ela ions (BTG, BTP, BTI). In e na ional Jou nal on Digi al Lib a ies 2016; 17(1):
39-48. doi:10.1007/s00799-015-0162-2.
[23] Made C, Haslho e B and Isaac A. Finding quali y issues in SKOS ocabula ies,
a Xi :1206.1339 (2012, accessed 25 Feb ua y 2017).
[24] Pas o -Sánchez JA. ISO-THES: ampliando SKOS a pa i de la no ma de esau os
ISO 25964. Anua io ThinkEPI 2013; 7: 189-193.
[25] Will L. The ISO 25964 da a model o he s uc u e o an in o ma ion e ie al
hesau us. Bulle in o he Ame ican Socie y o In o ma ion Science and Technology
2012; 38(4): 48–51. doi:10.1002/bul .2012.1720380413
[26] S ella o A, Rajbhanda i S, Tu ba i A, e al. Vocbench: A web applica ion o
collabo a i e de elopmen o mul ilingual hesau i. In: Gandon F, Sabou M, Sack H,
D’Ama o C, Cud é-Mau oux P and Zimme mann A (eds.) The Seman ic Web. La es
Ad ances and New Domains - 12 h Eu opean Seman ic Web Con e ence, ESWC
2015, Po o oz, Slo enia, May 31 - June 4, 2015. P oceedings, Vol. 9088 o Lec u e
No es in Compu e Science. Be lin: Sp inge , 2015, pp. 38-53. doi:10.1007/978-3-
319-18818- 8 3.
[27] Schandl T and Blumaue A. Poolpa y: SKOS hesau us managemen u ilizing linked
da a. In A oyo L, An oniou G and Hy önen E, e al. (eds.) The Seman ic Web:
Resea ch and Applica ions, 7 h Ex ended Seman ic Web Con e ence, ESWC 2010,
He aklion, C e e, G eece, May 30 - June 3, 2010, P oceedings, Pa II, Vol. 6089 o
Lec u e No es in Compu e Science. Be lin: Sp inge , 2010, pp. 421-425.
doi:10.1007/978-3-642-13489-0 36.
[28] Bake T, Bechho e S, Isaac A, Miles A, Sch eibe G and Summe s E. Key choices
in he design o simple knowledge o ganiza ion sys em (SKOS). Jou nal o Web
Seman ics 2013; 20:35-49. doi:10.1016/j.websem.2013.05.001.
[29] Knublauch H. Whe e OWL ails, h p://composing- he- seman ic-
web.blogspo .com.es/2010/04/whe e-owl- ails.h ml (2010, accessed 30 Janua y
2017)