The support of constructs in thesaurus tools from a Semantic Web perspective: framework to assess standard conformance

The suppo o cons uc s in hesau us ools om a Seman ic Web pe spec i e: F amewo k o assess s anda d con o mance M. Me cedes Ma ínez-González Uni e si y o Valladolid, Spain [email p o ec ed] Ma ía-Luisa Al i e-Díez Uni e si y o Leon, Spain luisa.al i [email protected] The inal, published e sion o his a icle is a ailable online. Please check he inal publica ion eco d o he la es e isions o his a icle. [Ma ínez-González, M. M., & Al i e-Díez, M.- L. (2019). The suppo o cons uc s in hesau us ools om a Seman ic Web pe spec i e: F amewo k o assess s anda d con o mance. Compu e S anda ds & In e aces. h ps://doi.o g/10.1016/j.csi.2019.02.003] Abs ac Thesau i a e concep ual ools use ul o achie e seman ic in e ope abili y and eusabili y, which a e ele an goals in he Seman ic Web. Thesau us s anda ds es ablish, among o he issues, he cons uc s ha can appea in a hesau us. The ISO 25964 s anda d o hesau i, which supe sedes ISO 2788, is he e olu ion o he ISO hesau i s anda d o a concep ual app oach close o he Seman ic Web. Howe e , i appea ed when SKOS - he W3C Recommenda ion- was al eady consolida ed as he s anda d o KOS (Knowledge O ganiza ion Sys em) ep esen a ion in he Seman ic Web, including hesau i. The e olu ion om ISO 2788 o ISO 25964, and he ela ionships be ween cons uc s in ISO 2788/ISO 25964 and SKOS, a e s udied in his pape . F om he analysis o his compa ison, a me hodological amewo k, ha ocuses on he cons uc suppo , is p oposed o e alua e he con o mance quali y o hesau us managemen ools. Ta ge eade s a e p o essionals in cha ge o hesau i edi ion. A Seman ic Web pe spec i e is aken o cha ac e ize he e ec ha using SKOS o ep esen hesau i can ha e on he esul s o he assessmen . A p oo o concep o he model’s easibili y was pe o med on wo ools and he analysis o he esul s o his expe imen al alida ion is p esen ed. The conclusions highligh he model’s sui abili y o assessing con o mance o he s anda ds conce ning suppo o hesau us cons uc s. Keywo ds ISO 2788; ISO 25964; Seman ic Web; SKOS; so wa e con o mance; s anda d con o mance; hesau us cons uc s; hesau us s anda ds; hesau us ools 1. In oduc ion Thesau i a e s uc u ed, con olled ocabula ies concei ed o acili a e in o ma ion e ie al. Thesau i add o in o ma ion sys ems he abili y o o e na iga ion h ough a hesau us' ca ego ies o o e ie e documen s ha ha e been classi ied unde one o i s ca ego ies. Mo eo e , he Seman ic Web and linked da a ha e b ough abou a enewed in e es in hesau i as concep ual ools ha can be used o imp o e seman ic in e ope abili y [1–4]. Thei po en ial as suppo o concep -based sea ches, i.e., sea ches in which he use looks o concep s ins ead o e ms in documen con en [1,4,5] is a aluable ea u e in he Seman ic Web con ex . The ad anced abili y o hesau i o manage synonymy, quasi-synonymy and subsump ions be ween concep s makes hem ideal ools o suppo hese sea ches. Examples o well-known hesau i a e: he Ag o oc Thesau us1, c ea ed and main ained by he Food and Ag icul u e O ganiza ion o he Uni ed Na ions (FAO); Eu oVoc2, he Eu opean Union mul ilingual hesau us; he A and A chi ec u e Thesau us3; he UNESCO Thesau us4; he UKAT Thesau us5; he Na ional Ag icul u al Lib a y Thesau us (NALT)6; and he GEne al Mul ilingual En i onmen al Thesau us (GEMET)7. S anda ds a e he ins umen s ha collec he ag eemen o a communi y abou he s anda dized issue. Fo hesau i, he ISO s anda ds de ine wha a hesau us is and wha he cons uc s a e ha a hesau us can use in o de o be a alid con olled ocabula y. The e o e, ools c ea ed o assis hesau us edi o s should con o m o hese ules, ei he by gua an eeing ha hey a e no ansg essed, o by wa ning hei use s abou possible con lic s. In an ideal scena io, a hesau us ool in acco dance wi h he s anda d would gua an ee ha any hesau us edi ed wi h i has cons uc s con o man wi h he s anda d, e.g., au oma ically inse ing any ela ionships ha can be de i ed om hose inse ed by end use s, e c. Some o hese es ic ions can be ound in ISO 25964-Pa 1 [6] and hey a e collec ed and expanded in sec ion 3 o his pape . When ools au oma ically check his con o mance, use s a e g ea ly helped in co ec ing e o s commi ed when c ea ing a hesau us, so hey can be mo e con iden abou he wo k doneand, consequen ly, on he e ec i eness o he ocabula y. As wi h on ologies [7], he in e es in assis ing he end use wi h a sui able checking ool inc eases as he size o he KOS being edi ed is g ea e . In his pape , a me hodological ool o selec ing hesau us managemen ools, by assessing hei con o mance o ISO s anda ds ega ding he suppo o hesau us cons uc s, is p esen ed. I s main public is he hesau us communi y, i.e., in o ma ion managemen p o essionals in ol ed in he de elopmen , main enance and edi ion o hesau i, who need eliable hesau us ools o hese asks. I is wo h no ing ha i is mo e o ien ed owa ds he p ope design o hesau us managemen ools and hei use s’ expe ience, a he han a pu ely heo e ical o logical pe spec i e. The emainde o his pape is o ganized as ollows. Sec ion 2 p esen s he backg ound and pu pose o he wo k. Sec ion 3 s udies he cons uc s in ISO 2788 and ISO 25964, hei e olu ion om ISO 2788 o ISO 25964 and he equi alence wi h SKOS cons uc s. Sec ion 4 p esen s he me hodological amewo k, he sui e o es s used and some indica o s. The indica o s a e used o measu e he con o mance o hesau us so wa e in cons uc suppo . In sec ion 5 he p oo o concep pe o med on wo selec ed hesau us ools is ou lined. Sec ion 6 is de o ed o he discussion o he e ec s ha he e olu ion o he ISO s anda d o hesau i has on he me hodological amewo k. The lessons lea ned om he p oo o concep a e also included in his sec ion. Finally, sec ion 7 collec s he main conclusions ob ained.  1 h p://aims. ao.o g/ es - egis y/ ocabula ies/ag o oc-mul ilingual-ag icul u al- hesau us 2 h ps://publica ions.eu opa.eu/en/web/eu- ocabula ies/ h-da ase /-/ esou ce/da ase /eu o oc 3 h p://www.ge y.edu/ esea ch/ ools/ ocabula ies/aa / 4 h p:// ocabula ies.unesco.o g/b owse / hesau us/en/ 5 h p://www.uka .o g.uk/ 6 h ps://agclass.nal.usda.go /ag .sh ml 7 h ps://www.eione .eu opa.eu/geme /en/ hemes/ 2. Backg ound and pu pose The ISO 2788 s anda d [8] es ablished he cons uc s a hesau us can ha e and he in eg i y es ic ions ha mus be espec ed. The s anda d o monolingual hesau i, o iginally published in 1974,was e ised and eedi ed in 1986. In addi ion, he ISO 5964 s anda d [9] es ablishes he main p ocedu es o he ea men o se e al languages in he same knowledge esou ce, iden i ying he main p oblems ela ed o seman ic equi alence. Howe e , he “ e i al” o hesau i as concep ual ools in Seman ic Web applica ions esul ed in he upda e o he hesau us ISO s anda d. Be ween 2011 and 2013, he In e na ional O ganiza ion o S anda diza ion (ISO) published ISO 25964 [6,10], he hesau us s anda d ha supe sedes ISO 2788. I is an e olu ion om he app oach o e m-based hesau i, p esen in ISO 2788, o concep -based hesau i [11,12]. Wi h he e olu ion om ISO 2788 o ISO 25964, he hesau us communi y emb aces he Seman ic Web ision. This concep -based app oach is close o he idea o concep ual sea ches ha unde lies seman ic in o ma ion e ie al [5,13]. All o his in an en i onmen o seman ic in e ope abili y, in which hesau i a e eused in open con ex s. Reuse is de ini ely s eng hened when using s anda ds o sha e hesau i8 [1,11]. ISO 25964 appea ed a e he W3C ecommenda ion o ep esen ing KOS in he Seman ic Web, SKOS (Simple Knowledge O ganiza ion Sys em) [14].SKOS p o ides a way o ep esen knowledge o ganiza ion sys ems (KOS) using RDF. SKOS is a ailable as an OWL on ology [15]. SKOS al eady used he concep -based app oach. Du ing he pe iod when ISO 2788 was he a ailable s anda d o hesau i, he bene i s o using W3C s anda ds such as SKOS led o se e al hesau i being ep esen ed wi h SKOS, including he mos impo an hesau i lis ed in he i s pa ag aph o his In oduc ion; a lis o which new i ems a e cons an ly being added [12,16]. Mo eo e , hesau us ools we e adap ed o use RDF/SKOS as he unde lying language9 o s o e and sha e he hesau i hei use s c ea ed and edi ed. Howe e , SKOS is in ended o use in a wide se o KOS, including hesau i, bu also olksonomies, glossa ies, e c. This has equi ed wo k on he equi alence be ween he ISO s anda ds and he W3C s anda d (SKOS). The equi alence be ween hesau i cons uc s, as de ined by ISO 2788, and SKOS cons uc s was i s co e ed by guidelines p o ided in he SKOS P ime Guide [17]. The equi alence be ween ISO 25964 and SKOS is deal wi h in [18]. Some mappings a e di ec , bu he e a e co espondences which a e mo e di icul o make10. Jus as he ISO s anda d o hesau i can be compa ed wi h SKOS, hesau i can also be compa ed wi h on ologies. Thesau i and on ologies a e KOS which can be used o o ganize knowledge om a communi y. E en hough se ious e o s ha e been made o ob ain on ologies om hesau i and o he KOS [19], he e a e ele an di e ences  8 Fo example, Eu oVoc, he hesau us main ained by he EU Publica ions O ice, is used in a la ge numbe o egional pa liamen s adap ed o he speci ic needs o each ins i u ion ela ed o indexing and e ie al, ha is, hey spawn a ian s o cus omiza ions o he o iginal hesau us. Adap a ions o a ian s o he ERIC Thesau us a e c ea ed o a ious educa ional scena ios, as signi ican poli ical o geog aphical di e ences should be add essed in he ocabula y, while a ian s om he UNESCO hesau us, in a wide hema ic a ea, se e as addi ional examples. These examples illus a e ha eusing sha ed hesau i is indeed a common p ac ice. 9 The e m “language” is used he e wi h he same meaning as in he In oduc ion o he SKOS Recommenda ion: "SKOS also p o ides a ligh weigh , in ui i e language o de eloping and sha ing new knowledge o ganiza ion sys ems" [14]. 10 Fo example, concep s in ISO 25964 a e concep s in SKOS, bu ela ions like hasSubG oup/hasSupe G oup in ISO 25964 do no ha e a di ec equi alen in SKOS. be ween on ologies and hesau i [20,21]. These di e ences a e enough o jus i y he exis ence o a Seman ic Web s anda d, SKOS, speci ically designed o ep esen KOS in he Seman ic Web con ex [3]. One ele an di e ence, enough o suppo his a gumen , is p o ided by he ISO 25964 s anda d: on ologies deal wi h classes, which ha e ins ances (indi iduals), while hesau i deal wi h concep s11. I is no in he in e es o his pape o ge in o he analysis o on ologies and hesau i simila i ies and di e ences, o which eade s a e o wa ded o he e e ences men ioned abo e. Howe e , hese di e ences p o e ha speci ic wo k abou hesau i is o in e es , especially when some hesau i a e well es ablished, consolida ed KOS ha depend on he consensus o wide communi ies (see, e.g., UNESCO, Eu oVoc, Ag o oc, and he o he hesau i men ioned in i s pa ag aph o he In oduc ion), some hing di icul o achie e when i e e s o ag eemen on wha knowledge is ele an o a gi en communi y. Howe e , he use o on ologies is compa ible wi h main aining hesau i. Fo example, he use o legal on ologies, such as he one de eloped by he Publica ions O ice o he Eu opean Union [22], is no in con lic wi h he use by his ins i u ion o long-s anding hesau i such as Eu oVoc in i s in o ma ion sys ems. In pa icula , his hesau us main ained by he Publica ions O ice o he Eu opean Union has been selec ed o illus a e, wi h examples, he cons uc s p esen ed in sec ion 3, as well as o he p epa a ion o he ad hoc hesau us used in he es s o his wo k. This is he con ex in which we place his s udy. The aim o his wo k is o p o ide a me hodological amewo k o selec ing hesau us ools, by assessing hei con o mance o ISO s anda ds. To achie e his goal he wo king me hodology was based on he li e a u e e iew and he compa a i e s udy o he s anda ds. The a ge issue o his pape is cons uc suppo , a basic issue o ensu e he co ec ness and quali y o any hesau us. This wo k is pa o a mo e gene ic amewo k [23], ini ially designed acco ding o he ISO 2788 s anda d, which is s ill suppo ed by many hesau us ools. He e, howe e , i is p esen ed wi h he e ision needed o adap i o ISO 25964. In he ollowing, he me hodological ool will be e e ed o as ‘ he amewo k’. The e m amewo k is unde s ood he e acco ding o [24,25] as a 'so wa e e alua ion me hod sui able o sys em compa ison'. I includes he me hodology, he se o issues o e alua e, he se o da a ( hesau i in his case) o use in he e alua ion, and a se o indica o s o he quali y o so wa e con o mance. A ele an ad an age o his amewo k is ha he con o mance equi emen s speci ied by ISO 25964 a e co e ed by a se o es s (see Sec ion 4.2 and he Appendix), each o which ope a es as an indi idual ins umen wi h p ede ined inpu s and possible esul s. The e o e, hey can easily be pe o med by people in cha ge o selec ing a hesau us ool, who can o ganize he execu ion o he se o es s as hey p e e , selec ing he ones o pe o m, he o de in which hey a e pe o med... The indi idual esul s o he ex s execu ed can be added la e o ob ain indica o s abou he quali y o he ool wi h espec o i s con o mance o hesau i  11 Reasoning bene i s om his, meaning ha all indi iduals o ins ances inhe i he p ope ies o he classes hey belong o.Howe e , hesau i deal wi h concep s, ideas which a e no ins an ia ed, i.e., his ype o easoning canno be applied. Fo example, in an on ology, “Ea h” is an ins ance o he “Plane ” class and inhe i s he p ope ies o a plane , while in a hesau us bo h, “Ea h” and “Plane ”, a e concep s. ISO 25964-2:2011 p o ides an example: “Ea h and plane s migh be wo concep s in a hesau us, linked by a hie a chical BT/NT ela ionship. Op ionally, he ins an ial na u e o he ela ionship could be made explici by using he ags BTI and NTI. In an on ology conce ned wi h celes ial mechanics, Plane could be es ablished as a class, and Ea h as an indi idual (since he la e is unique in he domain, whe eas he e is mo e han one plane ). The wo could be linked by a class asse ion. The p esence o such asse ions and axioms allows an indi idual o ‘inhe i ’ all he p ope ies o he classes o which i belongs”. s anda ds. This pape p o ides an enhanced, in-dep h and de ailed analysis o he cons uc suppo p oblem and he es s designed o e alua e i s suppo in hesau us ools, none o which could be included in he gene ic o e iew p esen ed in e e ence [23]. This amewo k is designed o hesau i. E en hough hesau i a e concep ual ools o knowledge o ganiza ion, as on ologies and o he KOS, hei di e ences jus i y speci ic wo ks o each ype. In addi ion, al hough hesau i mus con o m o ISO s anda ds, i is wo h analyzing hesau us issues ha a e also p esen in SKOS and hose ha a e speci ic o hesau i, because SKOS p o ides mo e lexibili y han hesau us s anda ds (as a hesau us is jus a ype o KOS) and because SKOS is widely used o ep esen hesau i. This analysis p o ides he key o poin ou which es s should be supe ised mo e ca e ully in a p ac ical e alua ion because o he p obabili y o ob aining nega i e esul s. Thus, in sec ion 3, he SKOS Recommenda ion is compa ed wi h ISO s anda ds. The me hod used o adap he me hodological amewo k is p esen ed in de ail in Sec ion 4.1 in o de o enable a be e unde s anding o i as a whole. Howe e , we ha e chosen o b ing o wa d a sec ion dedica ed o his issue (Sec ion 3) o p esen he e ision o he cons uc s in ISO 2788 and ISO 25964 in de ail, and he equi alence wi h SKOS. In o de o p o ide a p oo o concep o he easibili y o he amewo k, i was applied o wo ools, SKOSEd and PoolPa y. These esul s a e included. Fo his wo k, in which he new ISO 25964 s anda d is aken in o accoun , ools al eady using SKOS we e conside ed mo e in e es ing. Howe e , while SKOSEd is, as i s name indica es, a ool c ea ed o edi and manage SKOS sys ems, PoolPa y is a ool speci ically c ea ed o hesau i. Some di e ences will be commen ed on. A pe son esponsible o selec ing a hesau us ool could conside hese di e ences ele an o he selec ion. Howe e , his kind o decision depends on he in ended use o a so wa e, which canno be o eseen in a gene ic amewo k. This wo k also di e s om hose wo ks ha es he quali y o KOS ep esen ed wi h SKOS [26]. While, in he said wo ks, he goal is o analyze he quali y o he SKOS ep esen a ion o con olled ocabula ies (which include o he KOS han hesau i) and o p o ide sugges ions o co ec he p oblems de ec ed, in ou me hodological amewo k, he in e es ocuses on helping hesau i edi o s o selec ools ha assis hem in hesau i edi ion. The e a e su eys o hesau us ools [27–29]. In hese, such ea u es as he c ea ion and managemen o hesau i, and ea u es ela ed o so wa e ou pu ( he display o hesau i on he sc een o p in e , o ins ance), ha e been ouched upon. Besides, he e a e ools o e alua e on ologies and Seman ic Web ools [30–32]. Howe e , hey a e p io o he newes hesau us s anda ds and he Seman ic Web pe spec i e, o hey do no o e a speci ic me hod o hesau us ools. The p oposal p esen ed he e is o iginal due o i s Seman ic Web o ien ed app oach and i s ocus on hesau i. In addi ion, his p oposal co e s cons uc suppo in de ail, aking in o accoun ISO 2788, bu also SKOS and ISO 25964.  3. Thesau us Cons uc s: om ISO 2788 o ISO 25964. Equi alence wi h SKOS In his sec ion, he cons uc s ha a hesau us can ha e a e p esen ed. Bo h cons uc s in ISO 2788 and ISO 25964 a e co e ed. The pa allelism be ween bo h s anda ds, and he equi alence wi h SKOS cons uc s, a e co e ed a he same ime ha cons uc s a e in oduced. The explana ions a e illus a ed wi h examples om he Eu oVoc hesau us. In addi ion, when cons uc s a e new addi ions in ISO 25964, o hey acqui e a ele ance hey did no ha e in ISO 2788, his is ema ked. The equi alence be ween hesau i cons uc s, as de ined by ISO 2788, and SKOS cons uc s was i s co e ed by some guidelines p o ided in he SKOS P ime Guide [17]. The equi alence be ween he ISO 25964 hesau i cons uc s and SKOS is deal wi h in [18]. I should be no ed ha al hough some mappings a e a he di ec , o he equi alences a e mo e open, i.e., he e a e a ious possible mappings. Wha is p esen ed in his sec ion is essen ial knowledge o unde s and he pape . The equi alence be ween he cons uc s o bo h ISO s anda ds and SKOS is he esul o he e ision ca ied ou as pa o he adap a ion me hodology o he amewo k (see sec ion 4.1). Howe e , gi en i s in insic ela ionship o he p esen a ion o he cons uc s, we ha e decided o p esen i in his sec ion, o acili a e he eade 's unde s anding o he equi alences be ween s anda ds, which will be necessa y o unde s anding how o " ansla e" an ISO cons uc in o a SKOS cons uc in SKOS o ien ed hesau us ools. 3.1. Cons uc s Thesau i, Concep s and Te ms. A hesau us is a con olled and s uc u ed ocabula y. Wi h ISO 2788, he main cons uc s o hesau i a e Te ms: wo ds o ph ases ha ep esen an idea. ISO 25964 e ol es owa ds he concep -based app oach, i.e., he main cons uc s o hesau i a e Concep s, uni s o hough . Concep s a e ep esen ed by e ms and he ela ionships ha p o ide s uc u e o a hesau us a e es ablished be ween concep s. When mapping o SKOS, skos:Concep Scheme is used o ep esen a hesau us, a s uc u e ha compiles and o ganizes a se o concep s, and each concep is ep esen ed wi h skos:Concep , each o hem in u n iden i ied wi h a URI. Labels can be p e e ed (skos:p e Label), al e na i e (skos:al Label), o hidden (skos:hiddenLabel). Fo example, he concep ep esen ed wi h he P e e edTe m ‘social igh s’ in Eu oVoc has se e al SimpleNonP e e edTe m, which can be used o ep esen he same idea. The mapping o SKOS is di ec : his concep is iden i ied wi h he URI h p://eu o oc.eu opa.eu/3899, classi ied as a esou ce o ype skos:Concep , and i s labels a e e e ed o wi h he skos:p e Label, skos:al Label p ope ies. I is wo h ema king ha he idea o Te ms in ISO 25964 ma ches he SKOS-XL ex ension [33], whe e e ms a e aised o he ca ego y o objec s ha can be ela ed wi h o he objec s, some hing which is no possible o labels. skos-xl:label is used in his case. This has been done in Eu oVoc 4.7. Howe e , he e a e ew hesau i ep esen ed wi h SKOS-XL and, which may be mo e in luen ial in eal applica ions, he e a e ew gene al pu pose hesau us ools ha suppo SKOS-XL in ull. Domains o Mic o hesau i and Concep g oups. Thesau i ha e usually been o ganized in hema ic ields o domains12, also called ields o knowledge o mic o hesau i. ISO 25964 in oduces a new cons uc : concep g oups. Domains a e concep g oups. Te ms (ISO 2788), o concep s (ISO 25964), a e g ouped in domains. E en i no common, hesau i can ha e mul iple domain le els, ha is, domains which a e included in o he domains. The i s ones a e subdomains. Fo ins ance, he Eu oVoc hesau us has 21 domains - hema ic ields- and 127 subdomains o mic o hesau i. Thus, he domain ‘LAW’ is di ided in o se en mic o hesau i: ‘sou ces and b anches o he  12 Fo he es o his pape , ‘domain’ will be used. law’, ‘ci il law’, ‘c iminal law’, ‘jus ice’, ‘o ganisa ion o he legal sys em’, ‘in e na ional law’ and ‘ igh s and eedoms’. ISO 25964 Concep g oups a e conside ed a subclass o skos:Collec ion in [18]. The SKOS Collec ions a e g oups o concep s which do no need o be ela ed by hie a chical ela ionships [17]. Membe s o a SKOS Collec ion may come om di e en Concep Schemes, which o he in e es o hesau us managemen means ha a SKOS Collec ion can be used o ep esen domains o o g oup concep s om di e en hesau i. Al hough he nes ing be ween domains ecei ed a dedica ed ela ionship, hasSubG oup/hasSupe G oup, in ISO 25964, he e is no equi alence in SKOS [18]. The e was a p oposal o ex end SKOS o make up o his and o he sho ages, named ISO-THES [34]. Howe e , i s documen a ion is no longe a ailable and hence, i will no be conside ed in he es o his s udy13. Equi alence ela ionships. An equi alence ela ionship is es ablished be ween wo e ms in a hesau us ep esen ing he same concep in he same na u al language. The equi alence ela ionships a e USE ( o he p e e ed e m), and UF ( o he non- p e e ed e m). These ela ionships, p esen in ISO 2788, a e also ound in ISO 25964. Howe e , wi h concep -based hesau i, hese ela ionships a e no as c ucial in he de ini ion o a hesau us as hey we e wi h ISO 2788, because he idea ha was ep esen ed by he g oup o p e e ed and non-p e e ed e ms is now ep esen ed by he concep cons uc , o which p e e ed and non-p e e ed e ms a e associa ed. The equi alen o his in SKOS a e skos:p e Label and skos:al Label espec i ely14. Thus, in he same example ex ac ed om Eu oVoc, men ioned in he in oduc ion o he cons uc s, he concep wi h he desc ip o (P e e edTe m) 'social igh s' in Eu oVoc has wo SimpleNonP e e edTe m: 'economic and social igh s' and 'social eedom'. The h ee a e linked wi h he concep hey quali y by he skos:p e Label o 'social igh s' and skos:al Label o 'economic and social igh s' and 'social eedom', espec i ely. The equi alence ela ionship be ween p e e ed and non-p e e ed e ms is shown on he web page in Eu oVoc by he abb e ia ions ‘UF’ (used o ), in on o he SimpleNonP e e edTe m and ‘USE’, in on o he P e e edTe m. Hie a chical ela ionships. These ela ionships we e al eady a ailable in ISO 2788 and p o ide he hie a chical s uc u e ha o ganizes a hesau us. They ela e a pai o e ms (ISO 2788) o concep s (ISO 25964) o which one has a scope alling comple ely wi hin he scope o he o he . They a e b oade e ms (BT) and na owe e ms (NT), which a e ecip ocal. ISO 25964 main ains hese adi ional symbols, bu hey should be unde s ood as "b oade concep " and "na owe concep " espec i ely. Fo example, in Eu oVoc, he concep desc ibed as 'social igh s' has 13 na owe concep s: 'academic eedom', 'equali y be o e he law', 'equal ea men ', e c. These ela ionships ha e a di ec mapping in SKOS: skos:b oade and skos:na owe .  13 Based on he W3C Recommenda ion [14], an ex ension o SKOS o hesau i acco ding o ISO 25964, called ISO- THES (h ps://lo .linkedda a.es/da ase /lo / ocabs/iso- hes), was p oposed. This e e ence was used as a guide o he s udy. Howe e , a he ime o w i ing he pape , i s documen a ion was no longe a ailable o a long pe iod. On he o he hand, we ha e no ound in he analyzed ools suppo o ISO-THES. Fo bo h hese easons, he sea ch o s able e e ences, and he empi ical e i ica ion ha he SKOS e sion ha he ools suppo is he Recommenda ion, wi hou he ISO-THES ex ension, has led us o ocus ou s udy on ully s abilized e sions o he s anda ds and accep ed by he hesau us communi y ( hesau i edi o s, and hesau us ool de elope s). 14 The e a e wo possibili ies wi h SKOS: i SKOS Co e is used, which is he simples way o doing i , hei alue is a li e al; i SKOS-XL is used, he labels a e ela ed o concep s by hese ela ionships. Wi h SKOS-XL he p ope ies o be used a e xl:p e Label and xl:al Label. A no el y in ISO 25964 is ha i in oduces he possibili y o dis inguish be ween h ee ypes o hie a chical ela ionships: gene ic (kind o , BTG), pa i i e (pa o , BTP) and ins an ial (ins ance o , BTI).This has se e al e ec s [35]. In addi ion, his dis inc ion be ween he h ee ypes o hie a chical ela ionships, as ye , has no mapping in SKOS15. Indeed, a solu ion was ecen ly p oposed in [36], whose essence is o de ine ex ended p ope ies (BTGE, BTPE, BTIE). Howe e , i is s ill oo soon o know i i will become a s anda d solu ion. Some conside a ions abou his issue a e included in he Analysis (Sec ion 6). E en i no common, hie a chical ela ionships can be combined in a hesau us o ob ain polyhie a chical s uc u es. Polyhie a chical s uc u es a e de ined by ISO 25964- 1:2011 as a “hie a chical a angemen o concep s in a hesau us o classi ica ion scheme in which each concep can ha e mo e han one b oade concep ”. Top Te ms and Top Concep s. Top concep s a e b oade han any o he concep in hei domain. ISO 2788 hasTopTe m/isTopTe mO p ope ies, o he Top Concep s o ISO 25964, do no ha e a di ec mapping in SKOS [18]. Ne e heless, in SKOS, i is possible o s a e ha a concep is a op concep in a concep scheme by using he skos: opConcep O p ope y. The concep ‘social igh s’ in Eu oVoc is a Top Concep o he '1236 igh s and eedoms' mic o hesau us. Tha is, i only has NT concep s. Mo eo e , his is asse ed in an RDF ep esen a ion wi h he skos: opConcep O and skos:hasTopConcep p ope ies. Associa i e ela ionships. An associa i e ela ionship ela es wo p e e ed e ms (ISO 2788), o concep s (ISO 25964), ha a e no in he same hie a chical s uc u e, bu a e seman ically simila . The symbol used is RT (Rela ed Te m) and he e is a di ec mapping in SKOS by means o he skos: ela ed p ope y. ISO 25964 o e s he possibili y, which was no a ailable in ISO 2788, o commen on he na u e o hese ela ionships, some hing which b ings he hesau us ISO ecommenda ion close o he abili y o on ologies o model seman ics in ela ionships. Following he same p e ious example, he concep desc ibed as 'social igh s' has a ela ed concep (RT), ‘Communi y Cha e o he Fundamen al Social Righ s o Wo ke s’. The skos: ela ed p ope y p o ides his meaning. No es. These se e o cla i y he meaning and applica ion o a e m, o concep , in ela ion o o he e ms o concep s in he same hesau us. No es can be di ided in o scope no es, his o ical no es, edi o no es, usage no es, e c. They a e bo h in ISO 2788 and ISO 25964 wi hou changes. SKOS also suppo s no es.Thesau i edi o s can add as many no es as hey wan , o none. No es do no change he essence o a hesau us, so no mo e space will be de o ed o his heading. A ays. A ays a e g oups o sibling concep s. In [18] i is p oposed o ep esen hem wi h skos:Collec ion. Tha is, he SKOS collec ions can be used o ep esen domains and a ays. We ha e no ound an example o a ay in he Eu oVoc e sion a ailable in i s websi e. Howe e , o he aim o p o iding an example he e, an a ay could be made wi h he se o sibling concep s ‘ag icul u al ehicle, ai -cushion ehicle, camping ehicle, elec ic ehicle, la ge ehicle, mo o ehicle’. All o hem ha e a common  15 A W3C d a , which did no e ol e o a W3C Recommenda ion, aised he possibili y o a SKOS Ex ension o suppo some common ea u es o KOS, especially hesau i. In pa icula , i in oduced gene ic, pa i i e and ins an ial ela ionships. A. Miles, D. B ickley, SKOS Ex ensions Vocabula y Speci ica ion, Wo ld Wide Web Conso ium, 2004. h ps://www.w3.o g/2004/02/skos/ex ensions/spec/2004-10-18.h mlW3C pa en concep , ‘ ehicle’, and his se could be labelled wi h he cha ac e is ic ‘ ype o ehicle’. Compound equi alence. ISO 25964 in oduces he compound equi alence, which was no in ISO 2788. These a e ela ionships used o ep esen compound concep s ha do no exis in a hesau us bu can be exp essed as a combina ion o wo o mo e simple concep s. In some cases, he new concep is he union o subconcep s (e.g., in Eu oVoc ' ossil uel' could be conside ed he union o 'coal', 'na u al gas', and 'pe oleum'). Fo hese si ua ions, [35] ecommends using hie a chical ela ionships wi h p e e ence o compound equi alence, ha is, in oducing he compound concep as one mo e hesau us concep , which is ela ed by hie a chical ela ionships wi h i s componen s. The e is no s anda d solu ion ye o ep esen his wi h SKOS. Fo ins ance, he ' ossil uel' example has been modeled in Eu oVoc as a concep , which is ela ed wi h h ee o he concep s ('coal', 'na u al gas', and 'pe oleum') by RT ela ionships. This is no he solu ion p oposed by [35] (RT ela ionships ha e been used in Eu oVoc ins ead o hie a chical ela ionships), bu i is close o i s app oach han he compound equi alence o ISO 25964. Howe e , a las ema k is wo h no ing; s uc u es such as he one conside ed unde his heading, compound equi alence, a e a ely ound in eal hesau i, in which simplici y is a design p inciple. 3.2 E olu ion in cons uc s om ISO 2788 o ISO 25964 The main changes in oduced by he new ISO s anda d ha a ec he amewo k o cons uc suppo assessmen a e p esen ed and commen ed in he ollowing. 1. The basic cons uc s o a hesau us a e no longe e ms, bu concep s. Wi h his, ISO 25964 has go close o SKOS. Howe e , ISO 25964 o e s he possibili y o add ela ionships be ween e ms i desi ed. This in oduces complexi y in o he hesau i and di icul ies in he mapping o SKOS [18,37].  2. P e e ed e ms in ISO 2788 should be associa ed o concep s in ISO 25964. Non-p e e ed e ms should also be associa ed o concep s. 3. Domains a e ep esen ed wi h concep g oups in ISO 25964, and hese a e hemsel es ep esen ed wi h skos:Collec ion [18]. This is a change wi h espec o ISO 2788, as he mapping o domains o SKOS cons uc s was no ixed. I now becomes clea e wha could be expec ed in ools using SKOS.  4. Nes ing be ween domains is ep esen ed in ISO 25964 wi h he p ope y hasSupe G oup/hasSubG oup. In ISO 2788, he e was no equi alen p ope y. The mapping o hese p ope ies in SKOS has no ye been sol ed. 5. New cons uc s, e.g., compound equi alence, a e included in ISO 25964. 6. BT, NT and RT ela ionships a e in bo h ISO s anda ds wi h he same seman ics. In ISO 2788, hey ela ed p e e ed e ms, while in ISO 25964 hey ela e concep s. 7. Howe e , ISO 25964 in oduces a ype in NT/BT ela ionships wi h h ee possible alues: kind o , pa o , and ins ance o .  8. Top e ms ind hei equi alen in op concep s. In sho , he e a e new cons uc s in ISO 25964 and o he s ha e changed wi h espec o he p e ious s anda d. They a e: Concep s; Te ms; A ays; ypes in hie a chical ela ionships: BTG (Gene ic), BTP (Pa i i e), BTI (Ins an ial); Concep g oups, used o domains o mic o hesau i; and Compound equi alences. The possibili y o using compound equi alence, o ypes o hie a chical ela ionships, supposes a deg ee o lexibili y in hesau i modeling ha complica es he decision o designe s o hesau us ools using SKOS o ep esen ing hesau us, and new ones con inue o join his lis [38], no mo e ools ha e been included in his pape because he ocus is on he amewo k de ini ion and i s e ision o con o m o ISO 25964; applying i o ce ain ools is a way o e i y i s easibili y.  PoolPa y20 is a hesau us ool wi h a Seman ic Web app oach [39]. I is a comme cial so wa e p og am wi h a ee e alua ion e sion ha uses SKOS. The in e ace is designed o acili a e hesau us edi ion. The e sion ha was i s e alua ed in [23] was PoolPa y 2.7. Fo his pape , he es s ha e been applied o PoolPa y 5.  SKOSEd21 is a P o égé plugin [40]. I s pu pose is he c ea ion and edi ion o KOS ep esen ed wi h SKOS. The easoning is ca ied ou h ough P o égé's easoning acili ies, o which he app op ia e on ologies ( he SKOS on ology in his case) ha e o be loaded on o P o égé. The possibili ies o e ed by he loaded on ology will de e mine he suppo o he ool o some cons uc s and in e ences. A main di e ence wi h PoolPa y is, indeed, in he in e ace ha use s wo k wi h: i is P o égé, i.e., i is made o on ology enginee s, and may be mo e o e whelming o hesau us edi o s han ha o PoolPa y (e.g., he use o ' easone s' o 'classi y' i ems is qui e speci ic o he on ology enginee ing a ea).  The e is a ele an di e ence be ween he wo ools selec ed: PoolPa y is a hesau us ool, while SKOSEd is, as i s name indica es, a SKOS ool. This means ha SKOSEd should suppo any ype o KOS ha complies wi h he SKOS ecommenda ion, which is mo e lexible han hesau us s anda ds (see Sec ion 3). Howe e , es ic ions speci ic o hesau i can be expec ed o be aken in o accoun in PoolPa y. The cons uc sui e has been checked using he hesau us shown in Figu e 2. The ex ended e sion, Figu e 2(a), has been used. The hesau us cons uc s suppo ed by each ool a e shown in Tables 4 and 5. The i s column co esponds o he numbe o each es . In he second and hi d columns, a b ie desc ip ion o hei seman ics unde ISO 2788 and ISO 25964 is o e ed ( o a comple e desc ip ion, please e e o Sec ion 4.2). The nex columns show he esul s o each ool, wi h hei quali a i e and nume ic alues in each case. Table 4. Suppo o basic cons uc s in PoolPa y and SKOSEd. Tes ISO 2788 ISO 25964 PoolPa y SKOSEd Resul s Values Resul s Values 1 Thesau us Thesau us M 1 M 1 2 Domain Concep g oup M-I 0.5 NM 0 3 P e e ed Te m 3.1 Concep M 1 M 1 3.2 Associa e P e- e edTe m M 1 M 1 4 Non-p e e ed Te m Associa e NonP e- e edTe m o a concep M 1 M 1 5 No e No e M 1 M 1 6 A ay M 1 NM 0 7 Te m NM 0 NM 0  20 h ps://www.poolpa y.biz/ 21 h ps://code.google.com/a chi e/p/skosedi o /  Table 5. Suppo o ela ionships in PoolPa y and SKOSEd. Tes ISO 2788 ISO 25964 PoolPa y SKOSEd Resul s Values Resul s Values 8 Subdomain hasSupe G oup/has- SubG oup NM 0 NM 0 9 P e e ed Te m in Domain Concep in Concep g oup M-I 0.5 M-I 0.5 10 BT ela ionship BT ela ionships: a) wi hou ype b) ype = ‘kind o ’ c) ype = ‘pa o ’ d) ype = ‘ins ance o ’ M+I NM NM NM 1 0 0 0 M+l NM NM NM 1 0 0 0 11 NT ela ionship NT ela ionship: a) wi hou ype b) ype = ‘kind o ’ c) ype = ‘pa o ’ d) ype = ‘ins ance o ’ M+I NM NM NM 1 0 0 0 M+I NM NM NM 1 0 0 0 12 Polyhie a chy Polyhie a chy M+I 1 M+I 1 13 RT ela ionship RT ela ionship M+I 1 M+I 1 14 Top Te m Top Concep M+I 1 M+I 1 15 Concep in A ay M+I 1 NM 0 PoolPa y wo ks wi h SKOS cons uc s: Concep Schemes, Concep s, and Labels. I in e s ecip ocal ela ionships when c ea ing BT, NT o RT ela ionships. SKOS Collec ions a e suppo ed. Thus, hey can be used o ep esen concep g oups (domains) and a ays, as p oposed in [18]. PoolPa y has pe ec suppo o polyhie a chy (e.g., i has been possible o c ea e, wi hou p oblems, he polyhie a chical s uc u e o he hesau us in Figu e 2(a)), bu i does no suppo domain nes ing es ed in es 8, i.e., i only pe mi s one le el o Concep Schemes. Rega ding anno a ion, PoolPa y only suppo s Scope no es. The new upda es o ISO 25964, such as ypes in hie a chical ela ionships, a e no suppo ed. The alues ob ained o he indica o s a e p esen ed in he second column o Table 6. SKOSEd also wo ks wi h SKOS cons uc s. An impo an di e ence wi h PoolPa y in he cons uc s suppo ed is ha he e is no SKOSEd iew o add collec ions. This implies ha i is no possible o ep esen domains o a ays wi h collec ions as p oposed in [18]. In consequence, he esul s o es s 2, 6 and 15 di e om hose o PoolPa y.  In SKOSEd he in e ence o ecip ocal ela ionships is no au oma ically done when a seman ic ela ionship is added, bu i is o e ed when he 'Classi y' easoning acili y is pe o med. Polyhie a chy is suppo ed. Only one le el o Concep Schemes is accep ed by he ool, i.e., domain nes ing is no suppo ed. The alues ob ained o he indica o s a e shown in he hi d column o Table 6. Bo h ools e idence a easonable suppo o he cons uc s used in mos hesau i22. PoolPa y o e s be e suppo , as he alues in Table 6 show. This is logical, as his ool, by con as o SKOSEd, was concei ed as a hesau us ool. Mo eo e , some cons uc s ha appea ed wi h ISO 25964 a e no suppo ed (see he esul s o es s 6, 10 and 11). Some mo e conside a ions de i ed om he esul s o his expe imen al alida ion a e o e ed in he Analysis Sec ion (Sec ion 6). Table 6. Values ob ained o he indica o s in he expe imen al alida ion. Indica o PoolPa y SKOSEd Quali y o basic cons uc s suppo 6.5 80.8 5 80.6 Quali y o ela ionships suppo 6.5 14 0.5 5.5 14 0.4 6. Analysis The mos in e es ing ema ks a e ela ed o cons uc s ha a e new in ISO 25964, which we e no in ISO 2788, and ha e no equi alence in SKOS. The ollowing commen s a ec es s ha check he suppo o 1) BT/NT ela ionships, 2) Subdomains, 3) Collec ions and 4) Polyhie a chy. The expansion o es s 10 and 11 o co e he possibili y o assigning ypes o BT/NT ela ionships has been made wi h sub es s, numbe ed 10.a), 10.b), e c. I has been decided o do i in his way o p o ide he amewo k wi h lexibili y. Thus, i a use conside s he suppo o ypes in BT/NT ela ionships o be impo an , he ou a ia ions will be applied as independen es s, ha is, ou es s will be execu ed and he indica o s will be adap ed app op ia ely. Howe e , use s who conside he suppo o ypes in BT/NT ela ionships o be i ele an can main ain he a) a ia ion, “no ype”, which co esponds o he possibili y al eady a ailable in ISO 2788, and he one used in mos hesau i we ha e obse ed. In he expe imen al alida ion o Sec ion 5, we wo ked wi h he i s app oach, so he numbe o es s conside ed o calcula e he indica o o he ela ionships suppo is 14 (see he las ow o Table 6). Rega ding he implica ions ha he in oduc ion o ypes o BT/NT ela ionships has, i is wo h aking in o accoun he ac ha he manne o ep esen ing he di e si y o hie a chies associa ed o ypes o BT/NT ela ionships in SKOS has no de ini i e solu ion ye (see he p oposals made in [18,36]). In ou opinion, his implies ha he ools will no suppo hese ypes un il e e y hing conce ning hei ep esen a ion wi h SKOS and hei managemen is s abilized. Gi en ha he ex ensions o SKOS ha would suppo he dis inc ion be ween he di e en ypes o BT/NT ela ionships is no ye included in he SKOS ecommenda ion, ou p e ision is ha mos ools will ail in es s ha check he suppo o hese new cons uc s. They a e c ea ed wi h he in en ion o being a ailable when s abiliza ion a i es. We ema k ha he suppo o subdomains was al eady included in he p e ious e sion o his amewo k, as well as he suppo o nes ing be ween hem. The e is no equi alen p ope y in SKOS o ISO 25964 hasSupe G oup/hasSubG oup. This  22 Besides using he ad-hoc hesau us p esen ed in sec ion 4.3, some eal hesau i we e impo ed ( he easons ha mo i a ed he examina ion o hese hesau i a e p esen ed in sec ion 4.3). The analysis made by compa ing he manne each o hem ep esen s hesau us cons uc s wi h SKOS is p esen ed in sec ion 6. in oduces a le el o unce ain y ha will no encou age so wa e de elope s o include suppo o his capabili y (which was no necessa y wi h ISO 2788) in hei ools. This si ua ion is simila o ha desc ibed abou ypes in hie a chical ela ionships.  The suppo o subdomains seems o be a pending ask. So, when a hesau us has his s uc u e (e.g., he Eu oVoc Thesau us) one solu ion is ha ound in he UKAT Thesau us: no o ep esen he op le el o subjec ields and s a wi h he ep esen a ion o subdomains (mic o hesau i) as Concep Schemes, which a e placed a he op le el o he hie a chy. Ano he possibili y, which is he one ha p obably comes o mind when hesau us ools a e used o c ea e a hesau us ( hese ools do no suppo wo le els o Concep Schemes), is o use Concep s a all le els, e en o ep esen domains. These a e no ideal solu ions, bu un il he mapping o ISO 25964 and SKOS ge s ixed, we a e a aid his si ua ion will no change. Finally, he e a e o he possibili ies based on ex ending SKOS wi h OWL p ope ies de ined ad-hoc o ep esen his seman ic. This solu ion was chosen o he Eu oVoc ep esen a ion a ailable a he Eu oVoc o icial web page23. The d awback o using ad-hoc ex ensions is ha hey a e no unde s ood by gene ic hesau us ools. Tes ing wo di e en ools, one o hem o ien ed o hesau i and he o he ocused on SKOS, has helped o co obo a e he in e es o compa ing he cons uc s o ISO 25964 and SKOS. In ac , some esul s o he expe imen s on hese ools (di e ences in esul s o some es s) had been o eseen as possible, due o he compa ison discussed in Sec ion 3. Mo eo e , hanks o ha compa a i e analysis, an explana ion o he easons o hese di e ences was al eady a ailable. A di e ence was ound in he suppo o collec ions by he ools assessed in Sec ion 5 (compa e he esul s o es s 2, 6, and 15 in Tables 4 and 5). Wi h ISO 2788, he ole collec ions could ha e o ep esen ing a hesau us was mino . Howe e , wi h ISO 25964, he ac ha collec ions a e p oposed as he SKOS equi alen o concep g oups and a ays, means ha hey acqui e ele ance. This di e ence be ween ools, which was almos i ele an be o e ISO 25964, inc eases i s ele ance wi h he new s anda d. I is posi i e o e i y ha polyhie a chy is well modeled and suppo ed in he ools assessed in he expe imen al alida ion. E en i no common, polyhie a chy is a s uc u e used in some hesau i (e.g., Eu oVoc has some examples). I is good news o hesau us edi o s o ha e his suppo when needed. The expe imen s ha e con i med he suspec ed limi a ions wi h new cons uc s and s uc u es in ISO25964, o hose which acqui e a g ea e ele ance han hey had in ISO 2788: collec ions, e ms, polyhie a chy, a ays, compound equi alence, e c. This may be due o wha is e idenced in [37]: he special complexi y ha ISO 25964 in oduces wi h espec o SKOS,e.g., wi h he possibili y i in oduces o ela e concep s and e ms wi h isNonP e e edLabelFo /isP e e edLabelFo ela ionships. 7. Conclusions This pape p esen s a me hodological amewo k o assess cons uc suppo in hesau us ools, whose a ge communi y is hesau i edi o s conce ned wi h ob aining hesau i ha con o m o pe inen hesau i s anda ds. I is o ien ed owa ds he design o hesau us managemen ools and hei use s’ expe ience. Cons uc suppo is a c ucial  23 h ps://publica ions.eu opa.eu/en/web/eu- ocabula ies/ h-da ase /-/ esou ce/da ase /eu o oc  issue when c ea ing and edi ing hesau i. Thus, he help p o ided by ools in de ec ing possible in ac ions o he s anda d and p e en ing hem is aluable, as his will con ibu e o he quali y o he hesau i c ea ed wi h hem. Being able o e i y he le el o suppo ha can be ob ained om a p ospec i e ool o be used o hesau us edi ing can i sel be help ul o hesau us edi o s con on ed wi h he ask o selec ing a ool. This is wha is o e ed in his amewo k. In addi ion, his wo k can be ele an o SKOS o hesau us de elope s in e es ed in es ing hei abili ies, applying a SKOS ool o main ain, o publish, a hesau us in he Seman ic Web o ice e sa. The p oposal p esen ed in his pape is pa o a gene ic amewo k, which includes unc ionali y and o he issues, besides he one p esen ed he e [23]. Mo eo e , in his pape , he compa ison be ween he ISO s anda ds o hesau i and he SKOS ecommenda ion is deployed. The changes ha ISO 25964 in oduces wi h espec o ISO 2788 and he modi ica ions i implies on his me hodological amewo k ha e been analyzed. The inclusion o SKOS and ISO 25964 is a ele an no el y o his p oposal as compa ed wi h some p e ious s udies ela ed o he e alua ion o hesau i o hesau i ools [27–29]. This p oposal was i s designed aking in o accoun he ISO 2788 s anda d, s ill suppo ed by hesau us ools, and e ised con o ming o ISO 25964. I was impo an o keep bo h pe spec i es in pa allel, as a comple e adap a ion o hesau i and ools o ISO 25964 may be a long p ocess. The u u e will show how hesau i ools adap o he new ISO s anda d. This p oposal is speci ically made o hesau i ools, which di e en ia es i om gene al Seman ic Web benchma ks [30], e en i hey ha e been aken in o accoun o i s de ini ion and speci ica ion. In his amewo k, hesau i edi o s can ind a guide, no o he wise a ailable, o compa ing hesau us ools, ha hey can apply di ec ly. The p oposed model is sys ema ic and he indica o s o e a means o measu e and compa e he con o mance o hesau us managemen so wa e wi h espec o he necessa y suppo in managing he cons uc s. Tes s o compound equi alences and some o he cons uc s which a e new in ISO 25964 ha e no been included in Tables 1 and 2. The eason is ha we ha e no ound hesau i wi h such cons uc s, which implies ha , i hesau us designe s do no use hese cons uc s, nei he will hey be in e es ed in checking i hesau us ools a e able o manage hem. Howe e , hei inclusion would no a ec he sui e, as i would jus add new es s wi hou modi ying he a ailable ones. E en i SKOS is used by he ools e alua ed o ep esen concep -based hesau i, his p oposal is no concei ed o SKOS ools, bu o hesau i ools. A p oposal o SKOS ools should ha e di e en es s and a di e en se o esul s, wi h di e en issues o ake in o conside a ion ( emembe , e.g., he analysis ela ed o ypes o hie a chical ela ionships, and subdomains). Howe e , he analysis o he co espondences be ween ISO 25964 cons uc s and SKOS cons uc s is a aluable ool o unde s and how he es s can be applied o any hesau us ool. The analysis ca ied ou shows ha some cha ac e is ics o hesau i a e no well suppo ed when SKOS is used o hei ep esen a ion. The compa ison o he solu ions adop ed in a ious hesau i o ep esen he cons uc s ha do no ind di ec equi alence in SKOS, compound concep s, domain nes ing, e c., shows ha , in hese cases, he edi o s o hesau i a e he ones who assume he esponsibili y o decide he mapping o ISO cons uc s o SKOS cons uc s. E idence ocused on he solu ion ound o domain nes ing in he UKAT Thesau us and in Eu oVoc (see Sec ion 6) has been o e ed. Na u ally, he disad an age o hese solu ions is ha hey a e no s anda d. P oposals o ex end SKOS o suppo hese hesau i cons uc s, such as ISO-THES, ha e been ca ied ou . Howe e , he hesau us managemen ools do no in eg a e suppo o ISO-THES, which implies ha he esponsibili y o ans e ing hese p oposals adequa ely o hei hesau i con inues o all o he edi o s o he hesau i. In ou opinion, i would be necessa y o p oposals such as ISO-THES o e ol e o he W3C Recommenda ion s a us. This would allow ool de elope s o p o ide suppo by de aul , hus acili a ing he ask o he p o essionals in cha ge o hesau i edi ion. Re e ences [1] F.-J. Ga cia-Ma co, The e olu ion o hesau i and he his o y o knowledge o ganiza ion: be ween he swo d o mapping knowledge and he wall o keeping i simple, B azilian J. In . Sci. Res. T ends. 10 (2016) 10–11. doi:10.5016/b ajis. 10i1.5786. [2] F.-J. Ga cía-Ma co, Enhancing he Visibili y and Rele ance o Thesau i in he Web: Sea ching o a Hub in he Linked Da a En i onmen ., Knowl. O gan. 43 (2016) 193–202. [3] A. Isaac, T. Bake , Linked da a p ac ice a di e en le els o seman ic p ecision: The pe spec i e o lib a ies, a chi es and museums, Bull. Am. Soc. In . Sci. Technol. 41 (2015) 34–39. doi:10.1002/bul .2015.1720410411. [4] A. Mas o a, M. Peponakis, S. Kapidakis, SKOS concep s and na u al language concep s: An analysis o la en ela ionships in KOSs, J. In . Sci. 43 (2017) 492– 508. doi:10.1177/0165551516648108. [5] M. Hildeb and, J. an Ossenb uggen, L. Ha dman, G. Jacobs, Suppo ing subjec ma e anno a ion using he e ogeneous hesau i: A use s udy in Web da a euse, In . J. Hum. Compu . S ud. 67 (2009) 887–902. doi:10.1016/J.IJHCS.2009.07.008. [6] ISO, ISO 25964-1:2011 In o ma ion and Documen a ion -Thesau i and In e ope abili y wi h O he Vocabula ies -Pa 1: Thesau i o In o ma ion Re ie al, In e na ional O ganiza ion o S anda diza ion, 2011. [7] N.F. Noy, M. Sin ek, S. Decke , M. C ubezy, R.W. Fe ge son, M.A. Musen, C ea ing Seman ic Web con en s wi h P o ege-2000, IEEE In ell. Sys . 16 (2001) 60–71. doi:10.1109/5254.920601. [8] ISO, ISO 2788:1986 Documen a ion Guidelines o he Es ablishmen and De elopmen o Monolingual Thesau i, 2nd ed., In e na ional O ganiza ion o S anda diza ion, 1986. [9] ISO, ISO 5964:1985. Guidelines o he es ablishmen and de elopmen o mul ilingual hesau i, In e na ional O ganiza ion o S anda diza ion, 1985. [10] ISO, ISO 25964-2:2011 In o ma ion and Documen a ion -Thesau i and In e ope abili y wi h O he Vocabula ies -Pa 2: In e ope abili y wi h o he ocabula ies, In e na ional O ganiza ion o S anda diza ion, 2013. [11] S.G.D. Cla ke, M.L. Zeng, F om ISO 2788 o ISO 25964 : The e olu ion o hesau us s anda ds owa ds in e ope abili y and da a modeling, In . S and. Q. 24 (2012) 20–26. doi:h p://dx.doi.o g/10.3789/isq 24n1.2012.04. [12] J.-A. Pas o -Sánchez, P oposal o ep esen he UNESCO hesau us o he Seman ic Web applying ISO 25964, B azilian J. In . Sci. Res. T ends. 9 (2015) 1–8. h p://www2.ma ilia.unesp.b / e is as/index.php/bjis/a icle/ iew/5684/3897 (accessed May 18, 2018). [13] I. Ju isica, J. Mylopoulos, E. Yu, On ologies o Knowledge Managemen : An In o ma ion Sys ems Pe spec i e, Knowl. In . Sys . 6 (2004) 380–401. doi:10.1007/s10115-003-0135-4. [14] A. Miles, S. Bechho e , SKOS Simple Knowledge O ganiza ion Sys em Re e ence, Wo ld Wide Web Conso ium, 2009. h ps://www.w3.o g/TR/skos- e e ence/ (accessed May 18, 2018). [15] T. Bake , S. Bechho e , A. Isaac, A. Miles, G. Sch eibe , E. Summe s, Key choices in he design o Simple Knowledge O ganiza ion Sys em (SKOS), Web Seman . Sci. Se . Agen s Wo ld Wide Web. 20 (2013) 35–49. doi:10.1016/J.WEBSEM.2013.05.001. [16] A.J. O’dell, The Visual Vocabula y: Skos:example and he Illus a ed <i>A is s’ Books Thesau us</i>, J. Lib . Me ada a. 15 (2015) 241–251. doi:10.1080/19386389.2015.1103086. [17] A. Isaac, E. Summe s, SKOS Simple Knowledge O ganiza ion Sys em P ime , 2009. h ps://www.w3.o g/TR/skos-p ime / (accessed May 18, 2018). [18] A. Isaac, Co espondence be ween ISO 25964 and SKOS/SKOS-XL models, 2013. h ps://g oups.niso.o g/apps/g oup_public/download.php/12351/Co espondence ISO25964-SKOSXL-MADS-2013-12-11.pd . [19] B.C. Villazón-Te azas, M.C. Suá ez-Figue oa, A. Gómez-Pé ez, A Pa e n- Based Me hod o Re-Enginee ing Non-On ological Resou ces in o On ologies, In . J. Seman . Web In . Sys . 6 (2010) 27–63. [20] D. Kless, S. Mil on, E. Kazmie czak, Rela ionships and ela a in on ologies and hesau i: Di e ences and simila i ies, Appl. On ol. 7 (2012) 401–428. doi:10.3233/AO-2012-0118. [21] D. Kless, S. Mil on, E. Kazmie czak, J. Linden hal, Thesau us and on ology s uc u e: Fo mal and p agma ic di e ences and simila i ies, J. Assoc. In . Sci. Technol. 66 (2015) 1348–1366. doi:10.1002/asi.23268. [22] E. F ancesconi, Seman ic model o legal esou ces: Anno a ion and easoning o e no ma i e p o isions, Seman . Web. 7 (2016) 255–265. doi:10.3233/SW- 140150. [23] M.M. Ma ínez-González, M.-L. Al i e-Díez, On he e alua ion o hesau us ools compa ible wi h he Seman ic Web, J. In . Sci. 40 (2014) 711–722. doi:10.1177/0165551514545603. [24] B. Ki chenham, S.L. P leege , N. Fen on, Towa ds a amewo k o so wa e measu emen alida ion, IEEE T ans. So w. Eng. 21 (1995) 929–944. doi:10.1109/32.489070. [25] A.R. Weiss, Dh ys one Benchma k: His o y, Analysis, Sco es and Recommenda ions. Whi e pape , EEMBC Ce i ca ion Labo a o ies, LLC, Aus in, 2002. [26] O. Suominen, C. Made , Assessing and Imp o ing he Quali y o SKOS Vocabula ies, 3 (2014) 47–73. doi:10.1007/s13740-013-0026-0. [27] F. Se e ino, The Te m De elopmen in he Thesau i o In e na ional O ganisa ions, Eu . J. De . Res. 19 (2007) 327–351. doi:10.1080/09578810701289261. [28] G. Moya Ma ínez, I. Gil Lei a, E aluación de so wa es de ges ión de esau os, Ciencias La In . 32 (2001) 3–23. [29] Willpowe In o ma ion, So wa e o building and edi ing hesau i, (2014). h p://www.willpowe in o.co.uk/ hesso .h m (accessed May 18, 2018). [30] R. Ga cía-Cas o, A. Gómez-Pé ez, Benchma king in he Seman ic Web, in: Seman . Web Eng. Knowl. Soc., IGI Global, 2009: pp. 341–370. doi:10.4018/978-1-60566-060-8.ch200. [31] M. Po eda-Villalón, A. Gómez-Pé ez, M.C. Suá ez-Figue oa, OOPS! (On Ology Pi all Scanne !): suppo ing on ology e alua ion on-line, In . J. Seman . Web In . Sys . 10 (2014) 7–34. doi:10.4018/ijswis.2014040102. [32] F. Radulo ic, R. Ga cía-Cas o, A. Gómez-Pé ez, SemQuaRE — An ex ension o he SQuaRE quali y model o he e alua ion o seman ic echnologies, Compu . S and. In e aces. 38 (2015) 101–112. doi:10.1016/J.CSI.2014.09.001. [33] A. Miles, S. Bechho e , SKOS Simple Knowledge O ganiza ion Sys em eX ension o Labels (SKOS-XL) Namespace Documen - HTML Va ian , Wo ld Wide Web Conso ium, 2009. h ps://www.w3.o g/TR/skos- e e ence/skos-xl.h ml. [34] A. Isaac, E. De Smed , No e apply o he published mapping be ween he ISO 25964 da a model and he SKOS schema, (2015). h p://pub. en o ce.com/schemas/iso25964/skos hes. [35] L. Will, The ISO 25964 da a model o he s uc u e o an in o ma ion e ie al hesau us, Bull. Am. Soc. In . Sci. Technol. 38 (2012) 48–51. doi:10.1002/bul .2012.1720380413. [36] V. Alexie , A. Isaac, J. Linden hal, On he composi ion o ISO 25964 hie a chical ela ions (BTG, BTP, BTI), In . J. Digi . Lib . 17 (2016) 39–48. doi:10.1007/s00799-015-0162-2. [37] J.-A. Pas o -Sánchez, ISO-THES: Ampliando Skos a pa i de la no ma de esau os ISO 25964, Anu. ThinkEPI. 7 (2013) 189–193. [38] A. S ella o, S. Rajbhanda i, A. Tu ba i, M. Fio elli, C. Ca acciolo, T. Lo enze i, J. Keize , M.T. Pazienza, VocBench: A Web Applica ion o Collabo a i e De elopmen o Mul ilingual Thesau i, in: Z.A. Gandon F., Sabou M., Sack H., d’Ama o C., Cud é-Mau oux P. (Ed.), Seman . Web. La es Ad . New Domains. ESWC 2015. Lec . No es Compu . Sci. Vol 9088, Sp inge , 2015: pp. 38–53. doi:10.1007/978-3-319-18818-8_3. [39] T. Schandl, A. Blumaue , PoolPa y: SKOS Thesau us Managemen U ilizing Linked Da a, in: A oyo L. e al. (Ed.), Seman . Web Res. Appl. ESWC 2010. Lec . No es Compu . Sci. Vol 6089, Sp inge , Be lin, Heidelbe g, 2010: pp. 421– 425. doi:10.1007/978-3-642-13489-0_36. [40] S. Jupp, S. Bechho e , R. S e ens, A Flexible API and Edi o o SKOS, in: A oyo L. e al. (Ed.), Seman . Web Res. Appl. ESWC 2009. Lec . No es Compu . Sci. Vol 5554, Sp inge -Ve lag, Be lin, Heidelbe g, 2009: pp. 506–520. doi:doi.o g/10.1007/978-3-642-02121-3_38. APPENDIX - CONSTRUCT SUPPORT SUITE Table 1. Se o possible alues o es esul s. (RESULT) CODE (RESULT) VALUE DESCRIPTION M+I Model implemen ed OK, wi h in e ence Cons uc suppo ed. Recip ocal cons uc s a e inse ed. M Model implemen ed OK, in e ence is no applicable Cons uc suppo ed. No ecip oci y equi emen s apply. M-I Model implemen ed, bu no in e ence is added Cons uc suppo ed. Recip ocal cons uc s should be inse ed by he ool, bu hey a e no . PM P oblem o implemen ing he model Cons uc suppo ed, bu i is no implemen ed in a co ec manne NM No suppo o implemen ing he model Cons uc no suppo ed by he ool Table 2. Tes s o basic cons uc s. Tes ISO 2788 ISO 25964 Possible esul s 1 C ea e a Thesau us C ea e a Thesau us M: Thesau us suppo ed NM: No suppo o hesau us cons uc 2 C ea e a Domain C ea e a concep g oup M+I: Domain/Concep g oup suppo ed. The ool checks ha i has been placed a he co ec le el in he hesau us s uc u e (on op o concep s). M-I: Domain/Concep g oup suppo ed. No checks o i s posi ion in hesau us s uc u e. NM: No suppo o domains/concep g oups. 3 C ea e a P e e ed Te m 3.1 C ea e a Concep M: P e e ed Te m/Concep suppo ed. NM: P e e ed Te m/Concep s a e no suppo ed. 3.2 Associa e a P e e edTe m o M: An addi ional P e e edTe m can be