La evaluación de la calidad del texto meta producido por un sistema de traducción automático: Systran 4.0

EVALUATING THE OUTPUT QUALITY OF MACHINE TRANSLATION SYSTEMS: SYSTRAN 4.0 Noa Tala án Zanón UNED This pape p esen s a use -like black-box e alua ion o SYSTRAN P emium 4.0., a he same ime ha i in oduces an o e all app oach o he echnique o Machine T ansla ion e alua ion. The e alua ion o he ou pu quali y o a sys em such as SYSTRAN can gi e use s an idea o he needs ha can be co e ed by such a ool and o he ype o uses ha a e mo e app op ia e and can p o i mo e om such a sys em. 1. OVERVIEW OF MACHINE TRANSLATION EVALUATION The objec o an e alua ion is o de e mine whe he a sys em esponds adequa ely o gi en needs and cons ain s. E alua ing Machine T ansla ion (hence o h, MT) sys ems is impo an o e e yone in ol ed in he ield: linguis s and compu e scien is s need o know i hei heo ies make a di e ence, use s ha e o decide which sys em o use and wha o expec om i , and comme cial de elope s wan o please cos ume s, bu i s ly hey need o know how well he sys em pe o ms in eal- ime. I should be no ed ha nowadays, he main goal o MT is no o p oduce pe ec high-quali y ansla ions, bu use ul and p ac ical ones o a pa icula use in a pa icula con ex . The his o y o MT e alua ion is as old as MT i sel , so he e is a signi ican body o li e a u e on MT e alua ion and on he ac o s in ol ed. One o he i s majo MT e alua ions was ca ied ou by Pie ce and Ca oll in 1966 and became known as he amous and pessimis ic ALPAC Repo , whose conclusions we e popula ly in e p e ed as “MT is hopeless”1. A e a signi ican s op o se e al yea s, o he epo s, gene ally mo e op imis ic, ha e been sugges ed and pe o med by expe s like Leh be ge and Bou beau in 1988 o King and Falkedal in 1990, o name jus a couple o examples; Leh be ge and Bou beau analyzed in ull de ail he unc ioning o TAUM (T aduc ion Au oma ique de l’Uni e si é de Mon éal), and King and Falkedal u ilized ex sui es in e alua ing MT sys ems. Despi e o y yea s o esea ch on MT, he e is s ill no a gene ally accep ed, sa is ac o y and comp ehensi e e alua ion me hodology, which would conside ably help in enhancing knowledge on he gene al ield o MT and MT e alua ion and hence, on he essen ial issue o making expec a ions abou MT ealis ic. This is o en so because, on he one hand, companies do no wan o make hei laws public and, on he o he , many e alua ion 1 The main conclusions o he epo abou he iabili y o MT we e ha MT did no p o ide high quali y ansla ions and ha i would no be desi able in he nea e m, since i would be mo e cos -e ec i e hi ing human ansla o s. The wo s consequence o he ALPAC epo was he closing o mos esea ch g oups on MT o he ime, since economic suppo s opped due o he epo ’s nega i e conclusions. In ac , he epo ecommended pu ing mo e e o in scien i ic esea ch add essing mo e p ac ical ansla o ’s ools, and lea ing esea ch on MT a li le behind. I.S.S.N. 1132-0265 PHILOLOGIA HISPALENSIS 19 (2005) 189-201 190 Noa Tala án Zanón me hodologies a e in p i a e hands. Besides, e en i he limi a ions o MT a e cu en ly ecognized, and an MT sys em i is no gene ally expec ed o p oduce a lawless ansla ion wi hou human in e en ion, some kind o e alua ion will always be needed, ei he o imp o e a sys em, o simply o know i i sui s he use ’s needs. Typically, six ypes o e alua ion a e dis inguished: ope a ional e alua ion (which assesses he economic bene i s o using a pa icula sys em as pa o a p ocess in an o ganisa ion), adequacy e alua ion ( ha allows use s o be able o choose he sys em which bes mee s hei speci ic needs), decla a i e e alua ion ( he s anda d me hod, so o speak, ha looks a how sys ems pe o m acco ding o c i e ia such as accu acy and in elligibili y), diagnos ic e alua ion (when he s a e o a sys em is assessed o disco e whe e i ails and why), ypological e alua ion ( ha p o ides in o ma ion o de elope s on which linguis ic cons uc ions a sys em can handle, and ypically employs es sui es), and p og ess e alua ion (when he ac ual s a e o a sys em is assessed wi h espec o some desi ed s a e, o when successi e e sions o a sys em a e assessed o measu e i s p og ess in ime). Dis inc ions in he li e a u e ha e also been d awn be ween glass box and black box e alua ion, depending on whe he o no he e alua o has access o he ope a ional modules o he sys em. The i s can be used o measu e how well each componen pe o ms i s speci ic unc ion; usually i is he sys em builde o specialis ha pe o ms glass-box e alua ion, ha ing comple e access o he sys em. In he la e , he e alua o has access only o he inal esul s o he p ocessing and hence can measu e only how well he sys em as a whole pe o ms i s ask; ypically, black-box e alua ions a e pe o med by use s. Finally, di e en ypes o e alua ions can also be dis inguished depending on he pe son who ca ies hem ou : e alua ion by ansla o s, e alua ion by esea che s, e alua ion by de elope s, e alua ion by po en ial use s, e alua ion by ecipien s, and e en e alua ion by sys em sponso s (Saiz, 1995). Many speci ic me hods o MT e alua ion ha e been de eloped o e he yea s. The ISLE (In e na ional S anda ds o Language Enginee ing) p ojec , unded by he Eu opean Union and he Na ional Science Founda ion o he USA, which s a ed wo king a ew yea s ago, con inues i s wo k o sys ema ize hese measu es and p ocedu es (ISLE E alua ion Wo king G oup, 2003). The ISLE p ojec builds up schemes ha classi y a ious aspec s o impo o MT, including use needs and sys em cha ac e is ics, wi h me ics associa ed wi h hem, so as o measu e he di e en aspec s in ol ed. This wo k is in ended o be use ul o MT use s, e alua o s, esea che s, and sys em de elope s. The ISLE p ojec has o ganized se e al wo kshops exclusi ely on MT e alua ion, namely a LREC in A hens (“Wo kshop on he E alua ion o Machine T ansla ion”, h p://www.l ec- con .o g/l ec2000/www.icp.inpg. /ELRA/l ec2000.h ml, 2000), a AMTA in Mexico (“Hands on MT E alua ion Wo kshop” h p://www.isi.edu/na u al- language/con e ences/AMTA2000.h m , 2000) a Gene a Uni e si y (MT-E alua ion Wo kshop "An In i a ion o ge You Hands Di y”, h p://www.issco.unig e.ch/p ojec s/isle/m e al-ap il01, 2001) a NAACL in Pi sbu gh (Wo kshop on MT E alua ion h p://www.cs.cmu.edu/~ e /naacl2001.h ml, 2001), a MT Summi in San iago de Compos ela (MT E alua ion Wo kshop "Who Did Wha o Whom", h p://www.issco.unige.ch/p ojec s/isle/MT-Summi -wsp.h ml, 2001), a LREC in Las Palmas, Cana y Islands (MT E alua ion: "Human E alua o s Mee Au oma ed Me ics" h p://www.issco.unige.ch/p ojec s/isle/m e al-may02/, 2002), a USC/ISI, Ma ina del Rey (“MT E alua ion Wo kshop”, 2003), and a MT Summi IX in New O leans ("Towa ds E alua ing he Ou pu Quali y o Machine T ansla ion Sys em: Sys an 4.0 191 Sys ema izing MT E alua ion" h p://www.issco.unige.ch/p ojec s/isle/MTE-a -MTS9.h ml, 2003). 2. METHODS OF EVALUATING OUTPUT QUALITY To assess he quali y o he linguis ic pe o mance o any MT sys em, a numbe o me hods ha e been p oposed in he cou se o he las decades2. One o hem is e o coun ing, which consis s o coun ing up he e o s o a se o ou pu sen ences o a ex , and hen weighing hem acco ding o a speci ic scale; he disad an age o his me hod is ha wha cons i u es an e o may depend on subjec i e judgemen . Ano he possible p oposal o e alua ion is he one ha a es ou pu acco ding o scales o in elligibili y, accu acy, s yle and ideli y, h ough cloze echniques, judgemen s o eading p ocesses, quan i ying he ime aken o pos -edi a ex in o de o make i in elligible, e c. Also, ecen a en ion has been paid o new ools o MT e alua ion, pa icula ly o es sui es (o ganised se s o es inpu s, especially cons uc ed sen ences and s uc u es, used o es he syn ac ic co e age o he sys em) and ex co po a (la ge quan i ies o eal ex con aining any kind o linguis ic phenomena). While good combina ions o es sui es may allow de elope s o assess in a con olled way how sys ems beha e and how hey can be imp o ed, unning co po a h ough MT may p oduce la ge amoun s o da a bu canno ensu e ha a pa icula linguis ic phenomenon is es ed (Wagne , 1998). No ma e which me hod o e alua ing MT sys ems is used, i will ha e o assess he quali y o a pa icula sys em. Howe e , he MT quali y and accu acy needed o ansla ion pu poses is ela i ely highe han o in o ma ion pu poses, and his ac mus be conside ed be o e se ing abou e alua ing MT ou pu s. Ano he e y signi ican aspec o ake in o accoun in ad ance is ha any e alua ion o MT linguis ic ou pu , e en i ma hema ically measu able, will in ol e a subjec i e ac o (Lewis, 1997). Thus, each e alua ion p ocess has o es ablish a se ies o quali y equi emen s ha ha e o be ma ched o he me hods he e alua ion p ocess is going o ollow, so as o a emp o educe ha subjec i i y ac o o a minimum. All in all, wha needs o be bo ne in mind is ha e en i he e minology and ypology o MT e alua ion a ies sligh ly om one esea che g oup o ano he o om one sys em de elope o ano he , he ype o e alua ion chosen will de e mine he me hods employed and he ype o in o ma ion o be e alua ed and e e sely. 3. SYSTRAN AND ITS EVALUATION F om he g owing numbe o MT sys ems on he so wa e ma ke and on he Wo ld Wide Web, a long-es ablished and well-known one ha has i s own e sion a ailable o ee use on he web was selec ed: SYSTRAN and i s e sion SYSTRAN P emium 4.03. SYSTRAN was ounded in 1968 by Pe e Toma, an MT linguis esea che who es ablished in 1957 a company in La Jolla, Cali o nia, wi h a p oduc called SYSTRAN, an ac onym o Sys em T ansla ion. Soon a e wa ds, he company was hi ed o de elop Russian o English MT o he US Ai Fo ce (USAF). The i s SYSTRAN sys em was es ed in ea ly 1969, and since 1970, he sys em has con inued o p o ide ansla ion o he USAF Fo eign T ansla ion Di ision (Flanagan & McClu e, 2002). 2 Ob iously, complex and ime-consuming schemes o e alua ion a e mo e eadily unde aken by la ge o ganiza ions, agencies o in-house de elope s han by end use s o cus ome s. 3 E en i he one ha is cu en ly on he ma ke is SYSTRAN P emium 5.0. 192 Noa Tala án Zanón Du ing he pe iod 1974-1975, SYSTRAN was used by NASA o he join US-USSR Apollo-Soyouz space p ojec . In 1975, Toma demons a ed a p o o ype o English o F ench MT o ep esen a i es o he Commission o he Eu opean Communi ies (CEC), which esul ed in a con ac o de elop MT sys ems o a ious Eu opean language pai s. Nowadays, he CEC uses mo e han 12 SYSTRAN MT sys ems o he ansla ion o in e nal documen s. Likewise, Xe ox Co po a ion began using SYSTRAN in 1978 and i has con inued o use he sys em o he ansla ion o housands o pages pe yea , allowing Xe ox o launch mul ilingual p oduc s o he global ma ke place. In 1981, SYSTRAN de eloped he Japanese-English pai , and in 1989, i c ea ed he u ili y “Cus ome Speci ic Dic iona ies”, dic iona ies ha a e c ea ed by use s wi h hei own speci ic e minology. O he de elopmen s led o he b inging o he MT echnology o he PC, and in 1995, SYSTRAN P o essional o Windows was launched. In 1996, SYSTRAN ecei ed a con ac om he US na ional Ai In elligence Cen e o de elop se e al Eas e n Eu opean MT language pai s. O he companies, such as Seiko Ins umen s Inc. o Fo d Mo o Company, inco po a ed SYSTRAN MT o hei wo k and in 1997, BabelFish, he i s online ansla ion sys em e e was launched powe ed by SYSTRAN’s echnology. F om ha momen on, MT usage has been eaching new heigh s, no el imp o emen s ha e been gained, mo e and mo e co po a ions ha e es ed he bene i s o MT in oday’s mul ilingual socie y and oday, 36 SYSTRAN MT pai s a e comme cially a ailable (Flanagan & McClu e, 2002). As o he sys em cha ac e is ics, SYSTRAN can be desc ibed as a Fully Au oma ic Machine T ansla ion (FAMT) sys em based on he di ec app oach4, con aining a ce ain deg ee o modula i y5 o he poin ha nowadays i could almos be classi ied as a ans e sys em (Hu chins & Some s, 1992). Howe e , e en i SYSTRAN appea s o hold a clea sepa a ion be ween he phases o analysis, ans e and gene a ion, i canno be uly cha ac e ised as a ans e app oach o se e al easons, such as he e idence o inconsis ency in he applica ion o seman ic ea u es, o ha , despi e he labels, he e is no clea sepa a ion be ween he phases o ans e and gene a ion (Yus e-Rod igo & B aun- Chen, 2001). Mos SYSTRAN language pai s, being widely and in e na ionally used, ha e been e alua ed se e al imes in he cou se o he yea s; some o he e alua ions ha e been public and many o he s ha e been p i a e. Rep esen a i e ins ances o hese public e alua ions a e he one p esen ed by Halliday and B iss (1977), he one commissioned by he C.C.E. and pe o med by Van Slype (1979), o he one p esen ed by Heid (1988). 4 A di ec MT sys em simply ansla es sou ce language ex s o hei co esponding a ge language ex s in a wo d- o -wo d manne by means o bilingual dic iona ies inse ed in he sys em. Then he esul ing TL wo ds a e eo ganised acco ding o he TL sen ence con en ions. In o de o imp o e he ou pu quali y, some di ec MT sys ems also pe o m some mo phological analysis bu hey a ely analyse he sen ence s uc u e o he SL ex . Di ec MT di e en ia es i sel om wo mo e MT s a egies known as he ans e app oach and he in e lingua me hod, he o me ansla es using h ee s ages known as analysis, ans e and syn hesis, and he la e ansla es using one in e media e ep esen a ion which happens o be uni e sal o all languages and known as ‘in e lingua’. 5 ‘Modula i y con ibu es o ease he main enance and eusabili y o he sou ces and was hus an essen ial goal o SYSTRAN, whose linguis ic esou ces a e ex ensi e. The edesign has modula ised he code so ha he ou pu o each module is independen and can be used o ex e nal pu poses as well as o inpu o he subsequen module’ (Flanagan & McClu e, 2002). E alua ing he Ou pu Quali y o Machine T ansla ion Sys em: Sys an 4.0 193 3.1. The e alua ion SYSTRAN P emium 4.0, he speci ic so wa e ha has been e alua ed in he p esen s udy, is desc ibed a he SYSTRAN websi e (www.sys anso .com) as an MT sys em ha ‘allows you o manage sophis ica ed ansla ion p ojec s […] ex ends p oduc i i y le el o he maximum […] and con ains o e wo million wo ds and wen y e minology-speci ic domains’. I is a e y p ac ical sys em o pe sonal and small-business use, since i inco po a es i sel o he Mic oso Wo d ool o he Mic oso O ice so wa e, and use s can cu and pas e any ex hey wan o ansla e in hei compu e s, wi hou ha ing o ype i ou . Howe e , some use s a e usually soon discou aged due o some o he impe ec ions ha mos ansla ions show, since he sys em’s ou pu is no pe ec ; de ails abou he ou pu quali y and he u ili y o he sys em will be discussed in he nex sec ions. A non-expe use ’s ole was played by he e alua o so as o ca y ou he e alua ion o he sys em’s English-Spanish pai , wi h he main goal o d awing ou a numbe o conclusions ha could guide po en ial non-specialized use s o he sys em. As i was lis ed abo e, he e a e so many ways o e alua ing, ha many had o be le behind in he cu en e alua ion; some o hem because hey would no i he main goal o he e alua ion, and o he s because i would ha e been impossible o he assumed use o emba k on hem, since he/she is supposed o ha e no access o he in e nal unc ioning o he sys em. The e alua ion ca ied ou is based on he selec ion o h ee ex s o di e en gen es (na a i e, ou ism, and legal) ha con ained a bi a y combina ions o di e en phenomena. The easoning behind his selec ion was ha ing h ee ep esen a i e ex s o common s anda d a ie ies, use ul o he a e age use , di e en om each o he , and no ma kedly speci ic. A use is ee o choose any hing ha seems impo an o him/he o be e alua ed. Howe e , ac ing as he a e age use , he au ho de ised an e alua ion o he mos common ac o s his use would ake in o conside a ion when he/she is abou o buy an MT sys em o pe sonal o small-business use, such as cos -e ec i eness, obus ness, and use - iendliness. Besides, since his small s udy aims a helping use s make hei own e alua ions, his one was a black box e alua ion, gi en ha he use en isaged was a non- specialized one, who accesses he sys em simply o acqui e gene al in o ma ion and comp ehension o common and p ac ical ex s, as i was commen ed abo e. Hence, his po en ial use would wan he MT sys em no o make lawless high-quali y ansla ions in e ms o g amma and s yle o a e y speci ic ex ype, bu simply o ob ain a gene al unde s anding o un es ic ed ex s o iginally w i en in a di e en language. To his end, he ansla ions o a agmen o he beginning o he ale “Li le Snow Whi e” by he G im B o he s (consis ing on 380 wo ds), a agmen o a ou is b ochu e abou London (consis ing on 348 wo ds), and an ex ac o a wo king con ac (consis ing on 368 wo ds) we e unde aken, since hey p esen ed di e en linguis ic ea u es ha an a e age pe son could need o ansla e o pe sonal o small-business use: a domes ic and mo e subjec i e ex ( he ale), one ela ed o wo k ( he con ac ), and ano he one ha can be associa ed o bo h ields ( he b ochu e)6. Following he double pu pose o his pape , o e alua e he sys em and o help po en ial non-specialized use s o make hei own e alua ions, and in o de o de e mine he me hods o e alua ion used, i needs o be emembe ed ha his is a black box e alua ion and ha in 6 F agmen s o he h ee o iginal ex s and hei co esponding MT e sions appea in he Gene al Findings’ sec ion bellow. 194 Noa Tala án Zanón his ype o e alua ions, i may be dis inguished be ween an o e all assessmen o quali y and a mo e de ailed iden i ica ion o e o s. While he o me ends o p oduce mo e subjec i e e alua ions, he la e p o ides mo e objec i e p ac ical da a. Hence, a e e iewing he ISLE MT E alua ion Taxonomy (ISLE E alua ion Wo king G oup, 2003) i was decided o pe o m he e alua ion o he ex s on wo di e en le els, sen ence le el and ex le el, aking in o conside a ion in elligibili y (o comp ehensibili y), eadabili y, ideli y, e o analysis (o pos -edi abili y), and accu acy (o classi ica ion o e o s, conside ing punc ua ion, capi al le e s, mo phology, lexis, syn ax and s yle), ollowing he ISLE axonomy desc ip o s. In elligibili y o comp ehensibili y is one o he mos equen ly used ca ego ies o measu e he quali y o ou pu , and i exp esses how in elligible he ou pu o a ansla ion de ice is unde di e en condi ions, and he ease wi h which a eade can unde s and he ansla ion. The me hod used o assess in elligibili y in he p esen e alua ion in ol ed asking h ee di e en people o ead and e alua e each sen ence o each ex and each ex in i s en i e y on a scale o 1 o 4 o in elligibili y: ‘unin elligible’ (no hing o almos no hing o he message is comp ehensible), ‘ba ely in elligible’ (only a pa o he con en is unde s andable, ep esen ing less han i y pe cen o he message), ‘ ai ly in elligible’ ( he majo pa o he message passes as in elligible), ‘ e y in elligible’ (all he con en o he message is comp ehensible, e en i he e a e e o s o s yle and/o spelling, and i ce ain wo ds a e missing, o a e badly ansla ed bu close o he a ge language. Readabili y is a compa ison o he ime i akes o ead a ex ansla ed by an MT sys em and he eading ime spen in eading a human ansla ion o he same ex . This me hod was used as an indica ion o bo h he eadabili y and he in elligibili y o he ansla ed ex s in he p esen e alua ion, since eading speed should inc ease along wi h in elligibili y. This compa ison was analysed h ough he h ee ex s, as compa ed o human ansla ions in e ms o eading imes o h ee people who knew no hing abou he ex s. Then, he amoun o ime necessa y o achie e su icien unde s anding o answe basic ques ions abou he ex was also measu ed, and he wo ds ead pe minu e (WPM) by he di e en indi iduals we e calcula ed (WPM = numbe o wo ds / eading ime). Ano he es o eadabili y pe o med was he Cloze Technique. This me hod is linked wi h ex ual cohesi eness and measu es he success o a eade in eplacing wo ds ha ha e been dele ed om a ansla ed ex . Th ee subjec s we e asked o ill in he blanks and hen he sco e was de e mined by he numbe o co ec esponses (ei he he exac wo d o any wo d ha yields a pa aph ase o he o iginal ex ). The wo ds dele ed we e chosen a andom e e y 6 o 12 wo ds. The eadabili y o he ansla ed ex , as measu ed by his echnique, is also assumed o be co ela ed wi h in elligibili y. In o de o assess ideli y7, Leh be be & Bou beau (1988: 208) ollow John B. Ca ol, who de ised an indi ec me hod o measu ing ideli y, ‘based on he in o ma i eness8 o he o iginal ela i e o he ansla ed ex : a e diges ing he meaning o he la e , he a e is hen asked o ead he o iginal ex and see how much in o ma ion i adds o he ansla ed e sion. I he o iginal is e y in o ma i e ela i e o he ansla ed ex , he ideli y is low, and i i adds li le o no in o ma ion, he ideli y is high’. 7 De ined by he ISLE as ‘ he accu a eness and comple eness o he in o ma ion con eyed’. 8 De ined by he ISLE as ‘seman ic ideli y’; i ques ions whe he he ou pu e lec s he con en o he sou ce ex and whe he dis o ions o meaning occu . E alua ing he Ou pu Quali y o Machine T ansla ion Sys em: Sys an 4.0 195 Based on his me hod, he ideli y o he ex s used in he e alua ion was measu ed on a scale om 1 o 4 in e ms o he in o ma i eness o he o iginal ela i e o he ansla ion: 1 o e y in o ma i e, 2 o a he in o ma i e, 3 o no e y in o ma i e, and 4 o no in o ma i e a all. As a inal me hod o es ideli y, o see he ex en o which he ansla ed ex con ained he “same” in o ma ion as he o iginal, back ansla ion was used, ansla ing he ou pu back in o he o iginal language, and compa ing he esul wi h he o iginal ex ; a his s age, many o he sho comings we e magni ied by he double p ocess. E o analysis o pos -edi abili y is a me hod o e alua ion ha has appa en ly no been used e y much so a (Wagne , 1998). Howe e , he quali y o a ansla ion should be e lec ed in he ime needed o co ec ing e o s. This me hod has been adap ed o he pu poses o he p esen e alua ion, and his analysis has been measu ed by a emp ing o make he minimal numbe o co ec ions (dele ions, subs i u ions, addi ions, ea angemen s, e c.) necessa y o ende he MT “ aw” ansla ion ou pu accep able o in o ma ion pu poses. E o s we e simply coun ed and no weighed, since ‘a weigh ing acco ding o imp obabili y is useless i he e is no coope a ion wi h he de elope ’ (Wagne , 1998). This me ic is based on he in ui ion ha he ime equi ed o p oduce an accep able ansla ion om a aw MT ou pu is in e sely p opo ional o he o e all quali y o he aw ansla ion. In he p esen s udy, he ollowing measu emen was used o compa e he h ee ex s: (numbe o minu es spen in co ec ion) / ( o al numbe o wo ds in ex ) x 10= co ec ion ime. A he same ime, each addi ion o dele ion o a wo d was coun ed, as well as each subs i u ion o one wo d by ano he , e c., and he pe cen age o co ec ed wo ds in he whole ex was calcula ed. Finally, he e alua ion o accu acy o classi ica ion o e o s was pe o med acco ding o he ollowing ca ego ies: lexical e o s, syn ac ic e o s, un ansla ed wo ds, mo phological e o s, w ong punc ua ion, w ong use o capi al le e s, and s ylis ic e o s. Bea ing in mind ha a gi en ansla ion e o may be he mani es a ion o a ious in e ela ed linguis ic phenomena, he mos cha ac e is ic o mos s aigh o wa d phenomenon was chosen, making he dis inc ion, when necessa y, be ween Sou ce language (hence o h SL) phenomenon and Ta ge Language (hence o h TL) phenomenon, so as o imp o e he unde s anding o he sys em’s capabili y and i s linguis ic pe o mance. 4. GENERAL FINDINGS Ha ing submi ed he h ee ep esen a i e ex s o he sys em and ha ing analysed he esul s o hei co esponding e alua ions, he i s aspec o highligh is ha he o e all ou pu o all h ee ex s is a he comp ehensible and in elligible, in spi e o he exis ence o a ce ain numbe o e o s o di e en ypes, wi h di e en deg ees o signi icance in he h ee ex s. Thus, a e unde aking a de ailed analysis o he a ge ex s p oduced unde he di e en e alua ion me hods and echniques discussed abo e, a se ies o aspec s ela ed o se e al ele an indings need o be poin ed ou . -Fi s o all, he ansla ion o he ollowing ypes o linguis ic s uc u es be ween English and Spanish cause e o s in e ms o accu acy: TL nega i e s uc u es, TL subjunc i e s uc u es, SL s uc u es wi h “ o-in ini i e”, SL complex noun ph ases and noun + noun s ings, SL mul i-wo d e bs, anapho ic ela ionships o gende and numbe wi hin sen ences, and he main enance o he SL ex capi al le e s. The e we e o he 196 Noa Tala án Zanón speci ic e o s, bu hese we e he mos epea ed ones. Some ep esen a i e ins ances o hese accu acy e o s a e lis ed below: TL nega i e s uc u es: Example aken om he ale: The Queen was ho i ied, and om ha momen en y and p ide g ew in he hea like ank weeds, un il one day she called a hun sman and said "Take he child away in o he woods and kill he , o I can no longe bea he sigh o he . And when you e u n b ing wi h you he hea , ha I may know you ha e obeyed my will." This was ansla ed as: Ho o iza on a la eina, y a pa i de ese momen o la en idia y el o gullo c ecie on en su co azón como malas hie bas espesas, has a un día ella llamó un hun sman y una " oma dicha el niño ausen e en las made as y le ma a, po que no puedo ningún oso más la go la is a de ella. Y cuando us ed de uel a ae con us ed su co azón, que puedo conoce le ha obedecido mi olun ad.". TL subjunc i e s uc u es: Example aken om he ale: Long, long ago, in he win e - ime, when he snow lakes we e alling like li le whi e ea he s om he sky, a beau i ul Queen sa beside he window, which was amed in black ebony, and s i ched. As she wo ked, she looked some imes a he alling snow, and so i happened ha she p icked he inge wi h he needle, so ha h ee d ops o blood ell upon he snow. How p e y he ed blood looked upon he dazzling whi e! The Queen said o he sel as she saw i , "Ah me! I only I had a dea li le child as whi e as he snow, as osy as he blood, and wi h hai as black as he ebony window- ame." This was ansla ed as: La ga, la go hace, en el in ie no, cuando los copos de nie e caían como pequeñas plumas blancas del cielo, una eina he mosa se sen ó al lado de su en ana, cuál ue enma cado en ébano neg o, y cosido. Mien as que ella abajó, ella mi aba a eces la nie e que caía, y así que sucedió que ella pinchó su dedo con su aguja, de modo que es go as de la sang e baja an sob e la nie e. ¡Cómo es boni o la sang e oja mi aba sob e el blanco del deslumb amien o! ¡La eina dijo a se como ella la io, "ampe io ho a yo! Si solamen e enía un pequeño niño que ido an blanco como la nie e, an a ac i a como la sang e, y con del pelo neg o an como el en ana-ma co del ébano." SL complex noun ph ases and SL s uc u es wi h o-in ini i e: Example aken om he ou is b ochu e: London is made up o many a ied and qui e dis inc dis ic s, all o e ing a unique selec ion o a ac ions, places o s ay and nume ous places o ea : Bankside, s e ches om Sou hwa k B idge o jus beyond Towe B idge, enhancing bo h old and new London. Look ou o The Towe o London, he new Millennium B idge, Shakespea e's Globe Thea e , he Ta e Mode n, Sou hwa k Ca hed al, and plen y o ashionable shops and es au an s a Hay's Galle ia. This was ende ed as: Lond es se compone de muchos a iados y de dis ic os absolu amen e dis in os, odo o eciendo una selección única de a acciones, luga es pa a pe manece y los luga es E alua ing he Ou pu Quali y o Machine T ansla ion Sys em: Sys an 4.0 197 nume osos a come : Bankside, es i amien os del puen e de Sou hwa k a jus o más allá del puen e de la o e, ealzando Lond es iejo y nue o. Mi e hacia ue a pa a La o e de Lond es, el puen e nue o del milenio, Tea o del globo de Shakespea e, el Ta e mode no, ca ed al de Sou hwa k, y un mon ón de iendas y de es au an es de moda en Galle ia del heno. Noun+noun s ings: Example aken om he con ac : Be ween CATERING & INDUSTRIAL PERSONNEL LIMITED, an Employmen Business (HEREINAFTER REFERRED TO AS “WE) AND THE TEMPORAL WORKER (HERIENAFTER REFERRED TO AS “YOU”) This was ansla ed as: En e el ABASTECIMIENTO y PERSONAL INDUSTRIAL LIMITADOS, un negocio del empleo (MÁS ABAJO DESIGNADO "NOSOTROS”) Y EL TRABAJADOR TEMPORAL (HERIENAFTER REFERIDO COMO "USTED") SL mul i-wo d e bs: Example aken om he ale: Bu as ime passed on, Li le Snow-Whi e g ew mo e and mo e beau i ul, un il when she was se en yea s old, she was as lo ely as he b igh day, and s ill mo e lo ely han he Queen he sel , so ha when he lady one day asked he mi o - This was ansla ed as: Sino como el iempo pasado encendido, poco Nie e-Blanco c eció más y más he moso, has a cuando ella e a sie e años de iejo, ella e a an encan ado como el día b illan e, y aún más encan ado que la eina misma, de modo que cuando la seño a un día pidió su espejo. Anapho ic e e ences: Ins ance aken om he con ac : We shall pay o you emune a ion calcula ed a no less han a minimum hou ly a e o £3.60 pe hou , which shall be no i ied o you on a pe assignmen basis o each hou wo ked o be paid weekly subjec o such deduc ions ela ing o PAYE as a e equi ed by Sec ion 134 o he Taxes Ac 1988 and all o he such deduc ions equi ed by law o make. This was ende ed as: Le paga emos la emune ación calculada en no menos que un p ecio po ho a mínimo de £3.60 po la ho a, que se á no i icada a us ed en a po la base de la asignación pa a cada ho a abajada pa a se pagado semanalmen e con o me a ales deducciones e e en e a PAYE como son eque idos po Sec ion 134 del ac o 1988 de los impues os y de el es o de las ales deducciones eque idas po la ley pa a hace . (Ins ead o ‘ e e en es’) Capi al le e s: Example aken om he b ochu e: The Eas End has a ib an a is ic scene, one o London's hippes dis ic s wi h con empo a y ba s, es au an s, shops and ma ke s. G eenwich, o he sou h and eas is home o he Me idian Line, a he Royal Obse a o y, he Na ional Ma i ime Museum and he in amous Dome. In Holbo n, buildings da e back o he 15 h cen u y. This is London's legal epicen e .