A u h o e a l
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS
www.ij ca .com
Vol.13 Issue 11, Pg.: 98-121
No embe 2025
D a n K u p a s a
Page 98
INTERNATIONAL JOURNAL OF
RESEARCH IN COMPUTER
APPLICATIONS AND ROBOTICS
ISSN 2320-7345
SIGN LANGUAGE INTERPRETER USING
MACHINE LEARNING
Dan Kupa sa
BACHELOR OF SCIENCE IN COMPUTER SCIENCE
DMI ST JOHN THE BAPTIST UNIVERSITY SCHOOL OF COMPUTER SCIENCE LILONGWE,
MALAWI
Abs ac
Sign language in e p e e s play a c ucial ole in acili a ing communica ion be ween dea
o ha d-o -hea ing indi iduals and hose who do no use sign language. Thei wo k
ex ends ac oss a ious se ings, including educa ional ins i u ions, heal hca e acili ies,
legal p oceedings, and public e en s. This abs ac explo es he impo ance o sign
language in e p e a ion, highligh ing he linguis ic, cul u al, and e hical conside a ions
in ol ed. Addi ionally, i examines he skills equi ed o e ec i e in e p e a ion, such as
luency in sign language, cogni i e p ocessing speed, and adap abili y in di e se
en i onmen s. The documen also discusses challenges in e p e e s ace, including
main aining accu acy, con eying emo ions, and ensu ing inclusi i y. As socie y mo es
owa d g ea e accessibili y, he ole o sign language in e p e e s emains indispensable
in os e ing equal communica ion oppo uni ies o all.
CHAPTER I
INTRODUCTION
1.1 Backg ound o s udy
A backg ound s udy on sign language in e p e a ion ypically explo es he his o ical
de elopmen , signi icance, and cu en p ac ices wi hin he ield. He e‘s an o e iew:
1. His o ical Con ex :
Sign languages ha e been in use o cen u ies, e ol ing wi hin dea communi ies wo ldwide.
The o maliza ion o sign language in e p e a ion gained p ominence in he 20 h cen u y,
pa icula ly wi h inc eased ad ocacy o accessibili y and equal communica ion igh s.
2. Impo ance o Sign Language In e p e a ion:
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS
www.ij ca .com
Vol.13 Issue 11, Pg.: 98-121
No embe 2025
D a n K u p a s a
Page 99
Sign language in e p e e s play a i al ole in b idging communica ion gaps be ween dea
indi iduals and he hea ing popula ion. Thei wo k ensu es inclusi i y ac oss a ious sec o s,
including educa ion, heal hca e, legal p oceedings, and public se ices.
3. Linguis ic and Cul u al Conside a ions:
Sign languages a e dis inc , ully de eloped languages wi h hei own g amma , syn ax, and
egional a ia ions. In e p e e s mus be p o icien in sign language and unde s and cul u al
nuances o ensu e e ec i e and espec ul communica ion.
4. Skills and T aining:
Sign language in e p e e s equi e ex ensi e aining, including language p o iciency, cogni i e
p ocessing speed, and e hical conside a ions. Many coun ies ha e ce i ica ion p og ams o
ensu e high s anda ds o in e p e a ion.
5. Challenges and Fu u e Di ec ions:
In e p e e s o en ace challenges such as main aining accu acy in eal- ime ansla ion,
con eying emo ions, and adap ing o di e en con ex s. The in eg a ion o echnology, such as
AI-assis ed in e p e a ion and ideo elay se ices, is shaping he u u e o he p o ession.
1.2 OBJECTIVES
1.To Analyze he Role o Sign Language In e p e e s – Examine hei impac on communica ion
accessibili y in a ious se ings, such as educa ion, heal hca e, and legal p oceedings.
2.To Iden i y Key Skills Requi ed o E ec i e In e p e a ion – In es iga e he linguis ic
p o iciency, cogni i e abili ies, and e hical conside a ions necessa y o in e p e e s o pe o m
hei du ies e ec i ely.
3. To Explo e Challenges Faced by Sign Language In e p e e s – Assess di icul ies such as
main aining accu acy, con eying emo ions, and adap ing o di e en communica ion con ex s.
4.To E alua e he Impo ance o Cul u al Sensi i i y – Unde s and how cul u al nuances
in luence sign language in e p e a ion and i s e ec i eness in di e se communi ies.
5.To Examine Technological Ad ancemen s in In e p e a ion – In es iga e he ole o AI-assis ed
in e p e a ion, ideo elay se ices, and digi al pla o ms in shaping he u u e o sign language
in e p e a ion.
6.To P opose S a egies o Imp o ing Accessibili y– De elop ecommenda ions o enhance
in e p e e aining, ce i ica ion, and in eg a ion in o a ious p o essional ields.
1.3 SYSTEM DESCRIPTION
1. Sys em O e iew
The sign language in e p e ing sys em acili a es communica ion be ween indi iduals who use
sign language and hose who ely on spoken o w i en language. I ensu es accessibili y in
a ious en i onmen s, such as educa ion, heal hca e, legal se ings, and public se ices.
2. Componen s o he Sys em
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS
www.ij ca .com
Vol.13 Issue 11, Pg.: 98-121
No embe 2025
D a n K u p a s a
Page 100
- Human In e p e e s: T ained p o essionals luen in sign language who in e p e
con e sa ions in eal ime.
- Technological Tools: Video elay se ices (VRS), AI-powe ed in e p e a ion so wa e,
and eal- ime cap ioning.
- Inpu & Ou pu Modali ies: Sign language, spoken language, ex -based
communica ion, and acial exp essions o con ex ual meaning.
3. In e p e a ion P ocess
1.Recogni ion: The in e p e e o sys em cap u es he sign language inpu ia isual
obse a ion o mo ion senso s.
2.P ocessing & T ansla ion: Con e s sign language in o spoken o w i en language (o ice
e sa) while main aining accu acy, emo ional in en , and cul u al nuances.
3.Deli e y: The in e p e ed message is con eyed ei he h ough speech, ex , o sign language,
depending on he ecipien ‘s needs.
4. Challenges & Conside a ions
- Accu acy & Speed: Ensu ing eal- ime in e p e a ion wi hou losing meaning.
- Cul u al Sensi i i y: Unde s anding di e en dialec s and con ex ual exp essions.
- Technology Limi a ions: AI in e p e a ion is e ol ing bu no ye as nuanced as human
in e p e e s.
- Use Accessibili y: Sys ems mus be designed o accommoda e di e se needs, including
di e en sign language a ian s and egional adap a ions.
5. Fu u e Enhancemen s
- AI-powe ed ges u e ecogni ion o imp o e in e p e a ion accu acy.
- Wea able de ices ha p o ide eal- ime language ansla ion.
- In eg a ion wi h augmen ed eali y (AR) o imme si e communica ion expe iences.
1.4 LITERATURE REVIEW
1. In oduc ion
The li e a u e e iew p o ides an o e iew o academic and p o essional esea ch on sign
language in e p e a ion. I explo es his o ical de elopmen s, linguis ic heo ies, challenges, and
inno a ions ha shape he p o ession oday.
2. His o ical Pe spec i es
- Ea ly documen a ion o sign languages, such as s udies on Ame ican Sign Language (ASL),
B i ish Sign Language (BSL), and o he egional sign languages.
- The ecogni ion o sign languages as ully de eloped languages wi h unique g amma and
syn ax.
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS
www.ij ca .com
Vol.13 Issue 11, Pg.: 98-121
No embe 2025
D a n K u p a s a
Page 101
- G ow h o in e p e e ce i ica ion p og ams and accessibili y egula ions o e ime.
3. Linguis ic & Cogni i e F amewo ks
- S udies on he cogni i e p ocessing equi ed o simul aneous in e p e a ion.
- Resea ch on how sign languages di e s uc u ally om spoken languages.
- The ole o acial exp essions and non-manual ma ke s in sign language communica ion.
4. Challenges in In e p e a ion
- Accu acy in eal- ime ansla ion and he isk o misin e p e a ion.
- The impac o dialec al a ia ions and egional sign language di e ences.
- Emo ional and cul u al conside a ions when in e p e ing sensi i e opics.
5. Technological Ad ancemen s
- Use o A i icial In elligence (AI) o au oma ed sign language ansla ion.
- De elopmen o wea able de ices and mo ion-sensing glo es o sign ecogni ion.
- Video elay se ices (VRS) imp o ing emo e accessibili y o dea indi iduals.
6. Fu u e Di ec ions & Resea ch Gaps
- The need o imp o ed AI-assis ed in e p e a ion ha cap u es nuances o human emo ion
and dialec ical di e ences.
- Mo e esea ch on in e p e e aining me hods o enhance cogni i e speed and accu acy.
- The explo a ion o imme si e echnologies like augmen ed eali y (AR) in acili a ing sign
language in e p e a ion.
CHAPTER II SYSTEM ANALYSIS
2.1 In oduc ion
Sys em analysis plays a c i ical ole in e alua ing he e ec i eness, e iciency, and
adap abili y o sign language in e p e a ion sys ems. I in ol es examining a ious
componen s, including human in e p e e s, echnological ools, communica ion p ocesses, and
accessibili y mechanisms. Th ough sys em analysis, esea che s and de elope s can iden i y
challenges, op imize exis ing me hods, and p opose enhancemen s o be e communica ion
be ween dea and hea ing indi iduals.
This analysis explo es key aspec s such as linguis ic accu acy, eal- ime p ocessing, cul u al
conside a ions, and echnological ad ancemen s, including AI-powe ed in e p e a ion and
ideo elay se ices. By unde s anding he in e ac ion be ween in e p e e s, use s, and
assis i e echnologies, sys em analysis aims o imp o e accessibili y and inclusi i y in di e se
en i onmen s.
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS
www.ij ca .com
Vol.13 Issue 11, Pg.: 98-121
No embe 2025
D a n K u p a s a
Page 102
2.2 PROBLEM DEFINITION
E ec i e communica ion be ween dea o ha d-o -hea ing indi iduals and hose who do no
use sign language is c ucial o accessibili y and inclusi i y. Despi e ad ancemen s in sign
language in e p e a ion, se e al challenges pe sis , including accu acy, eal- ime ansla ion,
cul u al sensi i i y, and echnological limi a ions.
The p oblem a ises due o he complexi y o sign languages, which in ol e dis inc
g amma ical s uc u es, acial exp essions, and egional a ia ions. Human in e p e e s ace
di icul ies in main aining speed, p ecision, and emo ional nuance, while au oma ed sys ems
s uggle wi h ull linguis ic and con ex ual comp ehension. Addi ionally, accessibili y gaps
emain in educa ion, heal hca e, and legal se ings, limi ing equal oppo uni ies o dea
indi iduals.
This s udy aims o analyze exis ing in e p e a ion me hods, iden i y sho comings, and explo e
po en ial solu ions, such as imp o ed in e p e e aining, AI-powe ed in e p e a ion ools, and
in eg a ed echnological amewo ks o enhance communica ion equi y.
2.3 EXISTING SYSTEM
The cu en sys ems o sign language in e p e a ion ely on wo p ima y app oaches: human
in e p e e s and echnological solu ions. These me hods enable communica ion be ween dea
indi iduals and hose who do no use sign language, bu each has i s own s eng hs and
limi a ions.
1. Human In e p e a ion
P o essional Sign Language In e p e e s: T ained indi iduals who in e p e spoken language
in o sign language and ice e sa in eal- ime.
Video Relay Se ices (VRS): Remo e in e p e a ion se ices whe e use s connec wi h
in e p e e s ia ideo calls.
Limi a ions: A ailabili y o in e p e e s, in e p e a ion accu acy in specialized ields (e.g.,
medical o legal con ex s), and a igue in eal- ime communica ion.
2. Technological Solu ions
AI-Based Sign Language T ansla o s: Machine lea ning models ained o ecognize signs and
ansla e hem in o ex o speech.
Mo ion-Sensing De ices: Wea able echnology and glo es equipped wi h senso s o cap u e
hand mo emen s and ansla e hem in o wo ds.
Au oma ed Cap ions: Speech ecogni ion so wa e ha ansc ibes spoken con en in eal ime
o aid communica ion.
Limi a ions: AI s uggles wi h complex g amma , acial exp essions, and emo ional nuances
c i ical o sign language communica ion.
3. Challenges in he Exis ing Sys em
Accu acy Issues: AI-based solu ions ha e di icul y unde s anding egional sign language
a ia ions.
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS
www.ij ca .com
Vol.13 Issue 11, Pg.: 98-121
No embe 2025
D a n K u p a s a
Page 103
Limi ed Accessibili y: Many public ins i u ions lack adequa e in e p e a ion se ices.
Cul u al Sensi i i y: In e p e e s mus g asp con ex , one, and cul u al nuances o ensu e
meaning ul communica ion.
2.4 FEASIBILITY STUDY
A easibili y s udy e alua es he p ac icali y and iabili y o implemen ing o imp o ing a sign
language in e p e a ion sys em. I conside s echnical, economic, legal, ope a ional, and
scheduling aspec s o de e mine i he sys em can be success ully de eloped and sus ained.
1. Technical Feasibili y
Technology A ailabili y: Assessing exis ing ools like AI-powe ed in e p e a ion, mo ion-
sensing de ices, and ideo elay se ices.
Sys em In eg a ion: Compa ibili y wi h a ious pla o ms (e.g., heal hca e, educa ion, and
legal ins i u ions).
Challenges: AI‘s abili y o ecognize ges u es, acial exp essions, and emo ional nuances
accu a ely.
2. Economic Feasibili y
Cos o Implemen a ion: E alua ing expenses o in e p e e aining, echnology acquisi ion,
and sys em main enance.
Funding Sou ces: Go e nmen g an s, co po a e sponso ships, and non-p o i ini ia i es.
Re u n on In es men (ROI): The long- e m bene i s o imp o ed communica ion
accessibili y.
3. Legal Feasibili y
Compliance wi h Accessibili y Laws: Ensu ing he sys em mee s disabili y igh s and
communica ion accessibili y egula ions.
Da a P i acy Conce ns: Add essing secu i y issues in AI-based in e p e a ion se ices.
S anda diza ion: De eloping uni e sal guidelines o sign language ansla ion sys ems.
4. Ope a ional Feasibili y
Use Adop ion: E alua ing how dea indi iduals, in e p e e s, and o ganiza ions will in e ac
wi h he sys em.
T aining Requi emen s: P epa ing p o essionals o use ad anced in e p e a ion ools
e ec i ely.
Scalabili y: Ensu ing he sys em can expand o mee g owing demand.
5. Scheduling Feasibili y
P ojec Timeline: Es ima ing he du a ion equi ed o esea ch, de elopmen , es ing, and
deploymen .
Miles ones & Deli e ables: Se ing achie able goals wi hin ealis ic ime ames.
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS
www.ij ca .com
Vol.13 Issue 11, Pg.: 98-121
No embe 2025
D a n K u p a s a
Page 104
2.5 PROPOSED SYSTEM
Sys em Componen s
1. Ges u e Recogni ion Module
- U ilizes came as o senso s o cap u e hand mo emen s, acial exp essions, and body
ges u es.
- Machine lea ning models ained o ecognize a ious signs in di e en sign language
dialec s.
2. T ansla ion Engine
- Con e s ecognized signs in o spoken o w i en language.
- Can include con ex ual unde s anding o imp o ed accu acy.
3. Speech- o-Sign Module
- Con e s spoken o w i en language in o sign language anima ions o holog aphic
ep esen a ions.
- O e s eal- ime eedback o ensu e luid communica ion.
4. Use In e ace
- In ui i e in e ace o bo h signe s and non-signe s.
- Could include mobile, web, o wea able de ices o accessibili y.
5. Cloud-based P ocessing & AI T aining
- Con inuous lea ning o imp o e accu acy o e ime.
- Cloud-based s o age allows o upda es and expansion o ocabula y.
2.6 SYSTEM OBJECTIVE
The objec i e o a Sign Language In e p e e Sys em is o acili a e seamless communica ion
be ween sign language use s and non-signe s by le e aging echnology. He e a e he key
objec i es:
1. Accessibili y & Inclusi i y
- Ensu e dea and ha d-o -hea ing indi iduals can communica e e ec i ely wi h non-signe s.
- Enable b oade pa icipa ion in educa ion, wo kplaces, heal hca e, and public se ices.
2. Real- ime T ansla ion
- P o ide ins an con e sion o sign language in o ex o speech.
- Allow spoken o w i en language o be ans o med in o sign language anima ions.
3. Accu acy & Con ex Awa eness
- Employ AI o unde s and con ex , emo ions, and nuances in sign language.
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS
www.ij ca .com
Vol.13 Issue 11, Pg.: 98-121
No embe 2025
D a n K u p a s a
Page 105
- Reduce ansla ion e o s by e ining ecogni ion models.
4. Mul i-language Suppo
- Accommoda e di e en sign language a ia ions (e.g., ASL, BSL, ISL).
- Enable c oss-language communica ion o in e na ional in e ac ions.
5. De ice Compa ibili y & Use -F iendliness
- De elop solu ions o mobile, web, and wea able de ices.
- Ensu e an in ui i e and adap i e in e ace o ease o use.
2.7 SYSTEM SPECIFICATION
1. Ha dwa e Requi emen s
- Came a/Senso s: High- esolu ion came as o dep h senso s (e.g., LiDAR, in a ed)
o ges u e ecogni ion.
- P ocessing Uni : Dedica ed GPU (e.g., NVIDIA RTX se ies) o TPU o AI-d i en
eal- ime p ocessing.
- Mic ophone ( o speech- o-sign module): High-quali y noise- il e ing mic ophone
o oice inpu .
- Display: Touch sc een, wea able display (AR glasses), o holog aphic p ojec o o
sign isualiza ion.
- S o age: Cloud o local s o age o lea ned sign language models and eal- ime da a
caching.
2. So wa e Requi emen s
- Ope a ing Sys em: Windows, Linux, macOS, o mobile OS (And oid, iOS) o c oss-
pla o m use.
- P og amming Languages: Py hon (Tenso Flow, OpenCV), C++ (Compu e
Vision),
Ja aSc ip (Web In eg a ion).
- AI & ML F amewo ks: Tenso Flow, PyTo ch, MediaPipe, OpenAI Whispe o sign
ecogni ion.
- Na u al Language P ocessing (NLP): T ans o me -based models (GPT, BERT) o con ex
awa e ansla ions.
- Cloud Se ices: AWS, Google Cloud, Azu e o model aining and da a p ocessing.
3. Ne wo k & Connec i i y
- In e ne : Cloud-based AI p ocessing equi es s able in e ne connec ion.
- Blue oo h/Wi-Fi: Fo wea able de ice communica ion (e.g., sma glo es).
- Edge Compu ing: Local AI p ocessing o o line unc ionali y.
4. Secu i y & P i acy
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS
www.ij ca .com
Vol.13 Issue 11, Pg.: 98-121
No embe 2025
D a n K u p a s a
Page 106
- Da a Enc yp ion: Secu e ansmission o sign language da a.
- Use Au hen ica ion: Biome ic au hen ica ion o pe sonalized se ings.
- E hical AI Compliance: Fai and bias- ee model aining o inclusi i y.
CHAPTER III SYSTEM DESIGN
3.1 INTRODUCTION
A Sign Language In e p e e Sys em is designed o b idge communica ion be ween sign language
use s and non-signe s using echnology. The sys em employs a i icial in elligence, compu e
ision, and na u al language p ocessing o ecognize, ansla e, and gene a e sign language
ges u es.
Pu pose o he Sys em
The goal is o c ea e an inclusi e communica ion ool ha p o ides eal- ime ansla ion o
sign language in o ex o speech and ice e sa. This can be use ul in a ious se ings,
including educa ion, heal hca e, cus ome se ice, and social in e ac ions.
Key Design Conside a ion
1.Use -Cen ic In e ace – The sys em should be in ui i e and easy o use o bo h signe s and
non-signe s.
2. Ges u e Recogni ion – Accu a e and e icien sign language de ec ion using came as o
senso s.
3. T ansla ion Accu acy– AI models mus unde s and con ex , g amma , and a ia ions in sign
language.
4. Mul i-pla o m Accessibili y – A ailable on mobile, web, and wea able de ices o
con enience.
5. P i acy & Secu i y – Ensu ing use da a and in e ac ions a e p o ec ed.
3.2 SYSTEM ARCHITECTURE
Sys em A chi ec u e o a Sign Language In e p e e
The a chi ec u e o a Sign Language In e p e e Sys em consis s o mul iple componen s ha
wo k oge he o ecognize, ansla e, and gene a e sign language ges u es. Below is an
o e iew o i s laye ed a chi ec u e:
1. Inpu Laye (Ges u e & Speech Cap u e)
- Came a/Senso s – Cap u es hand mo emen s, acial exp essions, and body ges u es.
- Mic ophone – Reco ds spoken language o con e in o sign language.
- Touch/Tex Inpu – Allows use s o en e ex o sign ansla ion.
2. P ocessing Laye (AI & NLP Model Execu ion)
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS
www.ij ca .com
Vol.13 Issue 11, Pg.: 98-121
No embe 2025
D a n K u p a s a
Page 113
Modules
Tenso Flow
A lib a y o da a low and di e en iable p og amming used o a a ie y o applica ions
called Tenso Flow is ee and open sou ce so wa e.
OpenCV
A collec ion o p og amming unc ions wi h a ocus on eal- ime compu e ision is called
OpenCV
(Open Sou ce Compu e Vision collec ion).I was ini ially c ea ed by In el, hen backed by
Willow Ga age and I seez (which In el e en ually pu chased). Unde he e ms o he open-
sou ce BSD license, he lib a y is ee o use and c oss-pla o m.
Ke as
Py hon-based Ke as is an open-sou ce lib a y o neu al ne wo ks. I may unc ion on op o
Tenso Flow, Mic oso Cogni i e Toolki , R, Theano, o PlaidML, among o he amewo ks. I
ocuses on being use iendly, modula , and ex endable in o de o enable quick expe imen a ion
wi h deep neu al ne wo ks. I s majo in en o and main aine is F ançois Cholle , a Google
enginee , and i was c ea ed as a componen o he esea ch e o o p ojec ONEIROS (Open-
ended Neu o-Elec onic In elligen Robo Ope a ing Sys em). The XCep ion deep neu al ne wo k
model was also c ea ed by Cholle .
NumPy
A lib a y o he Py hon p og amming language called NumPy adds suppo o big,
mul idimensional a ays and ma ices as well as a on o high-le el ma hema ical ope a ions ha
can be pe o med on hese a ays. Jim Hugunin and a numbe o o he de elope s wo ked
oge he o p oduce Nume ic, he p edecesso o NumPy. By hea ily al e ing Nume ic and
combining ea u es om he i al Numa ay, T a is Oliphan buil NumPy in 2005. Nume ous
people con ibu e o NumPy, an opensou ce p og am.
CHAPTER VI SYSTEM IMPLEMENTATION
6.1 INTRODUCTION
A hand sign in e p e e sys em is designed o b idge communica ion gaps be ween
indi iduals who use sign language and hose who do no . The implemen a ion o such a
sys em ypically in ol es ha dwa e componen s (like came as o mo ion senso s) and
so wa e using machine lea ning o deep lea ning echniques o ecognize and ansla e
ges u es in o ex o speech.
The implemen a ion o a hand sign in e p e e sys em s a s wi h unde s anding he use
needs and selec ing he app op ia e echnology s ack. The main objec i es a e:
1. Cap u ing Hand Ges u es – Using came as o wea able senso s o eco d mo emen s.
2. P ocessing Da a – Applying image p ocessing echniques o iden i y sign language
ges u es.
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS
www.ij ca .com
Vol.13 Issue 11, Pg.: 98-121
No embe 2025
D a n K u p a s a
Page 114
3. Recogni ion & T ansla ion – Using ained AI models o classi y signs and con e hem
in o co esponding ex o speech.
4. Use In e ace Design – Ensu ing accessibili y o bo h sign language use s and non-sign
language use s.
6.2.2 CODING
FIGURE 3.7: CODE
FIGURE 3.8: CODE
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS
www.ij ca .com
Vol.13 Issue 11, Pg.: 98-121
No embe 2025
D a n K u p a s a
Page 115
FIGURE 3.9: CODE
6.2.1.1 FRONT END
FIGURE 3.10: FROND END
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS
www.ij ca .com
Vol.13 Issue 11, Pg.: 98-121
No embe 2025
D a n K u p a s a
Page 116
6.4.1.2 BACKEND
FIGURE 3.11: CODE
FIGURE 3.12: CODE
FIGURE 3.13: CODE
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS
www.ij ca .com
Vol.13 Issue 11, Pg.: 98-121
No embe 2025
D a n K u p a s a
Page 117
FIGURE 3.14: CODE
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS
www.ij ca .com
Vol.13 Issue 11, Pg.: 98-121
No embe 2025
D a n K u p a s a
Page 118
FIGURE 3.15: CODE
CHAPTER VII CONCULSION & FUTURE ENHANCEMENTS
7.1 CONCULSION
A sign language in e p e e plays a c ucial ole in b idging communica ion be ween dea o
ha d o hea ing indi iduals and he hea ing wo ld. Thei wo k ensu es accessibili y,
inclusion, and equal pa icipa ion in a ious se ings—whe he in educa ion, heal hca e, legal
p oceedings, o daily in e ac ions. By in e p e ing spoken language in o sign language and
ice e sa, hey empowe indi iduals o connec , unde s and, and exp ess hemsel es ully.
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS
www.ij ca .com
Vol.13 Issue 11, Pg.: 98-121
No embe 2025
D a n K u p a s a
Page 119
Ul ima ely, sign language in e p e e s a e no jus language acili a o s; hey a e ad oca es
o accessibili y and inclusion. Thei p esence s eng hens communi ies, os e s
unde s anding, and helps b eak communica ion ba ie s, ensu ing ha e e yone has he
oppo uni y o be hea d and unde s ood.
7.2 FUTURE ENHANCEMENTS
Fu u e enhancemen s o sign language in e p e a ion could include AI-powe ed in e p e e s,
imp o ing accessibili y h ough eal- ime digi al ansla ion. Ad ances in ges u e ecogni ion
echnology may enable mo e seamless communica ion, educing he eliance on human
in e p e e s in ce ain si ua ions.
Wea able echnology, like sma glo es ha de ec sign language mo emen s and con e
hem in o ex o speech, could p o ide an inno a i e solu ion. Imp o emen s in **VR and
AR** could c ea e imme si e lea ning expe iences o sign language use s, making
educa ion and aining mo e in e ac i e.
Addi ionally, legisla i e ad ancemen s and b oade awa eness campaigns can ensu e sign
language in e p e a ion becomes a s anda d in wo kplaces, educa ion, and public se ices—
s eng hening inclusi i y o he dea and ha d-o -hea ing communi ies.
Re e ences
1. Kuma , A., & Sha ma, R. (2024). Sign language in e p e a ion using machine lea ning
and a i icial in elligence. Neu al Compu ing and Applica ions.
h ps://link.sp inge .com/a icle/10.1007/s00521-02410395-9
2. Singh, P., & Kau , G. (2023). In e p e a ion o Sign Language Using Machine
Lea ning. IEEE Xplo e. h ps://ieeexplo e.ieee.o g/documen /10877588
3. Pa el, H., & Desai, M. (2024). A Re iew on Sign Language Recogni ion Sys em
using Machine Lea ning. In e na ional Jou nal o Resea ch and Analy ical
Re iews (IJRAR). h ps://ij a .o g/pape s/IJRAR24B1244.pd
4. Alonso, J. M., & Ma inez, R. (2021). A i icial In elligence Technologies o Sign
Language. Senso s, 21(17), 5843. h ps://www.mdpi.com/1424-8220/21/17/5843
5. Choudhu y, S., & Bane jee, A. (2025). Ad ancemen s in Machine Lea ning Techniques
o Hand Ges u e-Based Sign Language Recogni ion. A chi es o Compu a ional
Me hods in Enginee ing. h ps://link.sp inge .com/a icle/10.1007/s11831-025-10258-z
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS
www.ij ca .com
Vol.13 Issue 11, Pg.: 98-121
No embe 2025
D a n K u p a s a
Page 120
6. Ahmed, T., & Malik, S. (2025). Real-Time Ges u e Recogni ion o Sign Language
Using Machine Lea ning. IEEE Xplo e. h ps://ieeexplo e.ieee.o g/documen /10871766
7. Rao, V., & Pillai, M. (2023). A Su ey o Ad ancemen s in Real-Time Sign Language
T ansla o s:
8. In eg a ion wi h IoT Technology. Technologies, 11(4), 83.
h ps://www.mdpi.com/2227-7080/11/4/83 Mwale, C., & Banda, T. (2025). Challenges
and Inno a i e Solu ions in Sign Language Communica ion.
9. Jou nal o Eme ging Technologies and Inno a i e Resea ch, 12(6), 828–835.
10. h ps://www.je i .o g/pape s/JETIR2506828.pd
11. Signapse.ai. (2025). Signapse: AI Sign Language T ansla o o ASL & BSL.
h ps://www.signapse.ai/
12. Royal Academy o Enginee ing. (2025). Te p360: Real-Time Speech- o-Sign Language
App Using 3D A a a s. h ps://www.yahoo.com/news/a icles/app- ansla es-speech-
sign-language-111731164.h ml
13. Ras ogi, U., Mahapa a, R. P., & Kuma , S. (2025). Ad ancemen s in machine lea ning
echniques o hand ges u e-based sign language ecogni ion: A comp ehensi e
e iew. A chi es o Compu a ional Me hods in Enginee ing, 32, 4265–4302.
h ps://link.sp inge .com/a icle/10.1007/s11831-025-10258-z
14. Papa simouli, M., Sa igiannidis, P., &F agulis, G. F. (2023). A su ey o
ad ancemen s in eal ime sign language ansla o s: In eg a ion wi h IoT echnology.
Technologies, 11(4), 83.
15. h ps://www.mdpi.com/2227-7080/11/4/83
16. Sa a ia, E. (2025). Te p360: Real- ime speech- o-sign language app using 3D
a a a s. Royal Academy o Enginee ing.
h ps://www.yahoo.com/news/a icles/app- ansla es-speech-signlanguage-
111731164.h ml
17. Signapse.ai. (2025). Add essing he challenges o sign language in e p e a ion.
18. h ps://www.signapse.ai/pos /add essing- he-challenges-o -sign-language-
in e p e a ion
19. MLTMS. (2025). Sign language in e p e a ion in he digi al age: Challenges and
inno a ions. h ps://www.ml ms.o g/sign-language-in e p e a ion-in- he-digi al-age-
challenges-andinno a ions/
20. Ka a Technologies. (2025). How we ansla e sign language wi h AI suppo in only 3
s eps.
21. h ps://www.ka a. ech/pos /applied-ai-sign-language- ansla ion
22. G asp.in o. (2025). Sign language ansla o – F ee online AI ool.
h ps://g asp.in o/ ools/signlanguage- ansla o
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS
www.ij ca .com
Vol.13 Issue 11, Pg.: 98-121
No embe 2025
D a n K u p a s a
Page 121
23. Simple Science. (2025). Ad ancemen s in sign language ansla ion echnology.
24. h ps://scisimple.com/en/a icles/2025-08-18-ad ancemen s-in-sign-language-
ansla ion echnology--a3dde11
25. Nagish. (2025). Nagish acqui es sign.m o d i e esea ch in AI and sign language.
h ps:// inance.yahoo.com/news/nagish-acqui es-sign-m -d i e-130000135.h ml
26. Gi Hub Con ibu o s. (2024). Sign-language- ecogni ion-sys em. Gi Hub.
27. h ps://gi hub.com/ opics/sign-language- ecogni ion-sys em
