Thesis Open Access

REALTIME ETHIOPIAN SIGN LANGUAGE ALPHABET RECOGNITION VIA COMPUTER VISION AND MOTION SENSOR

EYOB BOKRU BERHE


MARC21 XML Export

<?xml version='1.0' encoding='UTF-8'?>
<record xmlns="http://www.loc.gov/MARC21/slim">
  <leader>00000nam##2200000uu#4500</leader>
  <controlfield tag="005">20241128092026.0</controlfield>
  <controlfield tag="001">4196</controlfield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">647925</subfield>
    <subfield code="z">md5:d45cbd5fd89e1d88df48cadeabb670f7</subfield>
    <subfield code="u">https://zenodo.org/record/4196/files/f1042664640.pdf</subfield>
  </datafield>
  <datafield tag="542" ind1=" " ind2=" ">
    <subfield code="l">open</subfield>
  </datafield>
  <datafield tag="260" ind1=" " ind2=" ">
    <subfield code="c">2021-10-01</subfield>
  </datafield>
  <datafield tag="909" ind1="C" ind2="O">
    <subfield code="p">user-aastu</subfield>
    <subfield code="p">user-zenodo</subfield>
    <subfield code="o">oai:zenodo.org:4196</subfield>
  </datafield>
  <datafield tag="100" ind1=" " ind2=" ">
    <subfield code="a">EYOB BOKRU BERHE</subfield>
  </datafield>
  <datafield tag="245" ind1=" " ind2=" ">
    <subfield code="a">REALTIME ETHIOPIAN SIGN LANGUAGE ALPHABET RECOGNITION VIA COMPUTER VISION AND MOTION SENSOR</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">user-aastu</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">user-zenodo</subfield>
  </datafield>
  <datafield tag="540" ind1=" " ind2=" ">
    <subfield code="u">http://www.opendefinition.org/licenses/cc-by</subfield>
    <subfield code="a">Creative Commons Attribution</subfield>
  </datafield>
  <datafield tag="650" ind1="1" ind2="7">
    <subfield code="a">cc-by</subfield>
    <subfield code="2">opendefinition.org</subfield>
  </datafield>
  <datafield tag="520" ind1=" " ind2=" ">
    <subfield code="a">&lt;p&gt;Unlike ASL or other Sign language alphabets, ESL fingerspelling is primely distinguished by hand shape and hand motion. ESL finger spelling represents consonant series with hand configurations, seven movements correspond to the seven vowels. This makes Ethiopian sign language dynamic. In dynamic sign languages, motion detection is essential for the recognition of the language. In this work, an ESL fingerspelling recognition using a fusing of computer vision and motion sensor research work is proposed to recognize and classify the vowel using motion sensor data and deep learning, also using computer vision to recognize consonants. With A large dataset of Ethiopia manual sign language alphabets from multiple subjects, two deep neural networks selected to derive a best topology for each. The vison model is implemented by a YoloV5 model and the smartwatch motion sensor motion model is implemented by LSTM network. Several experimental tests were conducted to gain the most accurate result. And the proposed model yolov5 and Bi-LSTM got 98.5% and 97% respectively with inference time less than 2 Msec. As a result, it has been proven that the proposed decoupling model would be effective for Realtime EMA classification.&lt;/p&gt;</subfield>
  </datafield>
  <datafield tag="773" ind1=" " ind2=" ">
    <subfield code="n">doi</subfield>
    <subfield code="i">isVersionOf</subfield>
    <subfield code="a">10.20372/nadre:4195</subfield>
  </datafield>
  <datafield tag="024" ind1=" " ind2=" ">
    <subfield code="a">10.20372/nadre:4196</subfield>
    <subfield code="2">doi</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">publication</subfield>
    <subfield code="b">thesis</subfield>
  </datafield>
</record>
0
0
views
downloads
All versions This version
Views 00
Downloads 00
Data volume 0 Bytes0 Bytes
Unique views 00
Unique downloads 00

Share

Cite as