ResearchBib Share Your Research, Maximize Your Social Impacts
Sign for Notice Everyday Sign up >> Login

LIP READING USING DEEP LEARNING TECHNIQUES

Journal: International Journal of Advanced Research in Engineering and Technology (IJARET) (Vol.11, No. 12)

Publication Date:

Authors : ;

Page : 2088-2099

Keywords : Deep Learning; Convolutional Neural Network; Image classification; Lip Reading.;

Source : Downloadexternal Find it from : Google Scholarexternal

Abstract

Deep Learning in layman terms is basically stacking together multiple layers of neurons. These neurons lie on connected layers where the output from the previous layer is passed or connected to every other node in the next layer. In general, the performance of neural networks is optimized by stacking several layers together. In late programmed discourse acknowledgment considerations, profound learning engineering applications for acoustic include eclipsed regular sound highlights, for example, Mel-recurrence cepstral coefficient. Be that as it may, for visual discourse acknowledgment (VSR) studies, high-quality visual element extraction systems are still broadly used. Right now, this paper aims to apply convolutional neural system (CNN) as a visual component extraction instrument for VSR. Here, three different variants of CNN is developed to process the pictures of a speaker's mouth zone in blend with phoneme marks. Later, the developed CNN variants are used to remove visual highlights basic for perceiving phonemes and are evaluated for their performance with the most widely used benchmark dataset, MIRACL-VC1.

Last modified: 2021-02-24 18:08:12