Academic Journal
Mobile Phone-Based Audio Announcement Detection and Recognition for People with Hearing Impairment
| Title: | Mobile Phone-Based Audio Announcement Detection and Recognition for People with Hearing Impairment |
|---|---|
| Authors: | Yong Ruan, Yueliang Qian, Xiangdong Wang |
| Source: | Advances in Multimedia, Vol 2018 (2018) |
| Publisher Information: | Hindawi Limited, 2018. |
| Publication Year: | 2018 |
| Collection: | LCC:Electronic computers. Computer science |
| Subject Terms: | Electronic computers. Computer science, QA75.5-76.95 |
| More Details: | Automatic audio announcement systems are widely used in public places such as transportation vehicles and facilities, hospitals, and banks. However, these systems cannot be used by people with hearing impairment. That brings great inconvenience to their lives. In this paper, an approach of audio announcement detection and recognition for the hearing-impaired people based on the smart phone is proposed and a mobile phone application (app) is developed, taking the bank as a major applying scenario. Using the app, the users can sign up alerts for their numbers and then the system begins to detect audio announcements using the microphone on the smart phone. For each audio announcement detected, the speech within it is recognized and the text is displayed on the screen of the phone. When the number the user input is announced, alert will be given by vibration. For audio announcement detection, a method based on audio segment classification and postprocessing is proposed, which uses a SVM classifier trained on audio announcements and environment noise collected in banks. For announcement speech recognition, an ASR engine is developed using a GMM-HMM-based acoustic model and a finite state transducer (FST) based grammar. The acoustic model is trained on audio announcement speech collected in banks, and the grammar is human-defined according to the patterns used by the automatic audio announcement systems. Experimental results show that character error rates (CERs) around 5% can be achieved for the announcement speech, which shows feasibility of the proposed method and system. |
| Document Type: | article |
| File Description: | electronic resource |
| Language: | English |
| ISSN: | 1687-5680 1687-5699 |
| Relation: | https://doaj.org/toc/1687-5680; https://doaj.org/toc/1687-5699 |
| DOI: | 10.1155/2018/8786308 |
| Access URL: | https://doaj.org/article/acdd3fb3e55d4d569db426fb0b9f1092 |
| Accession Number: | edsdoj.3fb3e55d4d569db426fb0b9f1092 |
| Database: | Directory of Open Access Journals |
| Full text is not displayed to guests. | Login for full access. |
| ISSN: | 16875680 16875699 |
|---|---|
| DOI: | 10.1155/2018/8786308 |
| Published in: | Advances in Multimedia |
| Language: | English |