Faithful, Unfaithful or Ambiguous? Multi-Agent Debate with Initial Stance for Summary Evaluation

Authors: Koupaee, Mahnaz, Vincent, Jake W., Mansour, Saab, Shalyminov, Igor, He, Han, Song, Hwanjun, Shu, Raphael, He, Jianfeng, Nian, Yi, Wong, Amy Wing-mei, Han, Kyu J., Su, Hang

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2502.08514

Zero-resource Speech Translation and Recognition with LLMs

Authors: Mundnich, Karel, Niu, Xing, Mathur, Prashant, Ronanki, Srikanth, Houston, Brady, Elluru, Veera Raghavendra, Das, Nilaksh, Hou, Zejiang, Huybrechts, Goeric, Bhatia, Anshu, Garcia-Romero, Daniel, Han, Kyu J., Kirchhoff, Katrin

Subject Terms: Computer Science - Computation and Language, Electrical Engineering and Systems Science - Audio and Speech Processing

Access URL: http://arxiv.org/abs/2412.18566

SpeechGuard: Exploring the Adversarial Robustness of Multimodal Large Language Models

Authors: Peri, Raghuveer, Jayanthi, Sai Muralidhar, Ronanki, Srikanth, Bhatia, Anshu, Mundnich, Karel, Dingliwal, Saket, Das, Nilaksh, Hou, Zejiang, Huybrechts, Goeric, Vishnubhotla, Srikanth, Garcia-Romero, Daniel, Srinivasan, Sundararajan, Han, Kyu J, Kirchhoff, Katrin

Subject Terms: Computer Science - Computation and Language, Computer Science - Sound, Electrical Engineering and Systems Science - Audio and Speech Processing

Access URL: http://arxiv.org/abs/2405.08317

SpeechVerse: A Large-scale Generalizable Audio Language Model

Authors: Das, Nilaksh, Dingliwal, Saket, Ronanki, Srikanth, Paturi, Rohit, Huang, Zhaocheng, Mathur, Prashant, Yuan, Jie, Bekal, Dhanush, Niu, Xing, Jayanthi, Sai Muralidhar, Li, Xilai, Mundnich, Karel, Sunkara, Monica, Srinivasan, Sundararajan, Han, Kyu J, Kirchhoff, Katrin

Subject Terms: Computer Science - Computation and Language, Computer Science - Sound, Electrical Engineering and Systems Science - Audio and Speech Processing

Access URL: http://arxiv.org/abs/2405.08295

PEAVS: Perceptual Evaluation of Audio-Visual Synchrony Grounded in Viewers' Opinion Scores

Authors: Goncalves, Lucas, Mathur, Prashant, Lavania, Chandrashekhar, Cekic, Metehan, Federico, Marcello, Han, Kyu J.

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Multimedia, Electrical Engineering and Systems Science - Audio and Speech Processing

Access URL: http://arxiv.org/abs/2404.07336

Wav2Seq: Pre-Training Speech-to-Text Encoder-Decoder Models Using Pseudo Languages

Authors: Wu, Felix, Kim, Kwangyoun, Watanabe, Shinji, Han, Kyu J., McDonald, Ryan, Weinberger, Kilian Q., Artzi, Yoav

Source: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2023 - 2023 IEEE International Conference on. :1-5 Jun, 2023

Relation: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

E-Branchformer: Branchformer with Enhanced Merging for Speech Recognition

Authors: Kim, Kwangyoun, Wu, Felix, Peng, Yifan, Pan, Jing, Sridhar, Prashant, Han, Kyu J., Watanabe, Shinji

Source: 2022 IEEE Spoken Language Technology Workshop (SLT) Spoken Language Technology Workshop (SLT), 2023 IEEE. :84-91 Jan, 2023

Relation: 2022 IEEE Spoken Language Technology Workshop (SLT)

SLUE: New Benchmark Tasks For Spoken Language Understanding Evaluation on Natural Speech

Authors: Shon, Suwon, Pasad, Ankita, Wu, Felix, Brusco, Pablo, Artzi, Yoav, Livescu, Karen, Han, Kyu J.

Source: ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2022 - 2022 IEEE International Conference on. :7927-7931 May, 2022

Relation: ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

SRU++: Pioneering Fast Recurrence with Attention for Speech Recognition

Authors: Pan, Jing, Lei, Tao, Kim, Kwangyoun, Han, Kyu J., Watanabe, Shinji

Source: ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2022 - 2022 IEEE International Conference on. :7872-7876 May, 2022

Relation: ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Performance-Efficiency Trade-Offs in Unsupervised Pre-Training for Speech Recognition

Authors: Wu, Felix, Kim, Kwangyoun, Pan, Jing, Han, Kyu J., Weinberger, Kilian Q., Artzi, Yoav

Source: ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2022 - 2022 IEEE International Conference on. :7667-7671 May, 2022

Relation: ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Multistream CNN for Robust Acoustic Modeling

Authors: Han, Kyu J., Pan, Jing, Tadala, Venkata Krishna Naveen, Ma, Tao, Povey, Dan

Source: ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2021 - 2021 IEEE International Conference on. :6873-6877 Jun, 2021

Relation: ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

E-Branchformer: Branchformer with Enhanced merging for speech recognition

Authors: Kim, Kwangyoun, Wu, Felix, Peng, Yifan, Pan, Jing, Sridhar, Prashant, Han, Kyu J., Watanabe, Shinji

Subject Terms: Electrical Engineering and Systems Science - Audio and Speech Processing, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2210.00077

State-of-the-Art Speech Recognition Using Multi-Stream Self-Attention with Dilated 1D Convolutions

Authors: Han, Kyu J., Prieto, Ramon, Ma, Tao

Source: 2019 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) Automatic Speech Recognition and Understanding Workshop (ASRU), 2019 IEEE. :54-61 Dec, 2019

Relation: 2019 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU)

On the Use of External Data for Spoken Named Entity Recognition

Authors: Pasad, Ankita, Wu, Felix, Shon, Suwon, Livescu, Karen, Han, Kyu J.

Subject Terms: Computer Science - Computation and Language, Computer Science - Machine Learning, Computer Science - Sound, Electrical Engineering and Systems Science - Audio and Speech Processing

Access URL: http://arxiv.org/abs/2112.07648

SLUE: New Benchmark Tasks for Spoken Language Understanding Evaluation on Natural Speech

Authors: Shon, Suwon, Pasad, Ankita, Wu, Felix, Brusco, Pablo, Artzi, Yoav, Livescu, Karen, Han, Kyu J.

Subject Terms: Computer Science - Computation and Language, Computer Science - Machine Learning, Computer Science - Sound, Electrical Engineering and Systems Science - Audio and Speech Processing

Access URL: http://arxiv.org/abs/2111.10367

Multi-mode Transformer Transducer with Stochastic Future Context

Authors: Kim, Kwangyoun, Wu, Felix, Sridhar, Prashant, Han, Kyu J., Watanabe, Shinji

Subject Terms: Electrical Engineering and Systems Science - Audio and Speech Processing, Computer Science - Computation and Language, Computer Science - Sound

Access URL: http://arxiv.org/abs/2106.09760

Leveraging Pre-trained Language Model for Speech Sentiment Analysis

Authors: Shon, Suwon, Brusco, Pablo, Pan, Jing, Han, Kyu J., Watanabe, Shinji

Subject Terms: Computer Science - Computation and Language, Electrical Engineering and Systems Science - Audio and Speech Processing

Access URL: http://arxiv.org/abs/2106.06598

A Review of Speaker Diarization: Recent Advances with Deep Learning

Authors: Park, Tae Jin, Kanda, Naoyuki, Dimitriadis, Dimitrios, Han, Kyu J., Watanabe, Shinji, Narayanan, Shrikanth

Subject Terms: Electrical Engineering and Systems Science - Audio and Speech Processing, Computer Science - Computation and Language, Computer Science - Sound

Access URL: http://arxiv.org/abs/2101.09624

ASAPP-ASR: Multistream CNN and Self-Attentive SRU for SOTA Speech Recognition

Authors: Pan, Jing, Shapiro, Joshua, Wohlwend, Jeremy, Han, Kyu J., Lei, Tao, Ma, Tao

Subject Terms: Electrical Engineering and Systems Science - Audio and Speech Processing, Computer Science - Computation and Language, Computer Science - Sound

Access URL: http://arxiv.org/abs/2005.10469

Multistream CNN for Robust Acoustic Modeling

Authors: Han, Kyu J., Pan, Jing, Tadala, Venkata Krishna Naveen, Ma, Tao, Povey, Dan

Subject Terms: Electrical Engineering and Systems Science - Audio and Speech Processing, Computer Science - Computation and Language, Computer Science - Sound

Access URL: http://arxiv.org/abs/2005.10470