Meta Audiobox Aesthetics: Unified Automatic Quality Assessment for Speech, Music, and Sound

Authors: Tjandra, Andros, Wu, Yi-Chiao, Guo, Baishan, Hoffman, John, Ellis, Brian, Vyas, Apoorv, Shi, Bowen, Chen, Sanyuan, Le, Matt, Zacharov, Nick, Wood, Carleigh, Lee, Ann, Hsu, Wei-Ning

Subject Terms: Computer Science - Sound, Computer Science - Machine Learning, Electrical Engineering and Systems Science - Audio and Speech Processing

Access URL: http://arxiv.org/abs/2502.05139

Audiobox TTA-RAG: Improving Zero-Shot and Few-Shot Text-To-Audio with Retrieval-Augmented Generation

Authors: Yang, Mu, Shi, Bowen, Le, Matthew, Hsu, Wei-Ning, Tjandra, Andros

Subject Terms: Electrical Engineering and Systems Science - Audio and Speech Processing, Computer Science - Sound

Access URL: http://arxiv.org/abs/2411.05141

MusicFlow: Cascaded Flow Matching for Text Guided Music Generation

Authors: Prajwal, K R, Shi, Bowen, Lee, Matthew, Vyas, Apoorv, Tjandra, Andros, Luthra, Mahi, Guo, Baishan, Wang, Huiyu, Afouras, Triantafyllos, Kant, David, Hsu, Wei-Ning

Subject Terms: Computer Science - Sound, Computer Science - Artificial Intelligence, Electrical Engineering and Systems Science - Audio and Speech Processing

Access URL: http://arxiv.org/abs/2410.20478

Movie Gen: A Cast of Media Foundation Models

Authors: Polyak, Adam, Zohar, Amit, Brown, Andrew, Tjandra, Andros, Sinha, Animesh, Lee, Ann, Vyas, Apoorv, Shi, Bowen, Ma, Chih-Yao, Chuang, Ching-Yao, Yan, David, Choudhary, Dhruv, Wang, Dingkang, Sethi, Geet, Pang, Guan, Ma, Haoyu, Misra, Ishan, Hou, Ji, Wang, Jialiang, Jagadeesh, Kiran, Li, Kunpeng, Zhang, Luxin, Singh, Mannat, Williamson, Mary, Le, Matt, Yu, Matthew, Singh, Mitesh Kumar, Zhang, Peizhao, Vajda, Peter, Duval, Quentin, Girdhar, Rohit, Sumbaly, Roshan, Rambhatla, Sai Saketh, Tsai, Sam, Azadi, Samaneh, Datta, Samyak, Chen, Sanyuan, Bell, Sean, Ramaswamy, Sharadh, Sheynin, Shelly, Bhattacharya, Siddharth, Motwani, Simran, Xu, Tao, Li, Tianhe, Hou, Tingbo, Hsu, Wei-Ning, Yin, Xi, Dai, Xiaoliang, Taigman, Yaniv, Luo, Yaqiao, Liu, Yen-Cheng, Wu, Yi-Chiao, Zhao, Yue, Kirstain, Yuval, He, Zecheng, He, Zijian, Pumarola, Albert, Thabet, Ali, Sanakoyeu, Artsiom, Mallya, Arun, Guo, Baishan, Araya, Boris, Kerr, Breena, Wood, Carleigh, Liu, Ce, Peng, Cen, Vengertsev, Dimitry, Schonfeld, Edgar, Blanchard, Elliot, Juefei-Xu, Felix, Nord, Fraylie, Liang, Jeff, Hoffman, John, Kohler, Jonas, Fire, Kaolin, Sivakumar, Karthik, Chen, Lawrence, Yu, Licheng, Gao, Luya, Georgopoulos, Markos, Moritz, Rashel, Sampson, Sara K., Li, Shikai, Parmeggiani, Simone, Fine, Steve, Fowler, Tara, Petrovic, Vladan, Du, Yuming

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Artificial Intelligence, Computer Science - Machine Learning, Electrical Engineering and Systems Science - Image and Video Processing

Access URL: http://arxiv.org/abs/2410.13720

Dynamic ASR Pathways: An Adaptive Masking Approach Towards Efficient Pruning of a Multilingual ASR Model

Authors: Xie, Jiamin, Li, Ke, Guo, Jinxi, Tjandra, Andros, Shangguan, Yuan, Sari, Leda, Wu, Chunyang, Jia, Junteng, Mahadeokar, Jay, Kalinli, Ozlem

Source: ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2024 - 2024 IEEE International Conference on. :12201-12205 Apr, 2024

Relation: ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Learning Fine-Grained Controllability on Speech Generation via Efficient Fine-Tuning

Authors: Chien, Chung-Ming, Tjandra, Andros, Vyas, Apoorv, Le, Matt, Shi, Bowen, Hsu, Wei-Ning

Subject Terms: Electrical Engineering and Systems Science - Audio and Speech Processing, Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2406.06251

Learning ASR Pathways: A Sparse Multilingual ASR Model

Authors: Yang, Mu, Tjandra, Andros, Liu, Chunxi, Zhang, David, Le, Duc, Kalinli, Ozlem

Source: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2023 - 2023 IEEE International Conference on. :1-5 Jun, 2023

Relation: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Massively Multilingual ASR on 70 Languages: Tokenization, Architecture, and Generalization Capabilities

Authors: Tjandra, Andros, Singhal, Nayan, Zhang, David, Kalinli, Ozlem, Mohamed, Abdelrahman, Le, Duc, Seltzer, Michael L.

Source: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2023 - 2023 IEEE International Conference on. :1-5 Jun, 2023

Relation: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Voice-Preserving Zero-Shot Multiple Accent Conversion

Authors: Jin, Mumin, Serai, Prashant, Wu, Jilong, Tjandra, Andros, Manohar, Vimal, He, Qing

Source: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2023 - 2023 IEEE International Conference on. :1-5 Jun, 2023

Relation: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

NIX-TTS: Lightweight and End-to-End Text-to-Speech Via Module-Wise Distillation

Authors: Chevi, Rendi, Prasojo, Radityo Eko, Aji, Alham Fikri, Tjandra, Andros, Sakti, Sakriani

Source: 2022 IEEE Spoken Language Technology Workshop (SLT) Spoken Language Technology Workshop (SLT), 2023 IEEE. :970-976 Jan, 2023

Relation: 2022 IEEE Spoken Language Technology Workshop (SLT)

Audiobox: Unified Audio Generation with Natural Language Prompts

Authors: Vyas, Apoorv, Shi, Bowen, Le, Matthew, Tjandra, Andros, Wu, Yi-Chiao, Guo, Baishan, Zhang, Jiemin, Zhang, Xinyue, Adkins, Robert, Ngan, William, Wang, Jeff, Cruz, Ivan, Akula, Bapi, Akinyemi, Akinniyi, Ellis, Brian, Moritz, Rashel, Yungster, Yael, Rakotoarison, Alice, Tan, Liang, Summers, Chris, Wood, Carleigh, Lane, Joshua, Williamson, Mary, Hsu, Wei-Ning

Subject Terms: Computer Science - Sound, Computer Science - Machine Learning, Electrical Engineering and Systems Science - Audio and Speech Processing

Access URL: http://arxiv.org/abs/2312.15821

Generative Pre-training for Speech with Flow Matching

Authors: Liu, Alexander H., Le, Matt, Vyas, Apoorv, Shi, Bowen, Tjandra, Andros, Hsu, Wei-Ning

Subject Terms: Electrical Engineering and Systems Science - Audio and Speech Processing, Computer Science - Computation and Language, Computer Science - Machine Learning, Computer Science - Sound

Access URL: http://arxiv.org/abs/2310.16338

Dynamic ASR Pathways: An Adaptive Masking Approach Towards Efficient Pruning of A Multilingual ASR Model

Authors: Xie, Jiamin, Li, Ke, Guo, Jinxi, Tjandra, Andros, Shangguan, Yuan, Sari, Leda, Wu, Chunyang, Jia, Junteng, Mahadeokar, Jay, Kalinli, Ozlem

Subject Terms: Electrical Engineering and Systems Science - Audio and Speech Processing, Computer Science - Computation and Language, Computer Science - Sound

Access URL: http://arxiv.org/abs/2309.13018

Conformer-Based Self-Supervised Learning For Non-Speech Audio Tasks

Authors: Srivastava, Sangeeta, Wang, Yun, Tjandra, Andros, Kumar, Anurag, Liu, Chunxi, Singh, Kritika, Saraf, Yatharth

Source: ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2022 - 2022 IEEE International Conference on. :8862-8866 May, 2022

Relation: ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Improved Language Identification Through Cross-Lingual Self-Supervised Learning

Authors: Tjandra, Andros, Choudhury, Diptanu Gon, Zhang, Frank, Singh, Kritika, Conneau, Alexis, Baevski, Alexei, Sela, Assaf, Saraf, Yatharth, Auli, Michael

Source: ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2022 - 2022 IEEE International Conference on. :6877-6881 May, 2022

Relation: ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Scaling Speech Technology to 1,000+ Languages

Authors: Pratap, Vineel, Tjandra, Andros, Shi, Bowen, Tomasello, Paden, Babu, Arun, Kundu, Sayani, Elkahky, Ali, Ni, Zhaoheng, Vyas, Apoorv, Fazel-Zarandi, Maryam, Baevski, Alexei, Adi, Yossi, Zhang, Xiaohui, Hsu, Wei-Ning, Conneau, Alexis, Auli, Michael

Subject Terms: Computer Science - Computation and Language, Computer Science - Sound, Electrical Engineering and Systems Science - Audio and Speech Processing

Access URL: http://arxiv.org/abs/2305.13516

SpeeChain: A Speech Toolkit for Large-Scale Machine Speech Chain

Authors: Qi, Heli, Novitasari, Sashi, Tjandra, Andros, Sakti, Sakriani, Nakamura, Satoshi

Subject Terms: Computer Science - Computation and Language, Computer Science - Machine Learning, Electrical Engineering and Systems Science - Audio and Speech Processing, 68T10, I.2.7

Access URL: http://arxiv.org/abs/2301.02966

Voice-preserving Zero-shot Multiple Accent Conversion

Authors: Jin, Mumin, Serai, Prashant, Wu, Jilong, Tjandra, Andros, Manohar, Vimal, He, Qing

Subject Terms: Computer Science - Sound, Computer Science - Artificial Intelligence, Electrical Engineering and Systems Science - Audio and Speech Processing

Access URL: http://arxiv.org/abs/2211.13282

Massively Multilingual ASR on 70 Languages: Tokenization, Architecture, and Generalization Capabilities

Authors: Tjandra, Andros, Singhal, Nayan, Zhang, David, Kalinli, Ozlem, Mohamed, Abdelrahman, Le, Duc, Seltzer, Michael L.

Subject Terms: Computer Science - Computation and Language, Computer Science - Sound, Electrical Engineering and Systems Science - Audio and Speech Processing

Access URL: http://arxiv.org/abs/2211.05756

DEJA-VU: Double Feature Presentation and Iterated Loss in Deep Transformer Networks

Authors: Tjandra, Andros, Liu, Chunxi, Zhang, Frank, Zhang, Xiaohui, Wang, Yongqiang, Synnaeve, Gabriel, Nakamura, Satoshi, Zweig, Geoffrey

Source: ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2020 - 2020 IEEE International Conference on. :6899-6903 May, 2020

Relation: ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)