How much do contextualized representations encode long-range context?

Authors: Sun, Simeng, Hsieh, Cheng-Ping

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2410.12292

nGPT: Normalized Transformer with Representation Learning on the Hypersphere

Authors: Loshchilov, Ilya, Hsieh, Cheng-Ping, Sun, Simeng, Ginsburg, Boris

Subject Terms: Computer Science - Machine Learning, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2410.01131

Suri: Multi-constraint Instruction Following for Long-form Text Generation

Authors: Pham, Chau Minh, Sun, Simeng, Iyyer, Mohit

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2406.19371

RULER: What's the Real Context Size of Your Long-Context Language Models?

Authors: Hsieh, Cheng-Ping, Sun, Simeng, Kriman, Samuel, Acharya, Shantanu, Rekesh, Dima, Jia, Fei, Zhang, Yang, Ginsburg, Boris

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2404.06654

TopicGPT: A Prompt-based Topic Modeling Framework

Authors: Pham, Chau Minh, Hoyle, Alexander, Sun, Simeng, Resnik, Philip, Iyyer, Mohit

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2311.01449

Exploring the impact of low-rank adaptation on the performance, efficiency, and regularization of RLHF

Authors: Sun, Simeng, Gupta, Dhawal, Iyyer, Mohit

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2309.09055

A Near-field Millimeter Wave Imaging Approach for Cross MIMO Array

Authors: Sun, Simeng, Li, Shiyong, Zheng, Haitao, Mo, Xiaofei

Source: 2022 Cross Strait Radio Science & Wireless Technology Conference (CSRSWTC) Cross Strait Radio Science & Wireless Technology Conference (CSRSWTC), 2022. :1-3 Dec, 2022

Relation: 2022 Cross Strait Radio Science & Wireless Technology Conference (CSRSWTC)

PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents

Authors: Sun, Simeng, Liu, Yang, Wang, Shuohang, Zhu, Chenguang, Iyyer, Mohit

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2305.14564

How Does In-Context Learning Help Prompt Tuning?

Authors: Sun, Simeng, Liu, Yang, Iter, Dan, Zhu, Chenguang, Iyyer, Mohit

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2302.11521

Efficiently Upgrading Multilingual Machine Translation Models to Support More Languages

Authors: Sun, Simeng, Elbayad, Maha, Sun, Anna, Cross, James

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2302.03528

Multi-scale Grouped Dense Network for VVC Intra Coding

Authors: Li, Xin, Sun, Simeng, Zhang, Zhizheng, Chen, Zhibo

Source: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) Computer Vision and Pattern Recognition Workshops (CVPRW),2020 IEEE/CVF Conference on. :615-618 Jun, 2020

Relation: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)

Image Coding for Machines with Omnipotent Feature Learning

Authors: Feng, Ruoyu, Jin, Xin, Guo, Zongyu, Feng, Runsen, Gao, Yixin, He, Tianyu, Zhang, Zhizheng, Sun, Simeng, Chen, Zhibo

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2207.01932

ChapterBreak: A Challenge Dataset for Long-Range Language Models

Authors: Sun, Simeng, Thai, Katherine, Iyyer, Mohit

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2204.10878

Semantically Video Coding: Instill Static-Dynamic Clues into Structured Bitstream for AI Tasks

Authors: Jin, Xin, Feng, Ruoyu, Sun, Simeng, Feng, Runsen, He, Tianyu, Chen, Zhibo

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Multimedia

Access URL: http://arxiv.org/abs/2201.10162

Beyond Coding: Detection-driven Image Compression with Semantically Structured Bit-stream

Authors: He, Tianyu, Sun, Simeng, Guo, Zongyu, Chen, Zhibo

Source: 2019 Picture Coding Symposium (PCS) Picture Coding Symposium (PCS), 2019. :1-5 Nov, 2019

Relation: 2019 Picture Coding Symposium (PCS)

Alternative Input Signals Ease Transfer in Multilingual Machine Translation

Authors: Sun, Simeng, Fan, Angela, Cross, James, Chaudhary, Vishrav, Tran, Chau, Koehn, Philipp, Guzman, Francisco

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2110.07804

Do Long-Range Language Models Actually Use Long-Range Context?

Authors: Sun, Simeng, Krishna, Kalpesh, Mattarella-Micke, Andrew, Iyyer, Mohit

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2109.09115

IGA : An Intent-Guided Authoring Assistant

Authors: Sun, Simeng, Zhao, Wenlong, Manjunatha, Varun, Jain, Rajiv, Morariu, Vlad, Dernoncourt, Franck, Srinivasan, Balaji Vasan, Iyyer, Mohit

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2104.07000

Revisiting Simple Neural Probabilistic Language Models

Authors: Sun, Simeng, Iyyer, Mohit

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2104.03474

GraphIQA: Learning Distortion Graph Representations for Blind Image Quality Assessment

Authors: Sun, Simeng, Yu, Tao, Xu, Jiahua, Zhou, Wei, Chen, Zhibo

Subject Terms: Computer Science - Multimedia

Access URL: http://arxiv.org/abs/2103.07666