From Optimal to Practical: Efficient Micro-op Cache Replacement Policies for Data Center Applications

Authors: Zhu, Kan, Zhao, Yilong, Gao, Yufei, Braun, Peter, Khan, Tanvir Ahmed, Litz, Heiner, Kasikci, Baris, Deng, Shuwen

Source: 2025 IEEE International Symposium on High Performance Computer Architecture (HPCA) HPCA High Performance Computer Architecture (HPCA), 2025 IEEE International Symposium on. :716-731 Mar, 2025

Relation: 2025 IEEE International Symposium on High Performance Computer Architecture (HPCA)

An Extensible Software Transport Layer for GPU Networking

Authors: Zhou, Yang, Chen, Zhongjie, Mao, Ziming, Lao, ChonLam, Yang, Shuo, Kannan, Pravein Govindan, Gao, Jiaqi, Zhao, Yilong, Wu, Yongji, You, Kaichao, Ren, Fengyuan, Xu, Zhiying, Raiciu, Costin, Stoica, Ion

Subject Terms: Computer Science - Networking and Internet Architecture

Access URL: http://arxiv.org/abs/2504.17307

Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity

Authors: Xi, Haocheng, Yang, Shuo, Zhao, Yilong, Xu, Chenfeng, Li, Muyang, Li, Xiuyu, Lin, Yujun, Cai, Han, Zhang, Jintao, Li, Dacheng, Chen, Jianfei, Stoica, Ion, Keutzer, Kurt, Han, Song

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2502.01776

Semi-Structured Tender Document Retrieval-Augmented Generation: A Framework Based on Large Language Model

Authors: Zhao, Yilong, Li, Daifeng

Source: 2024 IEEE 2nd International Conference on Sensors, Electronics and Computer Engineering (ICSECE) Sensors, Electronics and Computer Engineering (ICSECE), 2024 IEEE 2nd International Conference on. :177-182 Aug, 2024

Relation: 2024 IEEE 2nd International Conference on Sensors, Electronics and Computer Engineering (ICSECE)

UM-PIM: DRAM-based PIM with Uniform & Shared Memory Space

Authors: Zhao, Yilong, Gao, Mingyu, Liu, Fangxin, Hu, Yiwei, Wang, Zongwu, Lin, Han, Li, Ji, Xian, He, Dong, Hanlin, Yang, Tao, Jing, Naifeng, Liang, Xiaoyao, Jiang, Li

Source: 2024 ACM/IEEE 51st Annual International Symposium on Computer Architecture (ISCA) ISCA Computer Architecture (ISCA), 2024 ACM/IEEE 51st Annual International Symposium on. :644-659 Jun, 2024

Relation: 2024 ACM/IEEE 51st Annual International Symposium on Computer Architecture (ISCA)

BlendServe: Optimizing Offline Inference for Auto-regressive Large Models with Resource-aware Batching

Authors: Zhao, Yilong, Yang, Shuo, Zhu, Kan, Zheng, Lianmin, Kasikci, Baris, Zhou, Yang, Xing, Jiarong, Stoica, Ion

Subject Terms: Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2411.16102

XGrammar: Flexible and Efficient Structured Generation Engine for Large Language Models

Authors: Dong, Yixin, Ruan, Charlie F., Cai, Yaxing, Lai, Ruihang, Xu, Ziyi, Zhao, Yilong, Chen, Tianqi

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Programming Languages

Access URL: http://arxiv.org/abs/2411.15100

A Large Language Model-based Framework for Semi-Structured Tender Document Retrieval-Augmented Generation

Authors: Zhao, Yilong, Li, Daifeng

Subject Terms: Computer Science - Computation and Language, Computer Science - Information Retrieval

Access URL: http://arxiv.org/abs/2410.09077

Microless: Cost-Efficient Hybrid Deployment of Microservices on IaaS VMs and Serverless

Authors: Cheng, Jiagan, Zhao, Yilong, Li, Zijun, Chen, Quan, Cui, Weihao, Guo, Minyi

Source: 2023 IEEE 29th International Conference on Parallel and Distributed Systems (ICPADS) ICPADS Parallel and Distributed Systems (ICPADS), 2023 IEEE 29th International Conference on. :2303-2310 Dec, 2023

Relation: 2023 IEEE 29th International Conference on Parallel and Distributed Systems (ICPADS)

NanoFlow: Towards Optimal Large Language Model Serving Throughput

Authors: Zhu, Kan, Zhao, Yilong, Zhao, Liangyu, Zuo, Gefei, Gu, Yile, Xie, Dedong, Gao, Yufei, Xu, Qinyu, Tang, Tian, Ye, Zihao, Kamahori, Keisuke, Lin, Chien-Yu, Wang, Stephanie, Krishnamurthy, Arvind, Kasikci, Baris

Subject Terms: Computer Science - Distributed, Parallel, and Cluster Computing

Access URL: http://arxiv.org/abs/2408.12757

Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference

Authors: Tang, Jiaming, Zhao, Yilong, Zhu, Kan, Xiao, Guangxuan, Kasikci, Baris, Han, Song

Subject Terms: Computer Science - Computation and Language, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2406.10774

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

Authors: DeepSeek-AI, Liu, Aixin, Feng, Bei, Wang, Bin, Wang, Bingxuan, Liu, Bo, Zhao, Chenggang, Dengr, Chengqi, Ruan, Chong, Dai, Damai, Guo, Daya, Yang, Dejian, Chen, Deli, Ji, Dongjie, Li, Erhang, Lin, Fangyun, Luo, Fuli, Hao, Guangbo, Chen, Guanting, Li, Guowei, Zhang, H., Xu, Hanwei, Yang, Hao, Zhang, Haowei, Ding, Honghui, Xin, Huajian, Gao, Huazuo, Li, Hui, Qu, Hui, Cai, J. L., Liang, Jian, Guo, Jianzhong, Ni, Jiaqi, Li, Jiashi, Chen, Jin, Yuan, Jingyang, Qiu, Junjie, Song, Junxiao, Dong, Kai, Gao, Kaige, Guan, Kang, Wang, Lean, Zhang, Lecong, Xu, Lei, Xia, Leyi, Zhao, Liang, Zhang, Liyue, Li, Meng, Wang, Miaojun, Zhang, Mingchuan, Zhang, Minghua, Tang, Minghui, Li, Mingming, Tian, Ning, Huang, Panpan, Wang, Peiyi, Zhang, Peng, Zhu, Qihao, Chen, Qinyu, Du, Qiushi, Chen, R. J., Jin, R. L., Ge, Ruiqi, Pan, Ruizhe, Xu, Runxin, Chen, Ruyi, Li, S. S., Lu, Shanghao, Zhou, Shangyan, Chen, Shanhuang, Wu, Shaoqing, Ye, Shengfeng, Ma, Shirong, Wang, Shiyu, Zhou, Shuang, Yu, Shuiping, Zhou, Shunfeng, Zheng, Size, Wang, T., Pei, Tian, Yuan, Tian, Sun, Tianyu, Xiao, W. L., Zeng, Wangding, An, Wei, Liu, Wen, Liang, Wenfeng, Gao, Wenjun, Zhang, Wentao, Li, X. Q., Jin, Xiangyue, Wang, Xianzu, Bi, Xiao, Liu, Xiaodong, Wang, Xiaohan, Shen, Xiaojin, Chen, Xiaokang, Chen, Xiaosha, Nie, Xiaotao, Sun, Xiaowen, Wang, Xiaoxiang, Liu, Xin, Xie, Xin, Yu, Xingkai, Song, Xinnan, Zhou, Xinyi, Yang, Xinyu, Lu, Xuan, Su, Xuecheng, Wu, Y., Li, Y. K., Wei, Y. X., Zhu, Y. X., Xu, Yanhong, Huang, Yanping, Li, Yao, Zhao, Yao, Sun, Yaofeng, Li, Yaohui, Wang, Yaohui, Zheng, Yi, Zhang, Yichao, Xiong, Yiliang, Zhao, Yilong, He, Ying, Tang, Ying, Piao, Yishi, Dong, Yixin, Tan, Yixuan, Liu, Yiyuan, Wang, Yongji, Guo, Yongqiang, Zhu, Yuchen, Wang, Yuduan, Zou, Yuheng, Zha, Yukun, Ma, Yunxian, Yan, Yuting, You, Yuxiang, Liu, Yuxuan, Ren, Z. Z., Ren, Zehui, Sha, Zhangli, Fu, Zhe, Huang, Zhen, Zhang, Zhen, Xie, Zhenda, Hao, Zhewen, Shao, Zhihong, Wen, Zhiniu, Xu, Zhipeng, Zhang, Zhongyu, Li, Zhuoshu, Wang, Zihan, Gu, Zihui, Li, Zilin, Xie, Ziwei

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2405.04434

PIMPR: PIM-based Personalized Recommendation with Heterogeneous Memory Hierarchy

Authors: Yang, Tao, Ma, Hui, Zhao, Yilong, Liu, Fangxin, He, Zhezhi, Sun, Xiaoli, Jiang, Li

Source: 2023 Design, Automation & Test in Europe Conference & Exhibition (DATE) Design, Automation & Test in Europe Conference & Exhibition (DATE), 2023. :1-6 Apr, 2023

Relation: 2023 Design, Automation & Test in Europe Conference & Exhibition (DATE)

Atom: Low-bit Quantization for Efficient and Accurate LLM Serving

Authors: Zhao, Yilong, Lin, Chien-Yu, Zhu, Kan, Ye, Zihao, Chen, Lequn, Zheng, Size, Ceze, Luis, Krishnamurthy, Arvind, Chen, Tianqi, Kasikci, Baris

Subject Terms: Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2310.19102

DTQAtten: Leveraging Dynamic Token-based Quantization for Efficient Attention Architecture

Authors: Yang, Tao, Li, Dongyue, Song, Zhuoran, Zhao, Yilong, Liu, Fangxin, Wang, Zongwu, He, Zhezhi, Jiang, Li

Source: 2022 Design, Automation & Test in Europe Conference & Exhibition (DATE) Design, Automation & Test in Europe Conference & Exhibition (DATE), 2022. :700-705 Mar, 2022

Relation: 2022 Design, Automation & Test in Europe Conference & Exhibition (DATE)

PV System Output Modeling and Influence Factor Analysis of Metallic Bipolar Short-Circuit Fault for DC Microgrids

Authors: Zhang, Zhihua, Wang, Kun, Zhao, Yilong, Wang, Hao

Source: 2021 International Conference on Power System Technology (POWERCON) Power System Technology (POWERCON), 2021 International Conference on. :1573-1583 Dec, 2021

Relation: 2021 International Conference on Power System Technology (POWERCON)

PIMGCN: A ReRAM-Based PIM Design for Graph Convolutional Network Acceleration

Authors: Yang, Tao, Li, Dongyue, Han, Yibo, Zhao, Yilong, Liu, Fangxin, Liang, Xiaoyao, He, Zhezhi, Jiang, Li

Source: 2021 58th ACM/IEEE Design Automation Conference (DAC) Design Automation Conference (DAC), 2021 58th ACM/IEEE. :583-588 Dec, 2021

Relation: 2021 58th ACM/IEEE Design Automation Conference (DAC)

Bit-Transformer: Transforming Bit-level Sparsity into Higher Preformance in ReRAM-based Accelerator

Authors: Liu, Fangxin, Zhao, Wenbo, He, Zhezhi, Wang, Zongwu, Zhao, Yilong, Chen, Yongbiao, Jiang, Li

Source: 2021 IEEE/ACM International Conference On Computer Aided Design (ICCAD) Computer Aided Design (ICCAD), 2021 IEEE/ACM International Conference On. :1-9 Nov, 2021

Relation: 2021 IEEE/ACM International Conference On Computer Aided Design (ICCAD)

Research on Droplet Digital PCR Amplification System

Authors: Zhang, Jie, Yan, Jiaqi, Wang, Jinxian, Xu, Jie, Zhao, Yilong, Luo, Gangyin

Source: 2021 IEEE 20th International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) TRUSTCOM Trust, Security and Privacy in Computing and Communications (TrustCom), 2021 IEEE 20th International Conference on. :1483-1487 Oct, 2021

Relation: 2021 IEEE 20th International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom)

SME: ReRAM-based Sparse-Multiplication-Engine to Squeeze-Out Bit Sparsity of Neural Network

Authors: Liu, Fangxin, Zhao, Wenbo, He, Zhezhi, Wang, Zongwu, Zhao, Yilong, Yang, Tao, Feng, Jingnai, Liang, Xiaoyao, Jiang, Li

Source: 2021 IEEE 39th International Conference on Computer Design (ICCD) ICCD Computer Design (ICCD), 2021 IEEE 39th International Conference on. :417-424 Oct, 2021

Relation: 2021 IEEE 39th International Conference on Computer Design (ICCD)