JavaBench: A Benchmark of Object-Oriented Code Generation for Evaluating Large Language Models

Authors: Cao, Jialun, Chen, Zhiyong, Wu, Jiarong, Cheung, Shing-Chi, Xu, Chang

Source: 2024 39th IEEE/ACM International Conference on Automated Software Engineering (ASE) ASE Automated Software Engineering (ASE), 2024 39th IEEE/ACM International Conference on. :870-882 Oct, 2024

Relation: 2024 39th IEEE/ACM International Conference on Automated Software Engineering (ASE)

MR-Adopt: Automatic Deduction of Input Transformation Function for Metamorphic Testing

Authors: Xu, Congying, Chen, Songqiang, Wu, Jiarong, Cheung, Shing-Chi, Terragni, Valerio, Zhu, Hengcheng, Cao, Jialun

Source: 2024 39th IEEE/ACM International Conference on Automated Software Engineering (ASE) ASE Automated Software Engineering (ASE), 2024 39th IEEE/ACM International Conference on. :557-569 Oct, 2024

Relation: 2024 39th IEEE/ACM International Conference on Automated Software Engineering (ASE)

Towards Understanding the Effectiveness of Large Language Models on Directed Test Input Generation

Authors: Jiang, Zongze, Wen, Ming, Cao, Jialun, Shi, Xuanhua, Jin, Hai

Source: 2024 39th IEEE/ACM International Conference on Automated Software Engineering (ASE) ASE Automated Software Engineering (ASE), 2024 39th IEEE/ACM International Conference on. :1408-1420 Oct, 2024

Relation: 2024 39th IEEE/ACM International Conference on Automated Software Engineering (ASE)

Isolating Language-Coding from Problem-Solving: Benchmarking LLMs with PseudoEval

Authors: Wu, Jiarong, Chen, Songqiang, Cao, Jialun, Lo, Hau Ching, Cheung, Shing-Chi

Subject Terms: Computer Science - Software Engineering, Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2502.19149

From Informal to Formal -- Incorporating and Evaluating LLMs on Natural Language Requirements to Verifiable Formal Proofs

Authors: Cao, Jialun, Lu, Yaojie, Li, Meiziniu, Ma, Haoyang, Li, Haokun, He, Mengda, Wen, Cheng, Sun, Le, Zhang, Hongyu, Qin, Shengchao, Cheung, Shing-Chi, Tian, Cong

Subject Terms: Computer Science - Artificial Intelligence, Computer Science - Computation and Language, Computer Science - Programming Languages

Access URL: http://arxiv.org/abs/2501.16207

How Should We Build A Benchmark? Revisiting 274 Code-Related Benchmarks For LLMs

Authors: Cao, Jialun, Chan, Yuk-Kit, Ling, Zixuan, Wang, Wenxuan, Li, Shuqing, Liu, Mingwei, Qiao, Ruixi, Han, Yuting, Wang, Chaozheng, Yu, Boxi, He, Pinjia, Wang, Shuai, Zheng, Zibin, Lyu, Michael R., Cheung, Shing-Chi

Subject Terms: Computer Science - Software Engineering, Computer Science - Artificial Intelligence, Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2501.10711

ICM-Assistant: Instruction-tuning Multimodal Large Language Models for Rule-based Explainable Image Content Moderation

Authors: Wu, Mengyang, Zhao, Yuzhi, Cao, Jialun, Xu, Mingjie, Jiang, Zhongming, Wang, Xuehui, Li, Qinbin, Hu, Guangneng, Qin, Shengchao, Fu, Chi-Wing

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2412.18216

Ergodic optimal liquidations in DeFi

Authors: Cao, Jialun, Šiška, David

Subject Terms: Quantitative Finance - Trading and Market Microstructure, Mathematics - Optimization and Control, Primary 93E20, Secondary 91G80

Access URL: http://arxiv.org/abs/2411.19637

CODECLEANER: Elevating Standards with A Robust Data Contamination Mitigation Toolkit

Authors: Cao, Jialun, Chen, Songqiang, Zhang, Wuqi, Lo, Hau Ching, Cheung, Shing-Chi

Subject Terms: Computer Science - Software Engineering, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2411.10842

Logarithmic regret in the ergodic Avellaneda-Stoikov market making model

Authors: Cao, Jialun, Šiška, David, Szpruch, Lukasz, Treetanthiploet, Tanut

Subject Terms: Mathematics - Optimization and Control, Quantitative Finance - Trading and Market Microstructure, Primary 93E35, Secondary 93C40, 93C41, 93E20, 91G80

Access URL: http://arxiv.org/abs/2409.02025

DOMAINEVAL: An Auto-Constructed Benchmark for Multi-Domain Code Generation

Authors: Zhu, Qiming, Cao, Jialun, Lu, Yaojie, Lin, Hongyu, Han, Xianpei, Sun, Le, Cheung, Shing-Chi

Subject Terms: Computer Science - Artificial Intelligence, Computer Science - Software Engineering

Access URL: http://arxiv.org/abs/2408.13204

CRUXEval-X: A Benchmark for Multilingual Code Reasoning, Understanding and Execution

Authors: Xu, Ruiyang, Cao, Jialun, Lu, Yaojie, Lin, Hongyu, Han, Xianpei, He, Ben, Cheung, Shing-Chi, Sun, Le

Subject Terms: Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2408.13001

DLLens: Testing Deep Learning Libraries via LLM-aided Synthesis

Authors: Li, Meiziniu, Li, Dongze, Liu, Jianmeng, Cao, Jialun, Tian, Yongqiang, Cheung, Shing-Chi

Subject Terms: Computer Science - Software Engineering, Computer Science - Artificial Intelligence, D.2.5, I.2.5

Access URL: http://arxiv.org/abs/2406.07944

Enchanting Program Specification Synthesis by Large Language Models using Static Analysis and Program Verification

Authors: Wen, Cheng, Cao, Jialun, Su, Jie, Xu, Zhiwu, Qin, Shengchao, He, Mengda, Li, Haokun, Cheung, Shing-Chi, Tian, Cong

Subject Terms: Computer Science - Software Engineering

Access URL: http://arxiv.org/abs/2404.00762

Concerned with Data Contamination? Assessing Countermeasures in Code Language Model

Authors: Cao, Jialun, Zhang, Wuqi, Cheung, Shing-Chi

Subject Terms: Computer Science - Software Engineering, Computer Science - Cryptography and Security

Access URL: http://arxiv.org/abs/2403.16898

DeepFD: Automated Fault Diagnosis and Localization for Deep Learning Programs

Authors: Cao, Jialun, Li, Meiziniu, Chen, Xiao, Wen, Ming, Tian, Yongqiang, Wu, Bo, Cheung, Shing-Chi

Source: 2022 IEEE/ACM 44th International Conference on Software Engineering (ICSE) ICSE Software Engineering (ICSE), 2022 IEEE/ACM 44th International Conference on. :573-585 May, 2022

Relation: 2022 IEEE/ACM 44th International Conference on Software Engineering (ICSE)

A study on Prompt Design, Advantages and Limitations of ChatGPT for Deep Learning Program Repair

Authors: Cao, Jialun, Li, Meiziniu, Wen, Ming, Cheung, Shing-chi

Subject Terms: Computer Science - Software Engineering

Access URL: http://arxiv.org/abs/2304.08191

TransRegex: Multi-modal Regular Expression Synthesis by Generate-and-Repair

Authors: Li, Yeting, Li, Shuaimin, Xu, Zhiwu, Cao, Jialun, Chen, Zixuan, Hu, Yun, Chen, Haiming, Cheung, Shing-Chi

Source: 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE) ICSE Software Engineering (ICSE), 2021 IEEE/ACM 43rd International Conference on. :1210-1222 May, 2021

Relation: 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE)

FlashRegex: Deducing Anti-ReDoS Regexes from Examples

Authors: Li, Yeting, Xu, Zhiwu, Cao, Jialun, Chen, Haiming, Ge, Tingjian, Cheung, Shing-Chi, Zhao, Haoren

Source: 2020 35th IEEE/ACM International Conference on Automated Software Engineering (ASE) ASE Automated Software Engineering (ASE), 2020 35th IEEE/ACM International Conference on. :659-671 Sep, 2020

Relation: 2020 35th IEEE/ACM International Conference on Automated Software Engineering (ASE)

FlashSchema: Achieving High Quality XML Schemas with Powerful Inference Algorithms and Large-scale Schema Data

Authors: Li, Yeting, Cao, Jialun, Chen, Haiming, Ge, Tingjian, Xu, Zhiwu, Peng, Qiancheng

Source: 2020 IEEE 36th International Conference on Data Engineering (ICDE) Data Engineering (ICDE), 2020 IEEE 36th International Conference on. :1962-1965 Apr, 2020

Relation: 2020 IEEE 36th International Conference on Data Engineering (ICDE)