Activity cliff-aware reinforcement learning for de novo drug design

Bibliographic Details
Title: Activity cliff-aware reinforcement learning for de novo drug design
Authors: Xiuyuan Hu, Guoqing Liu, Yang Zhao, Hao Zhang
Source: Journal of Cheminformatics, Vol 17, Iss 1, Pp 1-11 (2025)
Publisher Information: BMC, 2025.
Publication Year: 2025
Collection: LCC:Information technology
LCC:Chemistry
Subject Terms: AI for drug design, Activity cliff, Reinforcement learning, Contrastive loss, Information technology, T58.5-58.64, Chemistry, QD1-999
More Details: Abstract The integration of artificial intelligence (AI) in drug discovery offers promising opportunities to streamline and enhance the traditional drug development process. One core challenge in de novo molecular design is modeling complex structure-activity relationships (SAR), such as activity cliffs, where minor molecular changes yield significant shifts in biological activity. In response to the limitations of current models in capturing these critical discontinuities, we propose the Activity Cliff-Aware Reinforcement Learning (ACARL) framework. ACARL leverages a novel activity cliff index to identify and amplify activity cliff compounds, uniquely incorporating them into the reinforcement learning (RL) process through a tailored contrastive loss. This RL framework is designed to focus model optimization on high-impact regions within the SAR landscape, improving the generation of molecules with targeted properties. Experimental evaluations across multiple protein targets demonstrate ACARL’s superior performance in generating high-affinity molecules compared to existing state-of-the-art algorithms. These findings indicate that ACARL effectively integrates SAR principles into the RL-based drug design pipeline, offering a robust approach for de novo molecular design Scientific contribution Our work introduces a machine learning-based drug design framework that explicitly models activity cliffs, a first in AI-driven molecular design. ACARL’s primary technical contributions include the formulation of an activity cliff index to detect these critical points, and a contrastive RL loss function that dynamically enhances the generation of activity cliff compounds, optimizing the model for high-impact SAR regions. This approach demonstrates the efficacy of combining domain knowledge with machine learning advances, significantly expanding the scope and reliability of AI in drug discovery.
Document Type: article
File Description: electronic resource
Language: English
ISSN: 1758-2946
Relation: https://doaj.org/toc/1758-2946
DOI: 10.1186/s13321-025-01006-3
Access URL: https://doaj.org/article/b3d935501aad440b9b1add69886fd34a
Accession Number: edsdoj.b3d935501aad440b9b1add69886fd34a
Database: Directory of Open Access Journals
Full text is not displayed to guests.
More Details
ISSN:17582946
DOI:10.1186/s13321-025-01006-3
Published in:Journal of Cheminformatics
Language:English