Entropy-Reinforced Planning with Large Language Models for Drug Discovery
The objective of drug discovery is to identify chemical compounds that possess specific pharmaceutical properties toward a binding target. Existing large language models (LLMS) can achieve high token matching scores in terms of likelihood for molecule generation. However, relying solely on LLM decod...
שמור ב:
| Autores principales: | , , , , |
|---|---|
| פורמט: | Artículo |
| יצא לאור: |
2024
|
| נושאים: | |
| גישה מקוונת: | https://arxiv.org/abs/2406.07025 http://arxiv.org/abs/2406.07025 |
| תגים: |
אין תגיות, היה/י הראשונ/ה לתייג את הרשומה!
|
| _version_ | 1879176859834384384 |
|---|---|
| author | Liu, Xuefeng Tien, Chih-chan Ding, Peng Jiang, Songhao Stevens, Rick L. |
| author_browse | Ding, Peng Jiang, Songhao Liu, Xuefeng Stevens, Rick L. Tien, Chih-chan |
| author_facet | Liu, Xuefeng Tien, Chih-chan Ding, Peng Jiang, Songhao Stevens, Rick L. |
| author_sort | Liu, Xuefeng |
| building | arXiv |
| collection | Acceso abierto |
| description | The objective of drug discovery is to identify chemical compounds that possess specific pharmaceutical properties toward a binding target. Existing large language models (LLMS) can achieve high token matching scores in terms of likelihood for molecule generation. However, relying solely on LLM decoding often results in the generation of molecules that are either invalid due to a single misused token, or suboptimal due to unbalanced exploration and exploitation as a consequence of the LLMs prior experience. Here we propose ERP, Entropy-Reinforced Planning for Transformer Decoding, which employs an entropy-reinforced planning algorithm to enhance the Transformer decoding process and strike a balance between exploitation and exploration. ERP aims to achieve improvements in multiple properties compared to direct sampling from the Transformer. We evaluated ERP on the SARS-CoV-2 virus (3CLPro) and human cancer cell target protein (RTCB) benchmarks and demonstrated that, in both benchmarks, ERP consistently outperforms the current state-of-the-art algorithm by 1-5 percent, and baselines by 5-10 percent, respectively. Moreover, such improvement is robust across Transformer models trained with different objectives. Finally, to further illustrate the capabilities of ERP, we tested our algorithm on three code generation benchmarks and outperformed the current state-of-the-art approach as well. Our code is publicly available at: https://github.com/xuefeng-cs/ERP. |
| first_indexed | 2026-10-16T00:51:36Z |
| format | Article |
| fullrecord | <oai_dc:dc xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ https://www.openarchives.org/OAI/2.0/oai_dc.xsd"><identifier>arxiv-2406.07025</identifier><datestamp>2025-04-01</datestamp>
<dc:title>Entropy-Reinforced Planning with Large Language Models for Drug Discovery</dc:title>
<dc:creator>Liu, Xuefeng</dc:creator>
<dc:creator>Tien, Chih-chan</dc:creator>
<dc:creator>Ding, Peng</dc:creator>
<dc:creator>Jiang, Songhao</dc:creator>
<dc:creator>Stevens, Rick L.</dc:creator>
<dc:subject>Machine Learning</dc:subject>
<dc:subject>Artificial Intelligence</dc:subject>
<dc:subject>Quantitative Methods</dc:subject>
<dc:description>The objective of drug discovery is to identify chemical compounds that possess specific pharmaceutical properties toward a binding target. Existing large language models (LLMS) can achieve high token matching scores in terms of likelihood for molecule generation. However, relying solely on LLM decoding often results in the generation of molecules that are either invalid due to a single misused token, or suboptimal due to unbalanced exploration and exploitation as a consequence of the LLMs prior experience. Here we propose ERP, Entropy-Reinforced Planning for Transformer Decoding, which employs an entropy-reinforced planning algorithm to enhance the Transformer decoding process and strike a balance between exploitation and exploration. ERP aims to achieve improvements in multiple properties compared to direct sampling from the Transformer. We evaluated ERP on the SARS-CoV-2 virus (3CLPro) and human cancer cell target protein (RTCB) benchmarks and demonstrated that, in both benchmarks, ERP consistently outperforms the current state-of-the-art algorithm by 1-5 percent, and baselines by 5-10 percent, respectively. Moreover, such improvement is robust across Transformer models trained with different objectives. Finally, to further illustrate the capabilities of ERP, we tested our algorithm on three code generation benchmarks and outperformed the current state-of-the-art approach as well. Our code is publicly available at: https://github.com/xuefeng-cs/ERP. </dc:description>
<dc:description>Published in ICML2024</dc:description>
<dc:date>2024-06-11</dc:date>
<dc:date>2025-03-29</dc:date>
<dc:type>text</dc:type>
<dc:identifier>https://arxiv.org/abs/2406.07025</dc:identifier>
<dc:identifier>http://arxiv.org/abs/2406.07025</dc:identifier>
</oai_dc:dc> |
| id | arxiv-2406.07025 |
| institution | arXiv |
| last_indexed | 2026-10-16T00:51:36Z |
| publishDate | 2024 |
| publishDateRange | 2024 |
| publishDateSort | 2024 |
| record_format | oai_dc |
| spelling | arxiv-2406.070252025-04-01 Entropy-Reinforced Planning with Large Language Models for Drug Discovery Liu, Xuefeng Tien, Chih-chan Ding, Peng Jiang, Songhao Stevens, Rick L. Machine Learning Artificial Intelligence Quantitative Methods The objective of drug discovery is to identify chemical compounds that possess specific pharmaceutical properties toward a binding target. Existing large language models (LLMS) can achieve high token matching scores in terms of likelihood for molecule generation. However, relying solely on LLM decoding often results in the generation of molecules that are either invalid due to a single misused token, or suboptimal due to unbalanced exploration and exploitation as a consequence of the LLMs prior experience. Here we propose ERP, Entropy-Reinforced Planning for Transformer Decoding, which employs an entropy-reinforced planning algorithm to enhance the Transformer decoding process and strike a balance between exploitation and exploration. ERP aims to achieve improvements in multiple properties compared to direct sampling from the Transformer. We evaluated ERP on the SARS-CoV-2 virus (3CLPro) and human cancer cell target protein (RTCB) benchmarks and demonstrated that, in both benchmarks, ERP consistently outperforms the current state-of-the-art algorithm by 1-5 percent, and baselines by 5-10 percent, respectively. Moreover, such improvement is robust across Transformer models trained with different objectives. Finally, to further illustrate the capabilities of ERP, we tested our algorithm on three code generation benchmarks and outperformed the current state-of-the-art approach as well. Our code is publicly available at: https://github.com/xuefeng-cs/ERP. Published in ICML2024 2024-06-11 2025-03-29 text https://arxiv.org/abs/2406.07025 http://arxiv.org/abs/2406.07025 |
| spellingShingle | Machine Learning Artificial Intelligence Quantitative Methods Liu, Xuefeng Tien, Chih-chan Ding, Peng Jiang, Songhao Stevens, Rick L. Entropy-Reinforced Planning with Large Language Models for Drug Discovery |
| title | Entropy-Reinforced Planning with Large Language Models for Drug Discovery |
| title_full | Entropy-Reinforced Planning with Large Language Models for Drug Discovery |
| title_fullStr | Entropy-Reinforced Planning with Large Language Models for Drug Discovery |
| title_full_unstemmed | Entropy-Reinforced Planning with Large Language Models for Drug Discovery |
| title_short | Entropy-Reinforced Planning with Large Language Models for Drug Discovery |
| title_sort | entropy reinforced planning with large language models for drug discovery |
| topic | Machine Learning Artificial Intelligence Quantitative Methods |
| url | https://arxiv.org/abs/2406.07025 http://arxiv.org/abs/2406.07025 |
| work_keys_str_mv | AT liuxuefeng entropyreinforcedplanningwithlargelanguagemodelsfordrugdiscovery AT tienchihchan entropyreinforcedplanningwithlargelanguagemodelsfordrugdiscovery AT dingpeng entropyreinforcedplanningwithlargelanguagemodelsfordrugdiscovery AT jiangsonghao entropyreinforcedplanningwithlargelanguagemodelsfordrugdiscovery AT stevensrickl entropyreinforcedplanningwithlargelanguagemodelsfordrugdiscovery |