Enhancing Activation Energy Predictions under Data Constraints Using Graph Neural Networks

21 October 2024, Version 1
This content is a preprint and has not undergone peer review at the time of posting.

Abstract

Accurately predicting activation energies is crucial for understanding chemical reactions and modeling complex reaction systems. However, the high computational cost of quantum chemistry methods often limits the feasibility of large-scale studies, leading to a scarcity of high-quality activation energy data. In this work, we explore and compare three innovative approaches—transfer learning, delta learning, and feature engineering—to enhance the accuracy of activation energy predictions using graph neural networks, specifically focusing on methods that incorporate low-cost, low-level computational data. Using the Chemprop model, we systematically evaluated how these methods leverage data from semiempirical quantum mechanical (SQM) calculations to improve predictions. Our findings reveal that delta learning, which adjusts low-level SQM activation energies to match high-level CCSD(T)-F12a targets, offers the greatest accuracy improvement. However, this approach also requires more computational resources due to the complexity of transition state searches for each query of activation energy during model application. Transfer learning, which pretrains models on large datasets of low-level data, provided mixed results, particularly when there was a mismatch in the reaction distributions between the training and target datasets. Feature engineering, which involves adding computed molecular properties as input features, showed modest gains, particularly when incorporating thermodynamic properties. Our study highlights the trade-offs between accuracy and computational demand in selecting the best approach for enhancing activation energy predictions. These insights provide valuable guidelines for researchers aiming to apply machine learning in chemical reaction engineering, helping to balance accuracy with resource constraints.

Keywords

Transfer Learning
Delta Learning
Feature Engineering
Machine Learning
Semiempirical Quantum Mechanism

Supplementary materials

Title
Description
Actions
Title
Supporting Information: Enhancing Activation Energy Predictions under Data Constraints Using Machine Learning
Description
This supporting information provides additional details for the study "Enhancing Activation Energy Predictions under Data Constraints Using Machine Learning." The document outlines the hyperparameter optimization performed for the Chemprop model, with parameters specified in Table S1. It also presents the classification of reaction types from the CCSD(T)-F12a and RGD1 databases using Reaction Mechanism Generator (RMG) templates (Tables S2 and S3), with reaction type histograms shown in Figures S1 and S2. Additionally, delta learning results for AM1 and PM3 semi-empirical methods are documented, highlighting statistical improvements in activation energy predictions (Tables S4 and S5).
Actions

Comments

Comments are not moderated before they are posted, but they can be removed by the site moderators if they are found to be in contravention of our Commenting Policy [opens in a new tab] - please read this policy before you post. Comments should be used for scholarly discussion of the content in question. You can find more information about how to use the commenting feature here [opens in a new tab] .
This site is protected by reCAPTCHA and the Google Privacy Policy [opens in a new tab] and Terms of Service [opens in a new tab] apply.