RESEARCH ARTICLE Relative Entropy and Optimization-Driven Coarse-Graining Methods in VOTCA
S. Y. Mashayak1, Mara N. Jochum2, Konstantin Koschke2, N. R. Aluru1, Victor Rühle3, Christoph Junghans4*
1 Department of Mechanical Science and Engineering, Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, 61801, United States of America, 2 Max Planck Institute for Polymer Research, Ackermannweg 10, 55128 Mainz, Germany, 3 Department of Chemistry, University of Cambridge, Cambridge, United Kingdom, 4 Computer, Computational, and Statistical Sciences Division, Los Alamos National Laboratory, Los Alamos, NM 87545, United States of a11111 America
Abstract
OPEN ACCESS We discuss recent advances of the VOTCA package for systematic coarse-graining. Two methods have been implemented, namely the downhill simplex optimization and the relative Citation: Mashayak SY, Jochum MN, Koschke K, Aluru NR, Rühle V, Junghans C (2015) Relative entropy minimization. We illustrate the new methods by coarse-graining SPC/E bulk water Entropy and Optimization-Driven Coarse-Graining and more complex water-methanol mixture systems. The CG potentials obtained from both Methods in VOTCA. PLoS ONE 10(7): e0131754. methods are then evaluated by comparing the pair distributions from the coarse-grained to doi:10.1371/journal.pone.0131754 the reference atomistic simulations. In addition to the newly implemented methods, we Editor: Xuhui Huang, Hong Kong University of have also added a parallel analysis framework to improve the computational efficiency of Science and Technology, HONG KONG the coarse-graining process. Received: November 12, 2014
Accepted: June 5, 2015
Published: July 20, 2015
Copyright: This is an open access article, free of all copyright, and may be freely reproduced, distributed, 1 Introduction transmitted, modified, built upon, or otherwise used In recent years, coarse-grained simulations have become an important tool for investigating by anyone for any lawful purpose. The work is made – available under the Creative Commons CC0 public systems on larger time- and length-scales [1 6]. Here, we focus on the bottom-up approaches domain dedication. of coarse-graining (CG), which create a systematic link between two particle based descriptions of a given system by building a lower resolution model based on a reference higher resolution Data Availability Statement: The code with which the simulation has been performed can be found model. here: https://code.google.com/p/votca/source/browse/ In a coarse-grained representation, several atoms are grouped into a single CG unit and the ?repo = csg. The input files to the simulations shown effective interactions between them are determined. Such coarse-graining leads to a significant in the paper have been published here: https://code. speed-up in the molecular dynamics (MD) simulations due to i) a reduced number of degrees google.com/p/votca/source/browse/?repo = csg- of freedom and hence, the number of interactions to compute, ii) smoother interaction poten- tutorials. tials among CG particles that enable larger time steps, and most importantly, iii) a speedup in Funding: SYM and NRA acknowledge financial the intrinsic dynamics of the system which leads to faster diffusion and thus, shorter equilibra- support by the NSF under grant Nos. 480 1264282 tion times [7]. and 1420882 and AFOSR under grant No. 11157642. CJ was financially supported by SFB 625 in the Although coarse-grained simulations allow one to reach longer time- and length-scales, framework of the multiscale modeling initiative of the they also, by definition, lose some information from the underlying reference system. For Max-Planck Society (M3). This research was instance, when replacing a water molecule by a single sphere, one loses information about the
PLOS ONE | DOI:10.1371/journal.pone.0131754 July 20, 2015 1/20 Relative Entropy and Optimization-Driven Coarse-Graining Methods supported in part by the National Science Foundation molecule’s orientation. Generally, CG systems are limited in their representability and transfer- under grant number NSF PHY11-25915. CJ thanks ability, i.e., they cannot simultaneously reproduce all of the properties of interest and they may LANL for a Director’s fellowship and the MPG for not be applicable for thermodynamic states far away from the one at which the system was hospitality in 2013 at MPI-P. K. Koschke acknowledges funding by the Nestlé Research parametrized [8, 9]. Center. MNJ acknowledges DFG Emmy Noether There exist, however, several coarse-graining techniques of varying complexities and accu- program for financial support. Assigned: LA-UR-13- racies for modeling CG systems and optimizing their interactions. These range from structure- 26878. LANL is operated by Los Alamos National based methods, such as Boltzmann inversion, iterative Boltzmann inversion (IBI) [10], inverse Security, LLC, for the National Nuclear Security monte carlo (IMC) [11], and relative entropy [12], to force-based methods like force matching Administration of the U.S. DOE under Contract DE- AC52-06NA25396. The funders had no role in study (FM) [13, 14]. Structure-based methods target (multi-body) distribution functions and use the design, data collection and analysis, decision to relation between the distribution functions and the potential of mean force (PMF) [10, 14]to publish, or preparation of the manuscript. derive effective CG interactions. In contrast, the FM method tries to reproduce forces on CG
Competing Interests: Nestlé Research Center partly sites [14]. Detailed descriptions about the various aspects and methods for determining CG – funded this study. There are no patents, products in potentials can be found in ref. [1, 3, 14 16]. development or marketed products to declare. This Given such a wide range of methods of varying complexity and properties that they target, does not alter the authors’ adherence to all of the the question arises as which method is the most suitable for a specific system in a desired appli- PLOS ONE policies on sharing data and materials. cation. This can be best answered by a comparative analysis of the CG potentials obtained from different methods. To facilitate the determination of these potentials and to allow for a direct comparison of the methods, the Versatile Object-Oriented Toolkit for Coarse-graining Applications (VOTCA) was developed by Rühle et. al [16], which is available under an open source software license. In the first release of VOTCA, Boltzmann inversion, IBI, IMC, and FM had been imple- mented. In ref. [16], the VOTCA package was used to compare IBI, IMC, and FM by coarse- graining four test systems, namely SPC/E water, methanol, liquid propane, and a single chain of hexane. For example, it was observed that the IMC update function is more efficient than that of IBI method. IMC, however, requires significantly more statistics, and hence longer tra- jectories, and can be sensitive to finite size effects. On the other side, FM can have represent- ability issues if the set of coarse-grained interactions is incomplete. For such cases, three hybrid schemes to combine FM for non-bonded and the Boltzmann inversion for bonded interactions have been discussed in ref. [17] and applied to liquid hexane. Recently, we added two new methods to the VOTCA package, namely the simplex method [18] and relative entropy method [12]. The simplex algorithm is a general optimization method, which can be used to optimize coarse-grained interactions. As such, it is difficult to target properties other than structure, e.g. thermodynamic quantities. Nevertheless, extensions for pressure correction [10] or the Kirk- wood-Buff integral (KBI) [19] have been proposed but lack in a sound theoretical basis. How- ever, structure-based methods, pressure correction, or KBI, are based on the relation between the CG interactions and target properties. By comparison, the simplex algorithm makes no a priori assumptions about the relation between the effective interactions and the target proper- ties but instead requires the definition of an objective function which allows to fit arbitrary properties using a given functional form for the potentials. We call this approach targeted coarse-graining. In that sense, structure-based methods could be categorized as a subclass of targeted coarse-graining methods which target structural quantities and use a specialized opti- mizers like IMC or IBI. Relative entropy is a method which quantifies the extent of the configurational phase-space overlap between two molecular ensembles [20]. It can be used as a measure of the discrepancies between various properties of the CG system’s and the target all-atom (AA) ensemble. It has been shown by Shell S. [12] that one can minimize the relative entropy metric between the model CG system and the target AA system to optimize CG potential parameters such that the CG ensemble would mimic the target AA ensemble.
PLOS ONE | DOI:10.1371/journal.pone.0131754 July 20, 2015 2/20 Relative Entropy and Optimization-Driven Coarse-Graining Methods
The main objective of this paper is to describe and demonstrate the two newly implemented methods in VOTCA. In the sections 2.1 and 2.2, we describe the formulations of the simplex- based and the relative entropy-based methods, respectively. Implementation details of the sim- plex and relative entropy methods are given in the sections 3.1 and 3.2, respectively. In the sec- tions 4.1 and 4.2, we illustrate the simplex and relative entropy methods for a three-site SPC/E bulk water and a more complex water-methanol bulk mixture. To evaluate the accuracy of the CG potentials, we then compare the two-body distribution functions obtained from the CG MD system (CG-MD) with the reference AA MD system (AA-MD) simulations. In addition to these new methods, we have also made several improvements and other additions to VOTCA as described in the sections 3.4 and 3.5. For example, we have added a parallel analysis frame- work, which improves the performance of VOTCA by allowing it to utilize multi-core CPUs. These performance improvements are discussed in the section 3.4.
2 Methods 2.1 Downhill simplex algorithm The downhill simplex algorithm [18] is a derivative-free optimization procedure designed to ... minimize an objective (or penalty) function, y(x1, x2, , xn), with n degrees of freedom. p p ... p In the algorithm, the current state is described by n+1 vertices 1, 2, , n+1, with their corresponding penalty values from the objective function, which make up the geometric shape of a polytope. This polytope can then be transformed successively using basic operations such as a reflection, an expansion, a contraction, or a reduction in order to move towards the global minimum, i.e., minimize the objective function. The nature of progression of the algorithm depends on the combination of these transformations. In the following notation, we assume that the vertices at each step i are sorted according to their penalty values in ascending order. The first transformation performed on the initial polytope is a reflection, in which the vertex p with the highest objective value, n+1, is reflected through the centroid of all remaining points, p , such that p ¼ p þ ð p p Þ ; > 0 : ð : Þ r a nþ1 a 2 1 p fl α fl fi Here, r is the re ected point and is the re ection coef cient. This transformation preserves fl the volume of the simplex. If the penalty of the re ected point, yr, is lower than the best value, < fl i.e., yr y1, the algorithm tries to increase the step size along the line of the re ection. This is known as an expansion, p ¼ p þ ð p p Þ ; > 1 ; ð : Þ e g nþ1 g 2 2 p γ fi p where e is the expanded point and is the expansion coef cient, which is the distance from r p p fl through the centroid, ,to e. In contrast, if the value of the re ected point is worse than the > highest point, i.e., yr yn+1, the move is too large. Thus, a contraction is performed to reduce the step size and find a point which decreases the objective function, where p ¼ p þ ð p p Þ ; 0 > > 1 : ð : Þ c r nþ1 r 2 3 p ρ fi Here, c is the contracted point and is the contraction coef cient. If no improvement can be > achieved upon contraction, i.e., yc yn+1,areduction is performed. This happens in situations p close to a minimum by contracting the whole simplex around the lowest point, 1, such that p ! ð p þ p Þ ; ð : Þ i s i 1 2 4
where σ is the reduction coefficient. Subsequently, the procedure is restarted with a reflection.
PLOS ONE | DOI:10.1371/journal.pone.0131754 July 20, 2015 3/20 Relative Entropy and Optimization-Driven Coarse-Graining Methods
p fi fl In all other cases, the highest point, n+1,is rst replaced by the newly re ected, expanded, or contracted point, all points are resorted according to their penalty values, and the procedure is then resumed. The above described algorithm is applicable to a wide range of applications. In the context of coarse-graining, the evaluation of the objective function involves performing a coarse- grained simulation with a given set of parameters and subsequently analyzing its trajectory to compute the properties of interest. Here, the objective function calculates a single value, which is a cumulative measure of how well the target properties are reproduced. Hence, the algorithm constitutes a coarse-graining tool to find the optimal coarse-grained interaction parameters for nearly any measurable simulation property, even the optimal mapping for the CG model itself. One of the benefits of the downhill simplex algorithm is that it does not require any deriva- tives of the objective function which are often difficult to obtain. However, problems with con- vergence may arise when poor initial guesses are provided which yield high penalty values or if the objective function contains too many parameters, such as n > 10. Furthermore, since the objective function is a cumulative measure of the properties of interest, providing an appropri- ate form which accounts for each of these equally is often challenging. In this work, we set α =1,γ = 2, and ρ, σ = 0.5. However, as the performance of the simplex algorithm heavily depends on the type of system and the properties of interest studied, adapt- ing these transformation coefficients may lead to a better performance than reported here.
2.2 Relative entropy
Relative entropy, Srel, is defined as [12] X p ðr Þ ¼ ð Þ AA i þh i ; ð : Þ Srel pAA ri ln ð ð ÞÞ Smap AA 2 5 i pCG M ri fi ... where the sum is over all the con gurations of the reference AA system, r ={ri}(i =1,2, ), M fi fi is the mapping operation to generate a corresponding CG con guration, RI, from a AA con g- fi uration, ri, i.e., RI = M(ri), pAA and pCG are the con gurational probabilities based on the AA h i and CG potentials, respectively, and Smap AA is the mapping entropy due to the average degeneracy of AA configurations mapping to the same CG configuration, given by X S ðR Þ¼ ln d ; ð Þ ; map I RI M ri ð2:6Þ i
where δ is the Kronecker delta function. From Eq (2.6), it can be shown that the mapping h i entropy, Smap AA, does not depend on the CG interactions, but instead it is a unique function of the mapping operation, M, and the AA configurational weights. The relative entropy is a metric borrowed from the field of information theory, which quantifies the extent of the config- urational phase-space overlap between two molecular ensembles [20]. The log-likelihood based derivation of the relative entropy for molecular systems, as defined in Eq (2.5), is given in ref. fi [12]. Physically, Srel can be interpreted as the log probability that one test con guration of the model CG ensemble is representative of the target AA ensemble, and when the likelihood is a
maximum, Srel is at a minimum. Hence, the numerical minimization of Srel with respect to the parameters of the CG model can be used to optimize the CG model. Comparisons between relative entropy and other coarse-graining methods are made in ref. [14] and [15]. Chaimovich and Shell [15] have shown that for certain CG models relative entropy minimization produces the same CG potentials as other methods, e.g., it is equivalent to the IBI when CG interactions are modeled using finely tabulated pair additive potentials, and to the FM when a CG model is based on N–body interactions, where N is the number of
PLOS ONE | DOI:10.1371/journal.pone.0131754 July 20, 2015 4/20 Relative Entropy and Optimization-Driven Coarse-Graining Methods
degrees of freedom in the CG model. However, there are some advantages of using relative entropy based coarse-graining. Relative entropy method allows to use analytical function forms for CG potentials, which are desired in theoretical treatments, such as parametric study of CG potentials, whereas, methods, like IBI, use tabulated potentials. Recently Lyubartsev et. al [21] have shows how to use IMC with an analytical function form, too. BI, IBI, and IMC methods are based on pair correlations and hence, they are only useful to optimize 2-body CG potentials, whereas, relative entropy uses more generic metric which offers more flexibility in modeling CG interactions and not only 2-body, but also 3-body and N-body CG potentials can be optimized. In addition to the CG potential optimization, the relative entropy metric can also be used to optimize an AA to CG mapping operator. In a canonical ensemble, substituting canonical configurational probabilities into Eq (2.5), the relative entropy simplifies to ¼ h i ð Þþh i ; ð : Þ Srel b UCG UAA AA b ACG AAA Smap AA 2 7 β where =1/kB T, kB is the Boltzmann constant, T is the temperature, UCG and UAA are the total potential energies from the CG and AA potentials, respectively, ACG and AAA are the con- figurational part of the Helmholtz free energies from the CG and AA potentials, respectively, and all the averages are computed in the reference AA ensemble. Consider a model CG system defined by the CG potentials between various CG sites such λ λ λ ...λ that the CG potentials depend on the parameters ={ 1, 2, n}. As described above, in the relative entropy based coarse-graining, the CG potential parameters, λ, are optimized by the relative entropy minimization. In this work, we use the Newton-Raphson strategy for the relative entropy minimization described in ref. [15]. In this strategy, the CG potential parameters, λ, are refined iteratively as λkþ1 ¼ λk H 1 r ; ð : Þ w lSrel 2 8
where k is the iteration index, χ 2 (0...1) is the relaxation parameter that can be adjusted to r fi λ ensure convergence, λ Srel is the vector of the rst derivatives of Srel with respect to , which can be computed from Eq (2.7) as @U @U r ¼ b CG b CG ; ð : Þ lSrel @ @ 2 9 l AA l CG H and is the Hessian matrix of Srel given by