How Does HF-DFT Achieve Chemical Accuracy for Water Clusters?

Bolstered by recent calculations of exact functional-driven errors (FEs) and density-driven errors (DEs) of semilocal density functionals in the water dimer binding energy [Kanungo, B. J. Phys. Chem. Lett. 2024, 15, 323-328], we investigate approximate FEs and DEs in neutral water clusters containing up to 20 monomers, charged water clusters, and alkali- and halide-water clusters. Our proxy for the exact density is r2SCAN 50, a 50% global hybrid of exact exchange with r2SCAN, which may be less correct than r2SCAN for the compact water monomer but importantly more correct for long-range electron transfers in the noncompact water clusters. We show that SCAN makes substantially larger FEs for neutral water clusters than r2SCAN, while both make essentially the same DEs. Unlike the case for barrier heights, these FEs are small in a relative sense and become large in an absolute sense only due to an increase in cluster size. SCAN@HF, short for SCAN evaluated on the Hartree-Fock (HF) density, produces a cancellation of errors that makes it chemically accurate for predicting the absolute binding energies of water clusters. Likewise, adding a long-range dispersion correction to r2SCAN@HF, as in the composite method HF-r2SCAN-DC4, makes its FE more negative than in r2SCAN@HF, permitting a near-perfect cancellation of FE and DE. r2SCAN by itself (and even more so, r2SCAN evaluated on the r2SCAN 50 density), is almost perfect for the energy differences between water hexamers, and thus probably also for liquid water away from the boiling point. Thus, the accuracy of composite methods like SCAN@HF and HF-r2SCAN-DC4 is not due to the HF density being closer to the exact density, but to a compensation of errors from its greater degree of localization. We also give an argument for the approximate reliability of this unconventional error cancellation for diverse molecular properties. Finally, we confirm this unconventional error cancellation for the SCAN description of the water trimer via Kohn-Sham inversion of the CCSD(T) density.

Unconventional Error Cancellation Explains the Success of Hartree-Fock Density Functional Theory for Barrier Heights.

Energy barriers, which control the rates of chemical reactions, are seriously underestimated by computationally efficient semilocal approximations for the exchange-correlation energy. The accuracy of a semilocal density functional approximation is strongly boosted for reaction barrier heights by evaluating that approximation non-self-consistently on Hartree-Fock electron densities, which has been known for ∼30 years. The conventional explanation is that the Hartree-Fock theory yields the more accurate density. This work presents a benchmark Kohn-Sham inversion of accurate coupled-cluster densities for the reaction H2 + F → HHF → H + HF and finds a strong, understandable cancellation between positive (excessively overcorrected) density-driven and large negative functional-driven errors (expected from stretched radical bonds in the transition state) within this Hartree-Fock density functional theory. This confirms earlier conclusions (Kaplan, A. D., et al. J. Chem. Theory Comput. 2023, 19, 532-543) based on 76 barrier heights and three less reliable, but less expensive, fully nonlocal density functional proxies for the exact density.

Exact and Model Exchange-Correlation Potentials for Open-Shell Systems.

The conventional approaches to the inverse density functional theory problem typically assume nondegeneracy of the Kohn-Sham (KS) eigenvalues, greatly hindering their use in open-shell systems. We present a generalization of the inverse density functional theory problem that can seamlessly admit degenerate KS eigenvalues. Additionally, we allow for fractional occupancy of the Kohn-Sham orbitals to also handle noninteracting ensemble-v-representable densities, as opposed to just noninteracting pure-v-representable densities. We present the exact exchange-correlation (XC) potentials for six open-shell systems─four atoms (Li, C, N, and O) and two molecules (CN and CH2)─using accurate ground-state densities from configuration interaction calculations. We compare these exact XC potentials with model XC potentials obtained using nonlocal (B3LYP, SCAN0) and local/semilocal (SCAN, PBE, PW92) XC functionals. Although the relative errors in the densities obtained from these DFT functionals are of O(10-3 to 10-2), the relative errors in the model XC potentials remain substantially large─O(10-1 to 100).

Exchange correlation potentials from full configuration interaction in a Slater orbital basis.

Ryabinkin-Kohut-Staroverov (RKS) theory builds a bridge between wave function theory and density functional theory by using quantities from the former to produce accurate exchange-correlation potentials needed by the latter. In this work, the RKS method is developed and tested alongside Slater atomic orbital basis functions for the first time. To evaluate this approach, full configuration interaction computations in the Slater orbital basis are employed to give quality input to RKS, allowing full correlation to be present along with correct nuclei cusps and asymptotic decay of the wavefunction. SlaterRKS is shown to be an efficient algorithm to arrive at exchange-correlation potentials without unphysical artifacts in moderately-sized basis sets. Furthermore, enforcement of the nuclear cusp conditions will be shown to be vital for the success of the Slater-basis RKS method. Examples of weakly and strongly correlated molecular systems will demonstrate the main features of SlaterRKS.

Efficient All-Electron Time-Dependent Density Functional Theory Calculations Using an Enriched Finite Element Basis.

We present an efficient and systematically convergent approach to all-electron real-time time-dependent density functional theory (TDDFT) calculations using a mixed basis, termed as enriched finite element (EFE) basis. The EFE basis augments the classical finite element basis (CFE) with a compactly supported numerical atom-centered basis, obtained from atomic ground-state DFT calculations. Particularly, we orthogonalize the enrichment functions with respect to the classical finite element basis to ensure good conditioning of the resultant basis. We employ the second-order Magnus propagator in conjunction with an adaptive Krylov subspace method for efficient time evolution of the Kohn-Sham orbitals. We rely on a priori error estimates to guide our choice of an adaptive finite element mesh as well as the time step to be used in the TDDFT calculations. We observe close to optimal rates of convergence of the dipole moment with respect to spatial and temporal discretizations. Notably, we attain a 50-100 times speedup for the EFE basis over the CFE basis. We also demonstrate the efficacy of the EFE basis for both linear and nonlinear responses by studying the absorption spectra in sodium clusters, the linear to nonlinear response transition in the green fluorescence protein chromophore, and the higher harmonic generation in the magnesium dimer. Lastly, we attain good parallel scalability of our numerical implementation of the EFE basis for up to ∼1000 processors, using a benchmark system of a 50-atom sodium nanocluster.

A Comparison of Exact and Model Exchange-Correlation Potentials for Molecules.

Accurate exchange-correlation (XC) potentials for three-dimensional systems─via solution of the inverse density functional theory (DFT) problem─are now available to test the quality of DFT approximations. Herein, the exact XC potential for seven molecules─dihydrogen at four different bond-lengths, lithium hydride, water, and ortho-benzyne─are computed from full configuration interaction reference densities. These are compared to model XC potentials from nonlocal (B3LYP, HSE06, SCAN0, and M08-HX) and semilocal/local (SCAN, PBE, and PW92) XC functionals. Whereas for most systems, relative errors in the ground-state densities are O(10-3-10-2), the model XC potentials have much higher errors of O(10-1-100). Among the model XC functionals, SCAN0 offers the best agreement with the exact XC potential, underlining the significance of satisfying exact conditions as well as including nonlocal effects in XC functionals. This work indicates that tests against the exact XC potential will provide a promising new direction for building more accurate XC functionals for DFT.

Exact exchange-correlation potentials from ground-state electron densities.

The quest for accurate exchange-correlation functionals has long remained a grand challenge in density functional theory (DFT), as it describes the many-electron quantum mechanical behavior through a computationally tractable quantity-the electron density-without resorting to multi-electron wave functions. The inverse DFT problem of mapping the ground-state density to its exchange-correlation potential is instrumental in aiding functional development in DFT. However, the lack of an accurate and systematically convergent approach has left the problem unresolved, heretofore. This work presents a numerically robust and accurate scheme to evaluate the exact exchange-correlation potentials from correlated ab-initio densities. We cast the inverse DFT problem as a constrained optimization problem and employ a finite-element basis-a systematically convergent and complete basis-to discretize the problem. We demonstrate the accuracy and efficacy of our approach for both weakly and strongly correlated molecular systems, including up to 58 electrons, showing relevance to realistic polyatomic molecules.