Evaluation of AlphaFold 3's Protein-Protein Complexes for Predicting Binding Free Energy Changes upon Mutation

AlphaFold 3 (AF3), the latest version of protein structure prediction software, goes beyond its predecessors by predicting protein-protein complexes. It could revolutionize drug discovery and protein engineering, marking a major step toward comprehensive, automated protein structure prediction. However, independent validation of AF3's predictions is necessary. In this work, we evaluate AF3 complex structures using the SKEMPI 2.0 database which involves 317 protein-protein complexes and 8338 mutations. AF3 complex structures when applied to the most advanced TDL model, MT-TopLap (MultiTask-Topological Laplacian), give rise to a very good Pearson correlation coefficient of 0.86 for predicting protein-protein binding free energy changes upon mutation, which is slightly less than the 0.88 achieved earlier with the Protein Data Bank (PDB) structures. Nonetheless, AF3 complex structures led to a 8.6% increase in the prediction RMSE compared to original PDB complex structures. Additionally, some of AF3's complex structures have large errors, which were not captured in its ipTM performance metric. Finally, it is found that AF3's complex structures are not reliable for intrinsically flexible regions or domains.