Multimodal Image Fusion Workflow Incorporating MALDI Imaging Mass Spectrometry and Microscopy for the Study of Small Pharmaceutical Compounds

Multimodal imaging analyses of dosed tissue samples can provide more comprehensive insights into the effects of a therapeutically active compound on a target tissue compared to single-modal imaging. For example, simultaneous spatial mapping of pharmaceutical compounds and endogenous macromolecule receptors is difficult to achieve in a single imaging experiment. Herein, we present a multimodal workflow combining imaging mass spectrometry with immunohistochemistry (IHC) fluorescence imaging and brightfield microscopy imaging. Imaging mass spectrometry enables direct mapping of pharmaceutical compounds and metabolites, IHC fluorescence imaging can visualize large proteins, and brightfield microscopy imaging provides tissue morphology information. Single-cell resolution images are generally difficult to acquire using imaging mass spectrometry but are readily acquired with IHC fluorescence and brightfield microscopy imaging. Spatial sharpening of mass spectrometry images would thus allow for higher fidelity coregistration with other higher-resolution microscopy images. Imaging mass spectrometry spatial resolution can be predicted to a finer value via a computational image fusion workflow, which models the relationship between the intensity values in the mass spectrometry image and the features of a high-spatial resolution microscopy image. As a proof of concept, our multimodal workflow was applied to brain tissue extracted from a Sprague-Dawley rat dosed with a kratom alkaloid, corynantheidine. Four candidate mathematical models, including linear regression, partial least-squares regression, random forest regression, and two-dimensional convolutional neural network (2-D CNN), were tested. The random forest and 2-D CNN models most accurately predicted the intensity values at each pixel as well as the overall patterns of the mass spectrometry images, while also providing the best spatial resolution enhancements. Herein, image fusion enabled predicted mass spectrometry images of corynantheidine, GABA, and glutamine to approximately 2.5 mu m spatial resolutions, a significant improvement compared to the original images acquired at 25 mu m spatial resolution. The predicted mass spectrometry images were then coregistered with an H&E image and IHC fluorescence image of the mu-opioid receptor to assess colocalization of corynantheidine with brain cells. Our study also provides insights into the different evaluation parameters to consider when utilizing image fusion for biological applications.