Collagen fiber centerline tracking in fibrotic tissue via deep neural networks with variational autoencoder-based synthetic training data generation

被引:2
|
作者
Park, Hyojoon
Li, Bin
Liu, Yuming [3 ]
Nelson, Michael S. [2 ,3 ]
Wilson, Helen M. [2 ,3 ]
Sifakis, Eftychios [1 ]
Eliceiri, Kevin W. [2 ,3 ,4 ]
机构
[1] Univ Wisconsin Madison, Dept Comp Sci, Madison, WI 53706 USA
[2] Univ Wisconsin Madison, Dept Biomed Engn, Madison, WI 53706 USA
[3] Univ Wisconsin Madison, Lab Opt & Computat Instrumentat, Madison, WI 53706 USA
[4] Morgridge Inst Res, Madison, WI 53706 USA
关键词
Digital pathology; Variational autoencoder; Collagen fiber; Deep learning; Generative model; MICROSCOPY; AUGMENTATION; FIBROBLASTS; PERFORMANCE;
D O I
10.1016/j.media.2023.102961
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The role of fibrillar collagen in the tissue microenvironment is critical in disease contexts ranging from cancers to chronic inflammations, as evidenced by many studies. Quantifying fibrillar collagen organization has become a powerful approach for characterizing the topology of collagen fibers and studying the role of collagen fibers in disease progression. We present a deep learning-based pipeline to quantify collagen fibers' topological properties in microscopy-based collagen images from pathological tissue samples. Our method leverages deep neural networks to extract collagen fiber centerlines and deep generative models to create synthetic training data, addressing the current shortage of large-scale annotations. As a part of this effort, we have created and annotated a collagen fiber centerline dataset, with the hope of facilitating further research in this field. Quantitative measurements such as fiber orientation, alignment, density, and length can be derived based on the centerline extraction results. Our pipeline comprises three stages. Initially, a variational autoencoder is trained to generate synthetic centerlines possessing controllable topological properties. Subsequently, a conditional generative adversarial network synthesizes realistic collagen fiber images from the synthetic centerlines, yielding a synthetic training set of image-centerline pairs. Finally, we train a collagen fiber centerline extraction network using both the original and synthetic data. Evaluation using collagen fiber images from pancreas, liver, and breast cancer samples collected via second-harmonic generation microscopy demonstrates our pipeline's superiority over several popular fiber centerline extraction tools. Incorporating synthetic data into training further enhances the network's generalizability. Our code is available at https://github.com/uw-loci/collagen-fiber-metrics.
引用
收藏
页数:16
相关论文
共 4 条
  • [1] Discrimination between Genuine and Cloned Gait Silhouette Videos via Autoencoder-Based Training Data Generation
    Hirose, Yuki
    Nakamura, Kazuaki
    Nitta, Naoko
    Babaguchi, Noboru
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2019, E102D (12) : 2535 - 2546
  • [2] ScaffoldGVAE: scaffold generation and hopping of drug molecules via a variational autoencoder based on multi-view graph neural networks
    Chao Hu
    Song Li
    Chenxing Yang
    Jun Chen
    Yi Xiong
    Guisheng Fan
    Hao Liu
    Liang Hong
    Journal of Cheminformatics, 15
  • [3] ScaffoldGVAE: scaffold generation and hopping of drug molecules via a variational autoencoder based on multi-view graph neural networks
    Hu, Chao
    Li, Song
    Yang, Chenxing
    Chen, Jun
    Xiong, Yi
    Fan, Guisheng
    Liu, Hao
    Hong, Liang
    JOURNAL OF CHEMINFORMATICS, 2023, 15 (01)
  • [4] Deep learning model for fiber optic distributed acoustic sensing seismic data compression based on autoencoder and recurrent neural networks
    Wang, Honghui
    Yang, Xike
    Zeng, Shangkun
    Liu, Tong
    Wang, Xiang
    Wang, Yiru
    APPLIED OPTICS, 2024, 63 (20) : 5303 - 5315