Unsupervised data to content transformation with histogram-matching cycle-consistent generative adversarial networks

被引:20
|
作者
Ihle, Stephan J. [1 ,2 ]
Reichmuth, Andreas M. [1 ,2 ]
Girardin, Sophie [1 ,2 ]
Han, Hana [1 ,2 ]
Stauffer, Flurin [1 ,2 ]
Bonnin, Anne [3 ]
Stampanoni, Marco [3 ]
Pattisapu, Karthik [1 ,2 ]
Voeroes, Janos [1 ,2 ]
Forro, Csaba [1 ,2 ]
机构
[1] Swiss Fed Inst Technol, Lab Biosensors & Bioelect, Zurich, Switzerland
[2] Univ Zurich, Zurich, Switzerland
[3] Paul Scherrer Inst, Swiss Light Source, Villigen, Switzerland
基金
瑞士国家科学基金会;
关键词
Generative adversarial networks - Nanowires - Image segmentation - Cells - Computerized tomography - Metadata;
D O I
10.1038/s42256-019-0096-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The segmentation of images is a common task in a broad range of research fields. To tackle increasingly complex images, artificial intelligence-based approaches have emerged to overcome the shortcomings of traditional feature detection methods. Owing to the fact that most artificial intelligence research is made publicly accessible and programming the required algorithms is now possible in many popular languages, the use of such approaches is becoming widespread. However, these methods often require data labelled by the researcher to provide a training target for the algorithms to converge to the desired result. This labelling is a limiting factor in many cases and can become prohibitively time consuming. Inspired by the ability of cycle-consistent generative adversarial networks to perform style transfer, we outline a method whereby a computer-generated set of images is used to segment the true images. We benchmark our unsupervised approach against a state-of-the-art supervised cell-counting network on the VGG Cells dataset and show that it is not only competitive but also able to precisely locate individual cells. We demonstrate the power of this method by segmenting bright-field images of cell cultures, images from a live/dead assay of C. elegans, and X-ray computed tomography of metallic nanowire meshes. Labelling training data to train machine learning models is very time intense. A new method shows that content transformation can be effectively learned from generated data, avoiding the need for any manual labelling in segmentation and classification tasks.
引用
收藏
页码:461 / 470
页数:10
相关论文
共 50 条
  • [1] Unsupervised data to content transformation with histogram-matching cycle-consistent generative adversarial networks
    Stephan J. Ihle
    Andreas M. Reichmuth
    Sophie Girardin
    Hana Han
    Flurin Stauffer
    Anne Bonnin
    Marco Stampanoni
    Karthik Pattisapu
    János Vörös
    Csaba Forró
    [J]. Nature Machine Intelligence, 2019, 1 : 461 - 470
  • [2] Unsupervised Cycle-Consistent Generative Adversarial Networks for Pan Sharpening
    Zhou, Huanyu
    Liu, Qingjie
    Weng, Dawei
    Wang, Yunhong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [3] Unsupervised Image Dedusting via a Cycle-Consistent Generative Adversarial Network
    Gao, Guxue
    Lai, Huicheng
    Jia, Zhenhong
    [J]. REMOTE SENSING, 2023, 15 (05)
  • [4] On Translation and Reconstruction Guarantees of the Cycle-Consistent Generative Adversarial Networks
    Chakrabarty, Anish
    Das, Swagatam
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [5] Unsupervised Video Summarization With Cycle-Consistent Adversarial LSTM Networks
    Yuan, Li
    Tay, Francis Eng Hock
    Li, Ping
    Feng, Jiashi
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (10) : 2711 - 2722
  • [6] Adversarial sample attacks algorithm based on cycle-consistent generative networks
    Gao, Haoqi
    Yang, Xing
    Hu, Yihua
    Liang, Zhenyu
    Xu, Haoli
    Wang, Bingwen
    Mu, Hua
    Wang, Yangyang
    [J]. APPLIED SOFT COMPUTING, 2024, 162
  • [7] Lund jet images from generative and cycle-consistent adversarial networks
    Carrazza, Stefano
    Dreyer, Frederic A.
    [J]. EUROPEAN PHYSICAL JOURNAL C, 2019, 79 (11):
  • [8] Normalization of breast MRIs using cycle-consistent generative adversarial networks
    Modanwal, Gourav
    Vellal, Adithya
    Mazurowski, Maciej A.
    [J]. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2021, 208
  • [9] Lund jet images from generative and cycle-consistent adversarial networks
    Stefano Carrazza
    Frédéric A. Dreyer
    [J]. The European Physical Journal C, 2019, 79
  • [10] Unsupervised cycle-consistent deformation for shape matching
    Groueix, Thibault
    Fisher, Matthew
    Kim, Vladimir G.
    Russell, Bryan C.
    Aubry, Mathieu
    [J]. COMPUTER GRAPHICS FORUM, 2019, 38 (05) : 123 - 133