A data-efficient self-supervised deep learning model for design and characterization of nanophotonic structures

被引:0
|
作者
Wei Ma
Yongmin Liu
机构
[1] Zhejiang University,College of Information Science and Electronic Engineering
[2] Northeastern University,Department of Mechanical and Industrial Engineering
[3] Northeastern University,Department of Electrical and Computer Engineering
关键词
nanophotonics; metasurfaces; self-supervised; deep learning;
D O I
暂无
中图分类号
学科分类号
摘要
With its tremendous success in many machine learning and pattern recognition tasks, deep learning, as one type of data-driven models, has also led to many breakthroughs in other disciplines including physics, chemistry and material science. Nevertheless, the supremacy of deep learning over conventional optimization approaches heavily depends on the huge amount of data collected in advance to train the model, which is a common bottleneck of such a data-driven technique. In this work, we present a comprehensive deep learning model for the design and characterization of nanophotonic structures, where a self-supervised learning mechanism is introduced to alleviate the burden of data acquisition. Taking reflective metasurfaces as an example, we demonstrate that the self-supervised deep learning model can effectively utilize randomly generated unlabeled data during training, with the total test loss and prediction accuracy improved by about 15% compared with the fully supervised counterpart. The proposed self-supervised learning scheme provides an efficient solution for deep learning models in some physics-related tasks where labeled data are limited or expensive to collect.
引用
收藏
相关论文
共 50 条
  • [1] A data-efficient self-supervised deep learning model for design and characterization of nanophotonic structures
    Ma, Wei
    Liu, Yongmin
    [J]. SCIENCE CHINA-PHYSICS MECHANICS & ASTRONOMY, 2020, 63 (08):
  • [2] A data-efficient self-supervised deep learning model for design and characterization of nanophotonic structures
    Wei Ma
    Yongmin Liu
    [J]. Science China(Physics,Mechanics & Astronomy), 2020, (08) : 27 - 34
  • [3] A self-supervised deep learning method for data-efficient training in genomics
    Hüseyin Anil Gündüz
    Martin Binder
    Xiao-Yin To
    René Mreches
    Bernd Bischl
    Alice C. McHardy
    Philipp C. Münch
    Mina Rezaei
    [J]. Communications Biology, 6
  • [4] A self-supervised deep learning method for data-efficient training in genomics
    Guenduez, Hueseyin Anil
    Binder, Martin
    To, Xiao-Yin
    Mreches, Rene
    Bischl, Bernd
    McHardy, Alice C.
    Muench, Philipp C.
    Rezaei, Mina
    [J]. COMMUNICATIONS BIOLOGY, 2023, 6 (01)
  • [5] Self-Supervised Learning With Data-Efficient Supervised Fine-Tuning for Crowd Counting
    Wang, Rui
    Hao, Yixue
    Hu, Long
    Chen, Jincai
    Chen, Min
    Wu, Di
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1538 - 1546
  • [6] Robust and data-efficient generalization of self-supervised machine learning for diagnostic imaging
    Azizi, Shekoofeh
    Culp, Laura
    Freyberg, Jan
    Mustafa, Basil
    Baur, Sebastien
    Kornblith, Simon
    Chen, Ting
    Tomasev, Nenad
    Mitrovic, Jovana
    Strachan, Patricia
    Mahdavi, S. Sara
    Wulczyn, Ellery
    Babenko, Boris
    Walker, Megan
    Loh, Aaron
    Chen, Po-Hsuan Cameron
    Liu, Yuan
    Bavishi, Pinal
    McKinney, Scott Mayer
    Winkens, Jim
    Roy, Abhijit Guha
    Beaver, Zach
    Ryan, Fiona
    Krogue, Justin
    Etemadi, Mozziyar
    Telang, Umesh
    Liu, Yun
    Peng, Lily
    Corrado, Greg S.
    Webster, Dale R.
    Fleet, David
    Hinton, Geoffrey
    Houlsby, Neil
    Karthikesalingam, Alan
    Norouzi, Mohammad
    Natarajan, Vivek
    [J]. NATURE BIOMEDICAL ENGINEERING, 2023, 7 (06) : 756 - +
  • [7] Robust and data-efficient generalization of self-supervised machine learning for diagnostic imaging
    Shekoofeh Azizi
    Laura Culp
    Jan Freyberg
    Basil Mustafa
    Sebastien Baur
    Simon Kornblith
    Ting Chen
    Nenad Tomasev
    Jovana Mitrović
    Patricia Strachan
    S. Sara Mahdavi
    Ellery Wulczyn
    Boris Babenko
    Megan Walker
    Aaron Loh
    Po-Hsuan Cameron Chen
    Yuan Liu
    Pinal Bavishi
    Scott Mayer McKinney
    Jim Winkens
    Abhijit Guha Roy
    Zach Beaver
    Fiona Ryan
    Justin Krogue
    Mozziyar Etemadi
    Umesh Telang
    Yun Liu
    Lily Peng
    Greg S. Corrado
    Dale R. Webster
    David Fleet
    Geoffrey Hinton
    Neil Houlsby
    Alan Karthikesalingam
    Mohammad Norouzi
    Vivek Natarajan
    [J]. Nature Biomedical Engineering, 2023, 7 (6) : 756 - 779
  • [8] Data-Efficient Masked Video Modeling for Self-supervised Action Recognition
    Li, Qiankun
    Huang, Xiaolong
    Wan, Zhifan
    Hu, Lanqing
    Wu, Shuzhe
    Zhang, Jie
    Shan, Shiguang
    Wang, Zengfu
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 2723 - 2733
  • [9] Primitive-contrastive network: data-efficient self-supervised learning from robot demonstration videos
    Pengfei Sun
    Zhile Yang
    Tianren Zhang
    Shangqi Guo
    Feng Chen
    [J]. Applied Intelligence, 2022, 52 : 4258 - 4273
  • [10] Primitive-contrastive network: data-efficient self-supervised learning from robot demonstration videos
    Sun, Pengfei
    Yang, Zhile
    Zhang, Tianren
    Guo, Shangqi
    Chen, Feng
    [J]. APPLIED INTELLIGENCE, 2022, 52 (04) : 4258 - 4273