Rapid 3D imaging at cellular resolution for digital cytopathology with a multi-camera array scanner (MCAS)

被引:0
|
作者
Kanghyun Kim [1 ]
Amey Chaware [1 ]
Clare B. Cook [1 ]
Shiqi Xu [1 ]
Monica Abdelmalak [2 ]
Colin Cooke [3 ]
Kevin C. Zhou [1 ]
Mark Harfouche [4 ]
Paul Reamey [5 ]
Veton Saliu [5 ]
Jed Doman [5 ]
Clay Dugo [5 ]
Gregor Horstmeyer [5 ]
Richard Davis [5 ]
Ian Taylor-Cho [2 ]
Wen-Chi Foo [2 ]
Lucas Kreiss [2 ]
Xiaoyin Sara Jiang [1 ]
Roarke Horstmeyer [2 ]
机构
[1] Duke University,Department of Biomedical Engineering
[2] Duke University Medical Center,Department of Pathology
[3] Duke University,Department of Electrical and Computer Engineering
[4] University of California Berkeley,Department of Electrical Engineering and Computer Science
[5] Ramona Optics Inc.,undefined
来源
npj Imaging | / 2卷 / 1期
关键词
D O I
10.1038/s44303-024-00042-2
中图分类号
学科分类号
摘要
Optical microscopy has long been the standard method for diagnosis in cytopathology. Whole slide scanners can image and digitize large sample areas automatically, but are slow, expensive and therefore not widely available. Clinical diagnosis of cytology specimens is especially challenging since these samples are both spread over large areas and thick, which requires 3D capture. Here, we introduce a new parallelized microscope for scanning thick specimens across extremely wide fields-of-view (54 × 72 mm2) at 1.2 and 0.6 μm resolutions, accompanied by machine learning software to rapidly assess these 16 gigapixel scans. This Multi-Camera Array Scanner (MCAS) comprises 48 micro-cameras closely arranged to simultaneously image different areas. By capturing 624 megapixels per snapshot, the MCAS is significantly faster than most conventional whole-slide scanners. We used this system to digitize entire cytology samples (scanning three entire slides in 3D in just several minutes) and demonstrate two machine learning techniques to assist pathologists: first, an adenocarcinoma detection model in lung specimens (0.73 recall); second, a slide-level classification model of lung smears (0.969 AUC).
引用
收藏
相关论文
共 50 条
  • [31] Joint Camera Pose Estimation and 3D Human Pose Estimation in a Multi-camera Setup
    Puwein, Jens
    Ballan, Luca
    Ziegler, Remo
    Pollefeys, Marc
    COMPUTER VISION - ACCV 2014, PT II, 2015, 9004 : 473 - 487
  • [32] Multi-camera based full-field 3D displacement measurement using digital image correlation
    Hu, Tianci
    Ma, Lei
    Jiang, Dong
    Fei, Qingguo
    2020 13TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID 2020), 2020, : 164 - 167
  • [33] Evaluating the Fuzzy Coverage Model for 3D Multi-camera Network Applications
    Mavrinac, Aaron
    Herrera, Jose Luis Alarcon
    Chen, Xiang
    INTELLIGENT ROBOTICS AND APPLICATIONS, PT I, 2010, 6424 : 692 - 701
  • [34] 3D SHAPE FROM MULTI-CAMERA VIEWS BY ERROR PROJECTION MINIMIZATION
    Haro, Gloria
    Pardas, Montse
    2009 10TH INTERNATIONAL WORKSHOP ON IMAGE ANALYSIS FOR MULTIMEDIA INTERACTIVE SERVICES, 2009, : 250 - +
  • [35] Multi-camera Photometric Simulation for Creation of 3D Object Reconstruction System
    Sobel, Dawid
    Jedrasiak, Karol
    Nawrat, Aleksander
    COMPUTER VISION AND GRAPHICS ( ICCVG 2018), 2018, 11114 : 187 - 198
  • [36] A Hybrid Optimization Approach for 3D Multi-Camera Human Pose Estimation
    Eguchi, Masatoshi
    Obo, Takenori
    Kubota, Naoyuki
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2024, 28 (06) : 1344 - 1353
  • [37] Multi-Camera Multiple 3D Object Tracking on the Move for Autonomous Vehicles
    Pha Nguyen
    Kha Gia Quach
    Chi Nhan Duong
    Ngan Le
    Xuan-Bac Nguyen
    Khoa Luu
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 2568 - 2577
  • [38] Multi-Camera 3D Position Estimation using Conditional Random Field
    Matsuda, Shusuke
    Techasarntikul, Nattaon
    Shimonishi, Hideyuki
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 1900 - 1908
  • [39] A Multi-Camera 3D Human Geometric Reconstruction Approach for Anthropometrical Representation
    Ong, Alex
    Quah, Chee Kwang
    Koh, Michael
    PROCEEDINGS OF FIRST JOINT INTERNATIONAL PRE-OLYMPIC CONFERENCE OF SPORTS SCIENCE AND SPORTS ENGINEERING, VOL I: COMPUTER SCIENCE IN SPORTS, 2008, : 339 - 343
  • [40] Multi-camera Finger Tracking and 3D Trajectory Reconstruction for HCI Studies
    Lyubanenko, Vadim
    Kuronen, Toni
    Eerola, Tuomas
    Lensu, Lasse
    Kalviainen, Heikki
    Hakkinen, Jukka
    ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS (ACIVS 2017), 2017, 10617 : 63 - 74