Brain-inspired automated visual object discovery and detection

被引:5
|
作者
Chen, Lichao [1 ]
Singh, Sudhir [1 ]
Kailath, Thomas [2 ]
Roychowdhury, Vwani [1 ]
机构
[1] Univ Calif Los Angeles, Dept Elect & Comp Engn, Los Angeles, CA 90095 USA
[2] Stanford Univ, Dept Elect Engn, Stanford, CA 94305 USA
关键词
computer vision; brain-inspired learning; brain-inspired object models; machine learning; brain memory models; REPRESENTATION;
D O I
10.1073/pnas.1802103115
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Despite significant recent progress, machine vision systems lag considerably behind their biological counterparts in performance, scalability, and robustness. A distinctive hallmark of the brain is its ability to automatically discover and model objects, at multiscale resolutions, from repeated exposures to unlabeled contextual data and then to be able to robustly detect the learned objects under various nonideal circumstances, such as partial occlusion and different view angles. Replication of such capabilities in a machine would require three key ingredients: (i) access to large-scale perceptual data of the kind that humans experience, (ii) flexible representations of objects, and (iii) an efficient unsupervised learning algorithm. The Internet fortunately provides unprecedented access to vast amounts of visual data. This paper leverages the availability of such data to develop a scalable framework for unsupervised learning of object prototypes-brain-inspired flexible, scale, and shift invariant representations of deformable objects (e.g., humans, motorcycles, cars, airplanes) comprised of parts, their different configurations and views, and their spatial relationships. Computationally, the object prototypes are represented as geometric associative networks using probabilistic constructs such as Markov random fields. We apply our framework to various datasets and show that our approach is computationally scalable and can construct accurate and operational part-aware object models much more efficiently than in much of the recent computer vision literature. We also present efficient algorithms for detection and localization in new scenes of objects and their partial views.
引用
收藏
页码:96 / 105
页数:10
相关论文
共 50 条
  • [1] Brain-inspired models for visual object recognition: an overview
    Yang, Xi
    Yan, Jie
    Wang, Wen
    Li, Shaoyi
    Hu, Bo
    Lin, Jian
    ARTIFICIAL INTELLIGENCE REVIEW, 2022, 55 (07) : 5263 - 5311
  • [2] Brain-inspired models for visual object recognition: an overview
    Xi Yang
    Jie Yan
    Wen Wang
    Shaoyi Li
    Bo Hu
    Jian Lin
    Artificial Intelligence Review, 2022, 55 (7) : 5263 - 5311
  • [3] Brain-Inspired Obstacle Detection Based on the Biological Visual Pathway
    Zeng, Yi
    Zhao, Feifei
    Wang, Guixiang
    Zhang, Lingyu
    Xu, Bo
    BRAIN INFORMATICS AND HEALTH, 2016, 9919 : 355 - 364
  • [4] A brain-inspired object-based attention network for multiobject recognition and visual reasoning
    Adeli, Hossein
    Ahn, Seoyoung
    Zelinsky, Gregory J.
    JOURNAL OF VISION, 2023, 23 (05):
  • [5] COSFIRE: A Brain-Inspired Approach to Visual Pattern Recognition
    Azzopardi, George
    Petkov, Nicolai
    BRAIN-INSPIRED COMPUTING, 2014, 8603 : 76 - 87
  • [6] The brain-inspired decoder for natural visual image reconstruction
    Li, Wenyi
    Zheng, Shengjie
    Liao, Yufan
    Hong, Rongqi
    He, Chenggang
    Chen, Weiliang
    Deng, Chunshan
    Li, Xiaojian
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [7] HDXplore: Automated Blackbox Testing of Brain-Inspired Hyperdimensional Computing
    Thapa, Rahul
    Ma, Dongning
    Jiao, Xun
    2021 IEEE COMPUTER SOCIETY ANNUAL SYMPOSIUM ON VLSI (ISVLSI 2021), 2021, : 90 - 95
  • [8] Brain-Inspired CIRA-DETR Full Inference Model for Small and Occluded Object Detection
    Ning X.
    Tian W.-J.
    Yu L.-N.
    Li W.-J.
    Jisuanji Xuebao/Chinese Journal of Computers, 2022, 45 (10): : 2080 - 2092
  • [9] Brain-inspired stochasticity
    Charlotte Allard
    Nature Reviews Materials, 2022, 7 : 426 - 426
  • [10] Brain-inspired computing
    Furber, Steve B.
    IET COMPUTERS AND DIGITAL TECHNIQUES, 2016, 10 (06): : 299 - 305