Computer-assisted visual InterActive recognition and its prospects of implementation over the Internet

被引:0
|
作者
Zou, J [1 ]
Gattani, A [1 ]
机构
[1] Rensselaer Polytech Inst, Dept Elect Comp & Syst Engn, Troy, NY 12181 USA
来源
INTERNET IMAGING VI | 2005年 / 5670卷
关键词
visual pattern recognition; human computer interaction; flower recognition; mobile; Internet; open mind; image based interaction; interactive segmentation; shape model; image retrieval;
D O I
10.1117/12.585112
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
When completely automated systems don't yield acceptable accuracy, Many practical pattern recognition systems involve the human either at the beginning (pre-processing) or towards the end (handling rejects). We believe that it may be more useful to involve the human throughout the recognition process rather than just at the beginning or end. We describe a methodology of interactive visual recognition for human-centered low-throughput applications, Computer Assisted Visual InterActive Recognition (CAVIAR), and discuss the prospects of implementing CAVIAR over the Internet. The novelty of CAVIAR is image-based interaction through a domain-specific parameterized geometrical model, which reduces the semantic gap between humans and computers. The user may interact with the computer anytime that she considers its response unsatisfactory. The interaction improves the accuracy of the classification features by improving the fit of the computer-proposed model. The computer makes subsequent use of the parameters of the improved model to refine not only its own statistical model-fitting process, but also its internal classifier. The CAVIAR methodology was applied to implement a flower recognition system. The principal conclusions from the evaluation of the system include: 1) the average recognition time of the CAVIAR system is significantly shorter than that of the unaided human, 2) its accuracy is significantly higher than that of the unaided machine; 3) it can be initialized with as few as one training sample per class and still achieve high accuracy; and 4) it demonstrates a self-learning ability. We have also implemented a Mobile CAVIAR system, where a pocket PC, as a client, connects to a server through wireless communication. The motivation behind a mobile platform for CAVIAR is to apply the methodology in a human-centered pervasive environment, where the user can seamlessly interact with the system for classifying field-data. Deploying CAVIAR to a networked mobile platform poses the challenge of classifying field images and programming under constraints of display size, network bandwidth, processor speed, and memory size. Editing of the computer-proposed model is performed on the handheld while statistical model fitting and classification take place on the server. The possibility that the user can easily take several photos of the object poses an interesting information fusion problem. The advantage of the Internet is that the patterns identified by different users can be pooled together to benefit all peer users. When users identify patterns with CAVIAR in a networked setting, they also collect training samples and provide opportunities for machine learning from their intervention. CAVIAR implemented over the Internet provides a perfect test bed for, and extends, the concept of Open Mind Initiative proposed by David Stork. Our experimental evaluation focuses on human time, machine and human accuracy, and machine learning. We devoted much effort to evaluating the use of our image-based user interface and on developing principles for the evaluation of interactive pattern recognition system. The Internet architecture and Mobile CAVIAR methodology have many applications. We are exploring in the directions of teledermatology, face recognition, and education.
引用
收藏
页码:76 / 87
页数:12
相关论文
共 50 条
  • [1] Implementation of an interactive computer-assisted infection monitoring program at the bedside
    Heininger, A
    Niemetz, AH
    Keim, M
    Fretschner, R
    Döring, G
    Unertl, K
    [J]. INFECTION CONTROL AND HOSPITAL EPIDEMIOLOGY, 1999, 20 (06): : 444 - 447
  • [2] Computer assisted visual interactive recognition (CAVIAR) technology
    Evans, Arthur
    Sikorski, John
    Thomas, Patricia
    Cha, Sung-Hyuk
    Tappert, Charles
    Zou, Jie
    Gattani, Abhishek
    Nagy, George
    [J]. 2005 IEEE INTERNATIONAL CONFERENCE ON ELECTRO/INFORMATION TECHNOLOGY (EIT 2005), 2005, : 470 - 475
  • [3] INTERACTIVE COMPUTER-ASSISTED INSTRUCTION
    BROOKS, DW
    BROOKS, HB
    [J]. ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 1989, 197 : 145 - CHED
  • [4] IMPLEMENTATION OF INTERACTIVE AND COLLABORATIVE COMPUTER-ASSISTED LEARNING IN AUTOMOTIVE ENGINEERING EDUCATION
    Alic, Carmen Inge
    Miklos, Imre Zsolt
    Miklos, Cristina Carmen
    Mihon, Liviu
    [J]. ANNALS OF DAAAM FOR 2009 & PROCEEDINGS OF THE 20TH INTERNATIONAL DAAAM SYMPOSIUM, 2009, 20 : 255 - 256
  • [5] IMPLEMENTATION OF COMPUTER-ASSISTED UNDERWRITING
    JOHNSON, JW
    [J]. INTERFACES, 1976, 6 (02) : 2 - 13
  • [6] COMPUTER-ASSISTED COUNSELING - PROBLEMS AND PROSPECTS
    WAGMAN, M
    KERBER, KW
    [J]. COUNSELOR EDUCATION AND SUPERVISION, 1984, 24 (02) : 142 - 154
  • [7] The effectiveness of computer-assisted interactive glosses
    Nagata, N
    [J]. FOREIGN LANGUAGE ANNALS, 1999, 32 (04) : 469 - 479
  • [8] Computer-Assisted Authoring of Interactive Narratives
    Kapadia, Mubbasir
    Falk, Jessica
    Zund, Fabio
    Marti, Marcel
    Sumner, Robert W.
    Gross, Markus
    [J]. PROCEEDINGS - I3D 2015, 2015, : 85 - 92
  • [9] INTERACTIVE DIGITIZING FOR COMPUTER-ASSISTED CARTOGRAPHY
    BRACKEN, I
    SPOONER, R
    [J]. AREA, 1985, 17 (03) : 205 - 212
  • [10] COMPUTER-ASSISTED ANALYSIS OF VISUAL PIGMENTS
    MUNZ, FW
    ALLEN, DM
    [J]. VISION RESEARCH, 1968, 8 (08) : 983 - &