Social Relation Trait Discovery from Visual LifeLog Data with Facial Multi-Attribute Framework

被引:3
|
作者
Tung Duy Dinh [1 ,2 ]
Hieu Dinh Nguyen [1 ]
Minh-Triet Tran [1 ,2 ]
机构
[1] Univ Sci VNU HCM, Fac Informat Technol, Ho Chi Minh City, Vietnam
[2] Univ Sci VNU HCM, Software Engn Dept, Ho Chi Minh City, Vietnam
来源
PROCEEDINGS OF THE 7TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION APPLICATIONS AND METHODS (ICPRAM 2018) | 2018年
关键词
Social Relation Trait; Visual LifeLog Data; Facial Multi-Attribute Framework;
D O I
10.5220/0006749206650674
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Social relation defines the status of interactions among individuals or groups. Although people's happiness is significantly affected by the quality of social relationships, there are few studies focusing on this aspect. This motivates us to propose a method to discover potential social relation traits, the interpersonal feelings between two people, from visual lifelog data to improve the status of our relationships. We propose Facial Multi-Attribute Framework (FMAF), a flexible network that can embed different sets of multiple pre-trained Facial Single-Attribute Networks to capture various facial features such as head pose, expression, age, and gender for social trait evaluation. We adopt the architecture of Inception-Resnet-V2 to each single attribute component to utilize the flexibility of Inception model and avoid the degradation problem with the residual module. We use a Siamese network with two FMAFs to evaluate social relation traits for two main persons in an image. Our experiment on the social relation trait dataset by Zhangpeng Zhang et. al shows that our method achieves the accuracy of 77.30%, which is 4.10% higher than the state-of-the-art result (73.20%). We also develop a prototype system integrated into Facebook to analyse and visualize the chronological changes in social traits between a user with friends in daily lives via uploaded photos and video clips.
引用
收藏
页码:665 / 674
页数:10
相关论文
共 35 条
  • [21] EMOTION RECOGNITION: EMPIRICAL STUDIES TOWARDS THE COMBINATION OF AUDIO-LINGUAL AND VISUAL-FACIAL MODALITIES THROUGH MULTI-ATTRIBUTE DECISION MAKING
    Virvou, M.
    Tsihrintzis, G. A.
    Alepis, E.
    Stathopoulou, I. -O.
    Kabassi, K.
    INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2012, 21 (02)
  • [22] Travel User Interest Discovery from Visual Shared Data in Social Networks
    Yassin, Fatima Mohamed
    Lazzez, Onsa
    Ouarda, Wael
    Alimi, Adel M.
    PROCEEDINGS OF 2017 SUDAN CONFERENCE ON COMPUTER SCIENCE AND INFORMATION TECHNOLOGY (SCCSIT), 2017, : 58 - 64
  • [23] Sparse-Group Lasso for Graph Learning From Multi-Attribute Data (vol 69, pg 1771, 2021)
    Tugnait, Jitendra
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2021, 69 : 4758 - 4758
  • [24] Multi-attribute k-means clustering for salt-boundary delineation from three-dimensional seismic data
    Di, Haibin
    Shafiq, Muhammad
    AlRegib, Ghassan
    GEOPHYSICAL JOURNAL INTERNATIONAL, 2018, 215 (03) : 1999 - 2007
  • [25] Providing a Framework for Evaluating the Quality of Health Care Services Using the HealthQual Model and Multi-Attribute Decision-Making Under Imperfect Knowledge of Data
    Estiri, Mehrdad
    Dahooie, Jalil Heidary
    Zavadskas, Edmundas Kazimieras
    INFORMATICA, 2023, 34 (01) : 85 - 120
  • [26] Distributed Multi-authority Attribute-Based Encryption for Secure Friend Discovery and Data Sharing in Mobile Social Networks
    Qi, Fang
    Wang, Wenbo
    Tang, Zhe
    SECURITY, PRIVACY, AND ANONYMITY IN COMPUTATION, COMMUNICATION, AND STORAGE, 2016, 10066 : 374 - 382
  • [27] CrystalBall: A Visual Analytic System for Future Event Discovery and Analysis from Social Media Data
    Cho, Isaac
    Wesslen, Ryan
    Volkova, Svitlana
    Ribarsky, William
    Dou, Wenwen
    2017 IEEE CONFERENCE ON VISUAL ANALYTICS SCIENCE AND TECHNOLOGY (VAST), 2017, : 25 - 35
  • [28] The MODIS land cover product: Multi-attribute mapping of global vegetation and land cover properties from time series MODIS data
    Friedl, M
    Strahler, A
    Zhang, XY
    Hodges, J
    IGARSS 2002: IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM AND 24TH CANADIAN SYMPOSIUM ON REMOTE SENSING, VOLS I-VI, PROCEEDINGS: REMOTE SENSING: INTEGRATING OUR VIEW OF THE PLANET, 2002, : 3199 - 3201
  • [29] Multi-Screen Lock: Visual Passwords from User's Social Data
    Tsoukas, Vasileios
    Gkogkidis, Anargyros
    Kakarountas, Athanasios
    Giannakas, Georgios
    PROCEEDINGS OF THE 23RD PAN-HELLENIC CONFERENCE OF INFORMATICS (PCI 2019), 2019, : 90 - 95
  • [30] Deriving population norms for the AQoL-6D and AQoL-8D multi-attribute utility instruments from web-based data
    Maxwell, Aimee
    Ozmen, Mehmet
    Iezzi, Angelo
    Richardson, Jeff
    QUALITY OF LIFE RESEARCH, 2016, 25 (12) : 3209 - 3219