Relational Similarity Measurement Between Word-pairs using Multi-Task Lasso

被引:0
|
作者
Yan, Dongbin [1 ]
Lu, Zhao [1 ]
机构
[1] E China Normal Univ, Dept Comp Sci & Technol, Shanghai 200241, Peoples R China
关键词
Relational similarity; multi-task learning; Lasso;
D O I
10.1109/CSC.2012.35
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Relational similarity measurement as a popular research area in the field of natural language processing, is widely used in information retrieval, word sense disambiguation, machine translation and so on. The existing approaches are mostly based on extracting semantic features as feature matrixes from the large-scale corpus and using the corresponding method to process these feature matrixes to compute the relational similarity between word-pairs. However, the extracted semantic features are loosely distributed, which make the sparseness of feature matrixes. This paper proposes a Multi-Task Lasso based Relational similarity measure method (MTLRel), which makes snippets retrieved from a web search engine as the semantic information sources of a word-pair, then builds the feature matrix by extracting predefined patterns from snippets, compress and denoise the feature matrix into a feature vector using a multi-task lasso method, finally measures the relational similarity between two word-pairs by computing the cosine of the angle between two feature vectors. The MTLRel approach achieves an accuracy rate of 50.3% by testing 374 SAT analogy questions with lower time consumption.
引用
收藏
页码:180 / 184
页数:5
相关论文
共 50 条
  • [41] Multi-Task Learning Using Shared and Task Specific Information
    Srijith, P. K.
    Shevade, Shirish
    NEURAL INFORMATION PROCESSING, ICONIP 2012, PT III, 2012, 7665 : 125 - 132
  • [42] Multi-task Regression using Minimal Penalties
    Solnon, Matthieu
    Arlot, Sylvain
    Bach, Francis
    JOURNAL OF MACHINE LEARNING RESEARCH, 2012, 13 : 2773 - 2812
  • [43] Multi-Task Learning Using BERT With Soft Parameter Sharing Between Layers
    Pahari, Niraj
    Shimada, Kazutaka
    2022 JOINT 12TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS AND 23RD INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (SCIS&ISIS), 2022,
  • [44] TIMME: Twitter Ideology-detection via Multi-task Multi-relational Embedding
    Xiao, Zhiping
    Song, Weiping
    Xu, Haoyan
    Ren, Zhicheng
    Sun, Yizhou
    KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 2258 - 2268
  • [45] Multi-Relational Graph based Heterogeneous Multi-Task Learning in Community Question Answering
    Lin, Zizheng
    Ke, Haowen
    Wong, Ngo-Yin
    Bai, Jiaxin
    Song, Yangqiu
    Zhao, Huan
    Ye, Junpeng
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 1038 - 1047
  • [46] MULTI-TASK LEARNING OF DEPTH FROM TELE AND WIDE STEREO IMAGE PAIRS
    El-Khamy, Mostafa
    Du, Xianzhi
    Ren, Haoyu
    Lee, Jungwon
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 4300 - 4304
  • [47] Learning twofold heterogeneous multi-task by sharing similar convolution kernel pairs
    Feng, Quan
    Yao, JiaYu
    Zhong, Yingyu
    Li, Ping
    Pan, Zhisong
    KNOWLEDGE-BASED SYSTEMS, 2022, 252
  • [48] An Inexact Semismooth Newton-Based Augmented Lagrangian Algorithm for Multi-Task Lasso Problems
    Lin, Lanyu
    Liu, Yong-Jin
    ASIA-PACIFIC JOURNAL OF OPERATIONAL RESEARCH, 2024, 41 (03)
  • [49] IMPROVING LANGUAGE MODELING BY USING DISTANCE AND CO-OCCURRENCE INFORMATION OF WORD-PAIRS AND ITS APPLICATION TO LVCSR
    Chong, Tze Yuang
    Banchs, Rafael E.
    Chng, Eng Siong
    Li, Haizhou
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [50] Multi-task incentive contract and performance measurement with multidimensional types
    Meng, Dawen
    Tian, Guoqiang
    GAMES AND ECONOMIC BEHAVIOR, 2013, 77 (01) : 377 - 404