Exploit parallelism in intersecting compressed bit vectors for inverted file organization

被引:0
|
作者
Yang, WJ [1 ]
Sridhar, R [1 ]
机构
[1] SUNY Buffalo, Ctr Excellence Document Anal & Recognit, Buffalo, NY 14260 USA
关键词
inverted file organization; parallel architecture; compressed bit vector;
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The inverted file organization has been applied to information retrieval and secondary-key access. rn this organization, inverted lists are used to locate data record which contain corresponding attribute values. With the use of compression, retrieval time and storage requirement for inverted lists can be reduced However, this increases the CPU load. Moreover: the query processing cost on large database is dominated by the intersection of inverted lists. This paper exploits the parallelism for intersecting compressed inverted lists, and proposes a parallel architecture to expand the compressed inverted lists, intersect the inverted lists in parallel, and pipeline the expansion and intersection operations in two stages. This parallel architecture can be accomplished by the current VLSI technology to release CPU load. This architecture can be applied to generate multiple-attribute lexicon for interpreting hand-written addresses. The simulation result of the parallel architecture shows that the speed of intersecting compressed inverted lists can be at least 160 times faster than that by the traditional implementation.
引用
收藏
页码:1429 / 1433
页数:5
相关论文
共 9 条
  • [1] Parallel intersecting compressed bit vectors in a high speed query server for processing postal addresses
    Yang, WJ
    Sridhar, R
    Demjanenko, V
    SECOND INTERNATIONAL SYMPOSIUM ON HIGH-PERFORMANCE COMPUTER ARCHITECTURE, PROCEEDINGS, 1996, : 232 - 241
  • [2] HOLOGRAPHIC IRS WITH INVERTED FILE-ORGANIZATION
    ZAHARCENKO, VM
    NAUCHNO-TEKHNICHESKAYA INFORMATSIYA SERIYA 2-INFORMATSIONNYE PROTSESSY I SISTEMY, 1980, (01): : 3 - 11
  • [3] ParaFS: A Log-Structured File System to Exploit the Internal Parallelism of Flash Devices
    Zhang, Jiacheng
    Shu, Jiwu
    Lu, Youyou
    PROCEEDINGS OF USENIX ATC '16: 2016 USENIX ANNUAL TECHNICAL CONFERENCE, 2016, : 87 - 100
  • [4] Compressed Bit vectors Based on Variable-to-Fixed Encodings
    Jo, Seungbum
    Joannou, Stelios
    Okanohara, Daisuke
    Raman, Rajeev
    Satti, Srinivasa Rao
    COMPUTER JOURNAL, 2017, 60 (05): : 761 - 775
  • [5] Compressed bit vectors based on variable-to-fixed encodings
    Jo, Seungbum
    Joannou, Stelios
    Okanohara, Daisuke
    Raman, Rajeev
    Satti, Srinivasa Rao
    2014 DATA COMPRESSION CONFERENCE (DCC 2014), 2014, : 409 - 409
  • [6] High-Order Entropy Compressed Bit Vectors with Rank/Select
    Beskers, Kai
    Fischer, Johannes
    ALGORITHMS, 2014, 7 (04) : 608 - 620
  • [8] Hiding of Compressed Bit Stream into Audio File to Enhance the Confidentiality and Portability of a Data Transmission System
    Bhattacharjee, Shiladitya
    Bin Ab Rahim, Lukman
    Aziz, Izatdin B. A.
    2015 INTERNATIONAL SYMPOSIUM ON MATHEMATICAL SCIENCES AND COMPUTING RESEARCH (ISMSC), 2015, : 196 - 201
  • [9] Synthesis and Realization of N-bit Reversible Register File Used in Bus Organization of Processor Architecture
    Majumder, A.
    Singh, P. L.
    Chowdhury, B.
    Rai, R.
    3RD INTERNATIONAL CONFERENCE ON RECENT TRENDS IN COMPUTING 2015 (ICRTC-2015), 2015, 57 : 305 - 312