Summary in Action: A Trade-off between Effectiveness and Efficiency in Multidimensional Relevance Estimation

In domain-specific search, effectiveness depends on considering multiple dimensions of relevance, beyond topicality, related to the domain involved. Estimating additional relevance dimensions can affect efficiency because the computation of relevance scores is time-consuming if performed on the full document, especially for query-dependent dimensions. Hence, this article introduces an approach for improving effectiveness in domain-specific search by considering multiple dimensions of relevance, namely topicality, correctness, and credibility. To address efficiency, we propose a re-ranking approach that estimates domain-specific relevance scores on document summaries, rather than full documents. We validate the proposed solution by performing the AdHoc Retrieval task from the TREC 2020 Health Misinformation Track, a domain that crucially relies on the considered relevance dimensions. Our findings underscore the potential of our approach with respect to both effectiveness and efficiency.