The Art of the Masses: Overviews on the Collective Visual Heritage through Convolutional Neural Networks

被引:1
|
作者
Rosado-Rodrigo, Pilar [1 ]
Reverter, Ferran [2 ]
机构
[1] Univ Barcelona, Dept Arts & Conservat Restorat, Barcelona 08028, Spain
[2] Univ Barcelona, Dept Genet Microbiol & Stat, Barcelona 08028, Spain
关键词
deep learning; post-photography; computer vision; t-SNE; convolutional neural networks (CNNs); Aby Warburg;
D O I
10.3390/bdcc7010033
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the context of a society saturated in images, convolutional neural networks (CNNs), pre-trained using from the visual information contained in many thousands of images, constitute a tool that is of great use in helping us to organize the visual heritage, thus offering a route of entry that would otherwise be impossible. One of the responsibilities of the contemporary artist is to adopt a position that will help to provide sense, to project meaning onto the accumulation of images that we are faced with. The artificial neuronal network ResNet-50 has been used in order to extract the visual characteristics of large sets of images from the internet. Textual searches have been carried out on social issues such as climate change, the COVID-19 pandemic, demonstrations around the world, and manifestations of popular culture, and the image descriptors obtained have been the input for the algorithm t-SNE. In this way, we produce large visual maps composed of thousands of images and arranged following the criteria of formal similitude, displaying the visual patterns of the archetypes of specific semantic categories. The method of filing and recovering our collective memory must have a correlation with the technological and scientific advances of our time, in order for us to progressively discover new horizons of knowledge.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] Panoramic views on the collective visual heritage through convolutional neural networks. The exhibitions Revolutionary Arkive and Mnemosyne 2.0 by Pilar Rosado
    Rosado Rodrigo, Pilar
    Reverter Comes, Ferran
    [J]. ARTNODES, 2020, (26): : 1 - 12
  • [2] Detecting visual design principles in art and architecture through deep convolutional neural networks
    Demir, Gozdenur
    Cekmis, Asli
    Yesilkaynak, Vahit Bugra
    Unal, Gozde
    [J]. AUTOMATION IN CONSTRUCTION, 2021, 130
  • [3] Using Principal Paths to Walk Through Music and Visual Art Style Spaces Induced by Convolutional Neural Networks
    E. Gardini
    M. J. Ferrarotti
    A. Cavalli
    S. Decherchi
    [J]. Cognitive Computation, 2021, 13 : 570 - 582
  • [4] Using Principal Paths to Walk Through Music and Visual Art Style Spaces Induced by Convolutional Neural Networks
    Gardini, E.
    Ferrarotti, M. J.
    Cavalli, A.
    Decherchi, S.
    [J]. COGNITIVE COMPUTATION, 2021, 13 (02) : 570 - 582
  • [5] Evaluation of convolutional neural networks for visual recognition
    Neubauer, C
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1998, 9 (04): : 685 - 696
  • [6] Finetuning Convolutional Neural Networks for Visual Aesthetics
    Wang, Yeqing
    Li, Yi
    Porikli, Fatih
    [J]. 2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 3554 - 3559
  • [7] How Convolutional Neural Networks Remember Art
    Cetinic, Eva
    Lipic, Tomislav
    Grgic, Sonja
    [J]. 2018 25TH INTERNATIONAL CONFERENCE ON SYSTEMS, SIGNALS AND IMAGE PROCESSING (IWSSIP), 2018,
  • [8] GraphInception: Convolutional Neural Networks for Collective Classification in Heterogeneous Information Networks
    Xiong, Yun
    Zhang, Yizhou
    Kong, Xiangnan
    Chen, Huidi
    Zhu, Yangyong
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2021, 33 (05) : 1960 - 1972
  • [9] DEEP CONVOLUTIONAL NEURAL NETWORKS FOR SENTIMENT ANALYSIS OF CULTURAL HERITAGE
    Paolanti, M.
    Pierdicca, R.
    Martini, M.
    Felicetti, A.
    Malinverni, E. S.
    Frontoni, E.
    Zingaretti, P.
    [J]. 27TH CIPA INTERNATIONAL SYMPOSIUM: DOCUMENTING THE PAST FOR A BETTER FUTURE, 2019, 42-2 (W15): : 871 - 878
  • [10] Alzheimer's Disease Evaluation Through Visual Explainability by Means of Convolutional Neural Networks
    Mercaldo, Francesco
    Di Giammarco, Marcello
    Ravelli, Fabrizio
    Martinelli, Fabio
    Santone, Antonella
    Cesarelli, Mario
    [J]. INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2024, 34 (02)