Neural Structured Learning: Training Neural Networks with Structured Signals

被引:8
|
作者
Gopalan, Arjun [1 ]
Juan, Da-Cheng [1 ]
Magalhaes, Cesar Ilharco [2 ]
Ferng, Chun-Sung [1 ]
Heydon, Allan [1 ]
Lu, Chun-Ta [1 ]
Pham, Philip [1 ]
Yu, George [1 ]
Fan, Yicheng [1 ]
Wang, Yueqi [1 ]
机构
[1] Google Res, Mountain View, CA 94043 USA
[2] Google Res, Zurich, Switzerland
关键词
Neural networks; Structured signals; Graph learning; Adversarial learning; Regularization; TensorFlow;
D O I
10.1145/3437963.3441666
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present Neural Structured Learning (NSL) in TensorFlow [1], a new learning paradigm to train neural networks by leveraging structured signals in addition to feature inputs. Structure can be explicit as represented by a graph, or implicit, either induced by adversarial perturbation or inferred using techniques like embedding learning. NSL is open-sourced as part of the TensorFlow [2] ecosystem and is widely used in Google across many products and services. In this tutorial, we provide an overview of the NSL framework including various libraries, tools, and APIs as well as demonstrate the practical use of NSL in different applications. The NSL website is hosted at www.tensorflow.org/neural_structured_learning, which includes details about the theoretical foundations of the technology, extensive API documentation, and hands-on tutorials.
引用
下载
收藏
页码:1150 / 1153
页数:4
相关论文
共 50 条
  • [1] Neural Structured Learning: Training Neural Networks with Structured Signals
    Gopalan, Arjun
    Juan, Da-Cheng
    Magalhaes, Cesar Ilharco
    Ferng, Chun-Sung
    Heydon, Allan
    Lu, Chun-Ta
    Pham, Philip
    Yu, George
    KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 3501 - 3502
  • [2] Structured neural networks and their flash learning
    Namatame, A.
    Algorithmic Learning Theory, 1990,
  • [3] Structured pruning of neural networks for constraints learning
    Cacciola, Matteo
    Frangioni, Antonio
    Lodi, Andrea
    Operations Research Letters, 2024, 57
  • [4] Learning Structured Sparsity in Deep Neural Networks
    Wen, Wei
    Wu, Chunpeng
    Wang, Yandan
    Chen, Yiran
    Li, Hai
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [5] LEARNING IN NEURAL NETWORKS WITH PARTIALLY STRUCTURED SYNAPTIC TRANSITIONS
    BATTAGLIA, FP
    FUSI, S
    NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1995, 6 (02) : 261 - 270
  • [6] Learning Structured Inference Neural Networks with Label Relations
    Hu, Hexiang
    Zhou, Guang-Tong
    Deng, Zhiwei
    Liao, Zicheng
    Mori, Greg
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 2960 - 2968
  • [7] Learning Structured Weight Uncertainty in Bayesian Neural Networks
    Sun, Shengyang
    Chen, Changyou
    Carin, Lawrence
    ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 54, 2017, 54 : 1283 - 1292
  • [9] Structured Pyramidal Neural Networks
    Soares, Alessandra M.
    Fernandes, Bruno J. T.
    Bastos-Filho, Carmelo J. A.
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2018, 28 (05)
  • [10] COMPUTING WITH STRUCTURED NEURAL NETWORKS
    FELDMAN, JA
    FANTY, MA
    GODDARD, NH
    COMPUTER, 1988, 21 (03) : 91 - 103