Graph embedding with hierarchical attentive membership

Lu Lin, Ethan Blaser, Hongning Wang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

This paper studies a remarkable property of graphs which is the latent hierarchical grouping of nodes, where each node manifests its membership to a specific group based on the context composed by its neighboring nodes. When modeling the neighborhood structure for graph representation learning, most prior works ignore such latent groups and nodes' membership to different groups, not to mention the hierarchy. Thus, they fall short of delivering a comprehensive understanding of the nodes under different contexts in a graph. In this paper, we propose a novel hierarchical attentive membership model for graph embedding, where the latent memberships for each node are dynamically discovered based on its neighboring context. Both group-level and individual-level attentions are performed when aggregating neighboring states to generate node embeddings. We introduce structural constraints to explicitly regularize the inferred memberships of each node, such that a well-defined hierarchical grouping structure is captured. The proposed model outperformed a set of state-of-the-art graph embedding solutions on node classification and link prediction tasks in a variety of graphs including citation networks and social networks. Qualitative evaluations visualize the learned node embeddings along with the inferred memberships, which proved the concept of membership hierarchy and enables explainable embedding learning in graphs.

Original languageEnglish (US)
Title of host publicationWSDM 2022 - Proceedings of the 15th ACM International Conference on Web Search and Data Mining
PublisherAssociation for Computing Machinery, Inc
Pages582-590
Number of pages9
ISBN (Electronic)9781450391320
DOIs
StatePublished - Feb 11 2022
Event15th ACM International Conference on Web Search and Data Mining, WSDM 2022 - Virtual, Online, United States
Duration: Feb 21 2022Feb 25 2022

Publication series

NameWSDM 2022 - Proceedings of the 15th ACM International Conference on Web Search and Data Mining

Conference

Conference15th ACM International Conference on Web Search and Data Mining, WSDM 2022
Country/TerritoryUnited States
CityVirtual, Online
Period2/21/222/25/22

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Computer Science Applications
  • Software

Cite this