模型

首先从一个图分别用删边和Mask的方法生成,两个视图,对于一个视图内:目标节点与其他节点生成视图内的负样本对,在视图间,目标节点和另一个视图中除了anchor的其他节点成为负例,anchor成为正例

Enconder

用GNN作为Enconder

数据增强方法

删边和Mask

Loss

其中: θ(u,v)=s(g(u),g(v))\theta(\boldsymbol{u}, \boldsymbol{v})=s(g(\boldsymbol{u}), g(\boldsymbol{v}))θ(u,v)=s(g(u),g(v)),s是余弦相似度计算,g是非线性的投影层(两层MLP),能够增强表达能力

总的Loss

J=12N∑i=1N[ℓ(ui,vi)+ℓ(vi,ui)]\mathcal{J}=\frac{1}{2 N} \sum_{i=1}^{N}\left[\ell\left(\boldsymbol{u}_{i}, \boldsymbol{v}_{i}\right)+\ell\left(\boldsymbol{v}_{i}, \boldsymbol{u}_{i}\right)\right]J=2N1∑i=1N[ℓ(ui,vi)+ℓ(vi,ui)]

相当于一张图形成两个视角,跑了两遍,计算了平均Loss,反向传播

Deep Graph Contrastive Representation Learning相关推荐

GERL 2020 （WWW）Graph Enhanced Representation Learning for News Recommendation
应用场景新闻推荐提出背景新闻因具有实时性因而不适用于传统的CF技术推荐.DKN[2018]中,物品通过新闻标题和知识图谱中对应实体和实体上下文表示,用户通过用户历史推荐序列进行表示,但是新闻标题 ...
2021-ACS-IGN: A Novel and Efficient Deep Graph Representation Learning Framework for Accurate
2021-ACS-IGN: A Novel and Efficient Deep Graph Representation Learning Framework for Accurate Paper: ...
DySAT: Deep Neural Representation Learning on Dynamic Graph via Self-Attention Networks
文章目录 1 前言 2 问题定义 2.1 dynamic graph 3 DySAT思路 3.1 Structural Self-Attention 3.2 Temporal Self-Attenti ...
论文解读（GMI）《Graph Representation Learning via Graphical Mutual Information Maximization》
Python微信订餐小程序课程视频 https://edu.csdn.net/course/detail/36074 Python实战量化交易理财系统 https://edu.csdn.net/cou ...
阅读Hierarchical Graph Representation Learning with Differentiable Pooling(NeurIPS 2018)
最近关注graph pooling,Hierarchical Graph Representation Learning with Differentiable Pooling(NeurIPS 2 ...
DeepGS：Deep Representation Learning of Graphs and Sequences for DTA | CNN,GAT,BiGRU,Prot2Vec
DeepGS: Deep Representation Learning of Graphs and Sequences for Drug-Target Binding Affinity Predic ...
Iterative Deep Graph Learning for Graph Neural Networks: Better and Robust Node Embeddings
摘要:在本文中,我们提出了一个端到端的图学习框架,即迭代深度图学习(IDGL),用于联合和迭代地学习图结构和图嵌入.IDGL的关键理论是基于更好的节点嵌入来学习更好的图结构,反之亦然(即基于更好的图结 ...
【论文笔记】半监督的多视图学习：Semi-supervised Multi-view Deep Discriminant Representation Learning
[论文笔记]Semi-supervised Multi-view Deep Discriminant Representation Learning 1. 概念多视图学习(Multiview Lea ...
论文理解—— Disentangle-based Continual Graph Representation Learning
EMNLP 2020 Disentangle-based Continual Graph Representation Learning 链接: https://arxiv.org/abs/2010. ...
对比学习系列论文CPC（二）—Representation Learning with Contrastive Predictive Coding
0.Abstract 0.1逐句翻译 While supervised learning has enabled great progress in many applications, unsupe ...

Deep Graph Contrastive Representation Learning

Deep Graph Contrastive Representation Learning

模型

Loss

Deep Graph Contrastive Representation Learning相关推荐

最新文章

热门文章