English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Zendy Pro

Presents the zaia usage as premium feature

ZAIA

Presents AI Discovery search usage as a premium feature

AI Discovery

Presents AI Discovery explain and summary usage as a premium feature

Content Analysis

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Presents the pdf analysis as premium feature

PDF Analysis

1500 Top-up

3000 Top-up

Zendy Basic

2500 Top-up

Zendy Unlimited

Presents the access of premium content as premium feature

Premium Content

For large-scale applications, there is growing interest in replacing graph neural networks (GNNs) with lightweight multilayer perceptrons (MLPs) via knowledge distillation. However, distilling GNNs for self-supervised graph representation learning (SSGRL) into MLPs is more challenging. This is because the performance of self-supervised learning is more related to the model&#x2019;s inductive bias than supervised learning. This motivates us to design a new distillation method to bridge a huge capacity gap between GNNs and MLPs in SSGRL. In this article, we propose diffusion-assisted distillation for self-supervised graph representation learning with MLPs (DAD-SGMs). The proposed method employs a denoising diffusion model (DDM) as a teacher assistant to better distill the knowledge from the teacher GNN into the student MLP. This approach enhances the generalizability and robustness of MLPs in SSGRL. Extensive experiments demonstrate that DAD-SGM effectively distills the knowledge of self-supervised GNNs compared to state-of-the-art GNN-to-MLP distillation methods.

Diffusion-Assisted Distillation for Self-Supervised Graph Representation Learning With MLPs