AI Research

Distilling Graph Geometry: Knowledge Gap from GNNs to MLPs

Medium Severity Global
Date Occurred Oct 07, 2026 17:56 UTC
Event Type AI Research
Source arXiv
Recorded Oct 08, 2026
Full Description

arXiv: Distilling Graph Geometry: Knowledge Gap from GNNs to MLPs GNN-to-MLP distillation aims to retain the predictive accuracy of a message-passing teacher while deploying a graph-free MLP at inference. Existing methods mainly transfer node-wise predictions or use confidence-based reweighting, but they do not specify where the student should preserve the teacher's graph-induced geometry. We show that this omission leads to two spectral failure modes in the student's representation space. On sparse graphs, the student suffers from spectral underfit, missing h

AI Intelligence Layer

AI Categories

performance
Event Metadata
  • ID #37607
  • Type AI Research
  • Region Global
  • Severity Medium
  • Indexed Oct 08, 2026