1/6 We're excited to share our #NeurIPS2024 paper: Probabilistic Graph Rewiring via Virtual Nodes! It addresses key challenges in GNNs, such as over-squashing and under-reaching, while reducing reliance on heuristic rewiring. w/ Chendi Qian, @christophermorris.bsky.social @mniepert.bsky.social 🧵 - ThreadSky

1/6 We're excited to share our #NeurIPS2024 paper: Probabilistic Graph Rewiring via Virtual Nodes! It addresses key challenges in GNNs, such as over-squashing and under-reaching, while reducing reliance on heuristic rewiring. w/ Chendi Qian, @christophermorris.bsky.social @mniepert.bsky.social 🧵

Comments

amanolache.bsky.social•82 days ago

2/6 Standard MPNNs struggle with long-range interactions, making them less effective for large, complex graphs. Transformers help but come with quadratic complexity, which is computationally expensive. Rewiring heuristics? Often brittle and task-specific.

amanolache.bsky.social•82 days ago

3/6 Enter IPR-MPNNs: Our approach learns to rewire graphs probabilistically by adding virtual nodes. This eliminates the need for heuristics, making the method more flexible and task-adaptive, while maintaining computational efficiency. 🎯

amanolache.bsky.social•82 days ago

4/6 We demonstrate SOTA results on various benchmarks, effectively addressing over-squashing and under-reaching. IPR-MPNNs also surpass standard MPNNs in expressiveness, distinguishing complex graph structures—all while being faster and more memory-efficient than GTs. 🚀

amanolache.bsky.social•82 days ago

5/6 How it works: Probabilistic sampling connects original nodes to virtual ones, enhancing connectivity without explicit pairwise computations. The result is a framework that achieves both higher WL expressiveness and efficiency in graph-based learning.

amanolache.bsky.social•82 days ago

6/6 Interested in learning more? Check out our preprint here: https://arxiv.org/pdf/2405.17311.
If you’d like to discuss, I’d be very happy to chat during the poster session in Vancouver! :)

kareemyousrii.bsky.social•82 days ago

Can't wait to finally meet you and hopefully @mniepert.bsky.social in person! :)

amanolache.bsky.social•78 days ago

Happening today, East Exhibit Hall A-C, poster #3110. Come say "Hi!"! 👋

Comments

Posting Rules

Reply