Graph Hardware Trends

Petar discusses how transformers, despite being a special case of attentional GNNS, have gained popularity due to efficient GPU support. The hardware lottery plays a significant role in their widespread use. Graphcore, a startup focusing on graph-oriented hardware, hints at potential shifts in hardware trends for graph representation learning.