Apr 4, 2024 🎉 I’m happy to announce that a new paper have been accepted at HPDC ‘24. The paper introduces a performance model and new algorithms for reduce and allreduce on the Cerebras Wafer-Scale Engine (WSE), a novel architecture optimized for machine learning workloads. The new algorithms outperform the current vendor solutions by more than 3x.
Feb 15, 2024 👨‍🏫 In partnership with the University of Trento and CINI, we will host in June a summer school focused on High-Performance Computing (HPC) ( I’ll be giving two lectures on interconnection networks and the process of writing HPC papers. If you’re interested, feel free to join.
Dec 11, 2023 🎉 I’m happy to announce that two papers have been accepted at NSDI ‘24. The first one is about a new algorithm for allreduce on multidimensional torus networks that improves performance up to 3x compared to state-of-the-art algorithms (you can find a preprint here). The second one is on the design, implementation, and evaluation of the first-ever Slim Fly network deployment (here).
Oct 21, 2023 🎉 Our paper “Canary: Congestion-Aware In-Network Allreduce” has been accepted for publication on Future Generation Computer Systems (FGCS). You can find a preprint here.
Jul 24, 2023 🎉 Our HammingMesh paper, the result of a collaboration between ETH Zurich and Microsoft, has been invited to appear in Communications of ACM (CACM) Research Highlights.
Jul 18, 2023 😎 New website online!