TEGRA -- Scaling Up Terascale Graph Processing with Disaggregated Computing

Bibliographic Details
Title: TEGRA -- Scaling Up Terascale Graph Processing with Disaggregated Computing
Authors: Shaddix, William, Samani, Mahyar, Fariborz, Marjan, Yoo, S. J. Ben, Lowe-Power, Jason, Akella, Venkatesh
Publication Year: 2024
Collection: Computer Science
Subject Terms: Computer Science - Emerging Technologies
More Details: Graphs are essential for representing relationships in various domains, driving modern AI applications such as graph analytics and neural networks across science, engineering, cybersecurity, transportation, and economics. However, the size of modern graphs are rapidly expanding, posing challenges for traditional CPUs and GPUs in meeting real-time processing demands. As a result, hardware accelerators for graph processing have been proposed. However, the largest graphs that can be handled by these systems is still modest often targeting Twitter graph(1.4B edges approximately). This paper aims to address this limitation by developing a graph accelerator capable of terascale graph processing. Scale out architectures, architectures where nodes are replicated to expand to larger datasets, are natural for handling larger graphs. We argue that this approach is not appropriate for very large-scale graphs because it leads to under utilization of both memory resources and compute resources. Additionally, vertex and edge processing have different access patterns. Communication overheads also pose further challenges in designing scalable architectures. To overcome these issues, this paper proposes TEGRA, a scale-up architecture for terascale graph processing. TEGRA leverages a composable computing system with disaggregated resources and a communication architecture inspired by Active Messages. By employing direct communication between cores and optimizing memory interconnect utilization, TEGRA effectively reduces communication overhead and improves resource utilization, therefore enabling efficient processing of terascale graphs.
Comment: Presented at the 3rd Workshop on Heterogeneous Composable and Disaggregated Systems (HCDS 2024)
Document Type: Working Paper
Access URL: http://arxiv.org/abs/2404.03155
Accession Number: edsarx.2404.03155
Database: arXiv
More Details
Description not available.