Seminars

View all Seminars  |  Download ICal for this event

CHARGE: Accelerating GNN Training via CPU Sampling in Heterogeneous CPU–GPU Environment

Series: M.Tech (Research) Colloquium

Speaker: Utkrisht Patesaria

Date/Time: Aug 11 11:30:00

Location: CSA Auditorium, (Room No. 104, Ground Floor)

Faculty Advisor: Arkaprava Basu

Abstract:
Graph Neural Networks (GNNs) have demonstrated exceptional performance across a wide range of applications, driving their widespread adoption. Current frameworks employ CPU and GPU resources-either in isolation or heterogeneously-to train GNNs, incorporating mini-batching and sampling techniques to mitigate scalability challenges posed by limited GPU memory. Sample-based GNN training is divided into three phases: Sampling, Extraction, and Training. Existing systems orchestrate these tasks across CPU and GPU in various ways, but exhaustive experiments reveal that not every stage is equally suited to both processors; notably, CPU sampling can outperform GPU sampling for certain samplers. Moreover, most frameworks lack adaptability to different samplers, datasets, and hardware configurations.

In this thesis, we propose CHARGE, a system that leverages competitive CPU sampling to accelerate end-to-end GNN training. An intelligent controller assigns each stage??Sampling, Extraction, and Training??to the most appropriate processor (CPU or GPU), agnostic to sampler, dataset, batch size, model, or underlying hardware. Built atop the DGL framework, CHARGE retains ease of programmability while delivering substantial improvements over state-of-the-art systems across multiple samplers, datasets, and models.

Speaker Bio:
Utkrisht Patesaria is an MTech Research student in the Department of Computer Science and Automation at IISc, Bangalore. He is a member of the Computer Systems Lab (CSL) and works under the guidance of Prof. Arkaprava Basu. His primary area of research sits at the nexus of Systems and Machine Learning, focusing on optimizing the GPU/CPU software stack at the hardware-software interface to enhance performance and efficiency.

Host Faculty: Arkaprava Basu