SMDG: Enhancing In-Memory Dynamic Graph Processing With Storage-Class Memory

Tongfeng Weng

doi:10.1109/TKDE.2026.3676514

SMDG: Enhancing In-Memory Dynamic Graph Processing With Storage-Class Memory

2026-03-23

0

PRE

AI

DOI：10.1109/TKDE.2026.3676514

Original

Original request for help

Save

Abstract

En 中文

In-memory dynamic graph processing faces three critical challenges: limited DRAM capacity, inefficient concurrent update/query handling, and vulnerability to crashes. Traditional segment-level systems struggle with write amplification on emerging Storage-Class Memory (SCM), while existing persistent-memory systems suffer from coarse-grained synchronization and high recovery overhead. This study presents the Storage-Class Memory Dynamic Graph (SMDG) processing framework, an architecture-level redesign centered on the block as the atomic unit across storage, concurrency, and recovery. The system addresses these challenges through three key innovations. First, a block-granular storage design organizes adjacency data at fixed-size block granularity on heterogeneous DRAM-SCM architecture, employing buffered batched writes to significantly reduce write amplification while preserving logarithmic update complexity. Second, block-level multi-version concurrency control maintains timestamped block versions under per-vertex read-write synchronization to provide task-ordered snapshot visibility for concurrent queries without copying entire vertices or pages. Third, a block-granular crash recovery protocol with decentralized per-vertex logs enables independent parallel reconstruction, ensuring application-level semantic consistency while achieving substantially faster recovery than sequential approaches. Experimental results validate that this unified block-granular design improves update efficiency, sustains mixed update-query workloads with controlled memory overhead, and accelerates crash recovery compared with prior dynamic graph systems.

Keywords:

Dynamic graph

MVCC

packed-memory array

storage-class memory

SMDG: Enhancing In-Memory Dynamic Graph Processing With Storage-Class Memory

Abstract

Journal

Organization

Cited Papers