.png){kind=icon}
.png){kind=icon}
Return
Asynchronous Parallel I/O Optimization for the Mass Conservation Ocean Model Using PAIO
.png){kind=icon}
OA
AI
DOI：10.3390/jmse14100910.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
The increasing resolution of global ocean circulation models has made data output an important constraint on runtime efficiency and operational timeliness. The current dedicated-process asynchronous I/O scheme in the Mass Conservation Ocean Model (MaCOM) sends output data from compute processes to a group of reserved I/O processes. Although this design separates part of the writing work from the main time-stepping loop, it still introduces centralized data aggregation, additional I/O process management, and high memory pressure on the I/O side at large process counts. This paper presents MaCOM–PAIO, a PAIO-enabled asynchronous I/O optimization for MaCOM. Built on the existing PAIO/PAIOM asynchronous I/O stack, MaCOM–PAIO implements a thread-based asynchronous output path, adapts the PnetCDF execution path used by MaCOM to route selected collective writes to PAIO, and uses PAIOM asynchronous zones to submit history and restart output operations as background tasks. The implementation keeps the numerical solver unchanged and preserves the PnetCDF-style calling path at the application level, while replacing the dedicated I/O process path with I/O–thread-based asynchronous execution on the allocated HPC nodes. Experiments were conducted on a 1/12 ∘ global MaCOM configuration. Strong-scaling tests show that, at 1646 compute processes, MaCOM–PAIO reduces the total runtime from 1167.45 s to 276.53 s and lowers the compute-side I/O blocking ratio from 67.2% to 4.9% under the tested configuration. In an independent bandwidth test at 1080 compute processes, the measured write bandwidth increases from approximately 0.10 GiB/s to 0.90 GiB/s for output volumes of about 82 GiB. The maximum memory footprint of the I/O entities is also reduced from approximately 18.2 GiB in the legacy dedicated-I/O scheme to approximately 1.9 GiB in MaCOM–PAIO. These results demonstrate that PAIO-based integration is a practical approach for improving MaCOM I/O performance under the evaluated hardware/software environment and workload.
Keywords:
Mass Conservation Ocean Model (MaCOM)
asynchronous I/O
parallel I/O
PAIO
PAIOM
PnetCDF
high-performance computing
ocean circulation model
Journal
IF:
2.8
Papers:
4.3K
Citations:
2.3W