Large Multimodal Model-Based Environment-Aware Channel Estimation

doi:10.1109/JSAC.2025.3623163

Large Multimodal Model-Based Environment-Aware Channel Estimation

2026-01-12

0

PRE

AI

DOI：10.1109/JSAC.2025.3623163

Original

Original request for help

Save

Abstract

En 中文

Recently, large multimodal models (LMMs) have been successfully adopted in various fields due to their outstanding adaptability and reasoning abilities. Despite their potential to automate diverse tasks in communications systems, application to the physical layer remains underexplored. The primary reason is that the traditional physical layer relies on analytic channel measurements (e.g., pilot measurements), which capture only quantitative changes in transmitted signals and fail to characterize qualitative physical interactions (e.g., reflections and blockages) with the environment. In this paper, we propose an LMM-based environment-aware channel estimation framework that captures the contextual channel information by leveraging both perceptual sensor data and numerical pilot measurements. The main idea of the proposed scheme is to utilize visual channel parameters (VCPs), i.e., positions of user equipment (UE), reflection points, and scatterers. Since VCPs provide a direct visualization of the propagation environment, we can identify how signals propagate and physically interacts with the surrounding objects. To extract the VCPs and learn their probability distributions, we develop a reflection learning technique based on LMM. By incorporating these parameters, we establish a fundamental channel knowledge map (CKM) between the UE position and the channel. Simulation results demonstrate that the proposed scheme can effectively predict the channel throughout the wireless environments.

Keywords:

Large multimodal model

channel knowledge map

environment awareness

integrated sensing and communications

Large Multimodal Model-Based Environment-Aware Channel Estimation

Abstract

Journal

Organization