Return
Skill-Driven Semantic Communication for Task Workflows
DOI:10.1109/lcomm.2026.3737163.png)
Abstract
En 中文
As wireless visual intelligence evolves from isolated task inference to ordered skill workflows, the core communication bottleneck shifts from transmitting a single semantic representation to coordinating reusable skill states under channel constraints. Existing DeepJSCC and prompt-guided visual transmitters usually treat each task as an independent full-token transmission, with limited reuse of execution memory across semantic workflows. This is inefficient for workflows such as Detect→Segment→Keypoint, where later stages mainly require state-relevant semantic updates rather than repeated full-grid transmission. This letter proposes SkillComm, a skill-driven semantic communication (SemCom) framework that utilizes reusable skill states as communication context to jointly guide workflow-aware token prioritization and memory-assisted token-grid reassembly. A shared Skill-Book first synchronizes the transmitter and receiver by mapping a high-level visual intent into an executable skill sequence. Conditioned on this synchronized workflow, workflow-aware adaptive token selection exploits cross-stage execution memory to prioritize state-active tokens before joint source-channel coding (JSCC) transmission. Finally, the receiver reconstructs a stage-specific token grid by merging the decoded active tokens with its local historical memory. Evaluations on the MS COCO 2017 validation dataset across the Detect→Segment→Keypoint workflow show that workflow-aware token prioritization enables SkillComm to reduce the transmitted semantic-token count by 51.2% and the index-aware channel-use cost by 50.4%, while retaining 99.4% upper-bound-normalized average precision in the high SNR regime. These results provide quantitative evidence that reusable skill states can drive workflow-aware token prioritization, enabling selective semantic innovation delivery for future agentic and embodied visual intelligence.
Keywords:
Skill-driven semantic communications
task workflow
token transmission
joint source-channel coding
Journal
IF:
4.4
Papers:
1.3W
Citations:
2.2W
Organization
Cited Papers
No cited papers available

