.png){kind=icon}
.png){kind=icon}
Return
Edge-assisted Collaborative Image Recognition for Mobile Augmented Reality
.png){kind=icon}
PRE
AI
DOI：10.1145/3469033.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Mobile Augmented Reality (AR), which overlays digital content on the real-world scenes surrounding a user, is bringing immersive interactive experiences where the real and virtual worlds are tightly coupled. To enable seamless and precise AR experiences, an image recognition system that can accurately recognize the object in the camera view with low system latency is required. However, due to the pervasiveness and severity of image distortions, an effective and robust image recognition solution for in the wild mobile AR is still elusive. In this article, we present CollabAR, an edge-assisted system that provides distortion-tolerant image recognition for mobile AR with imperceptible system latency. CollabAR incorporates both distortion-tolerant and collaborative image recognition modules in its design. The former enables distortion-adaptive image recognition to improve the robustness against image distortions, while the latter exploits the spatial-temporal correlation among mobile AR users to improve recognition accuracy. Moreover, as it is difficult to collect a large-scale image distortion dataset, we propose a Cycle-Consistent Generative Adversarial Network-based data augmentation method to synthesize realistic image distortion. Our evaluation demonstrates that CollabAR achieves over 85% recognition accuracy for in the wild images with severe distortions, while reducing the end-to-end system latency to as low as 18.2ms.
Keywords:
Edge computing
collaborative augmented reality
mobile image recognition
cycle-consistent generative adversarial networks
Journal
IF:
4.7
Papers:
995
Citations:
2.0K
View more organizations