Return
Vital Insight: Assisting Experts' Context-Driven Sensemaking of Multi-modal Personal Tracking Data Using Visualization and Human-in-the-Loop LLM
J
X
J
A
B
X
D
E
V
DOI:10.1145/3749508.png)
Abstract
En 中文
Passive tracking methods, such as phone and wearable sensing, have become dominant in monitoring human behaviors in modern ubiquitous computing studies. While there have been significant advances in machine-learning approaches to translate periods of raw sensor data to model momentary behaviors, (e.g., physical activity recognition), there still remains a significant gap in the translation of these sensing streams into meaningful, high-level, context-aware insights that are required for various applications (e.g., summarizing an individual's daily routine). To bridge this gap, experts often need to employ a context-driven sensemaking process in real-world studies to derive insights. For instance, current approaches in the field can reliably predict "walking outdoors" by contextualizing accelerometer and GPS data. Sensemaking, however, involves being able to notice patterns of periodic "walking" and "stationary" events, and even infer "walking the dog" after realizing the alignment with regular routines reported through surveys or self-reports. This process often requires manual effort and can be challenging even for experienced researchers due to the complexity of human behaviors.
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
P
IF:
4.5
Papers:
1.1K
Citations:
7.2K
Organization
No organization information available
