Multimodal-context Interruptibility Dataset for Proactive Services on Smart Speakers at Home
2026-08-13
As smart speakers become increasingly integrated into everyday home life, there is growing interest in leveraging these speakers to proactively deliver personalized proactive services. To enhance user experience and engagement of proactive services, a key challenge is identifying opportune moments, user contexts when users are most interruptible to engage in proactive services. Researchers have identified such moments by exploring interruptibility across various user contexts (in which contexts users are more interruptible), and several datasets have been released with interruptibility labels. However, no publicly available dataset has focused specifically on interruptibility within home environments. To fill this gap, we present INPROSH, a dataset collected from 26 participants over a three-week in-the-wild field study. Participants used proactive services via smart speakers in their homes. INPROSH comprises 2,830 cases, each annotated with interruptibility labels and enriched with contextual information, including temporal, spatial, and behavioral contexts, as well as surrounding image and sound recordings near the smart speakers. We believe INPROSH will support a deeper understanding and more accurate detection of interruptibility in home environments.