Skip to main navigation Skip to search Skip to main content

Why (Not) ReacTIVision: Emerging Challenges and Opportunities for Building Tangible User Interfaces with Computer Vision Toolkits

  • Krithik Ranjan
  • , S. Sandra Bae
  • , Peter Gyory
  • , Ellen Yi Luen Do
  • , Clement Zheng
  • , Rong Hao Liang

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Outdated Computer Vision (CV) toolkits for Tangible User Interfaces (TUI) have led to fragmented practices, diminished reproducibility, and reduced community support. This paper examines the past, present, and future trajectory of CV-TUI toolkits. Our scoping review of ACM literature (N=120) reveals a divergence between applications using the limited interactions of established toolkits like ReacTIVision and the fragmented, bespoke systems built for complex interactions, highlighting the need for advanced toolkits that enable accessible making. We found how ReacTIVision-based projects were primarily used in stationary tabletop settings with standard token events, while non-ReacTIVision projects explored unique interaction techniques in diverse configurations. Reflecting on these insights, we offer six suggestions for building the next-generation CV-TUI toolkits to support rapid prototyping of tangible interactions. This study provides the TUI community with an updated perspective to inform future research.

Original languageEnglish (US)
Title of host publicationTEI 2026 - Proceedings of 20th International Conference on Tangible, Embedded, and Embodied Interaction
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9798400718687
DOIs
StatePublished - Mar 7 2026
Event20th International Conference on Tangible, Embedded, and Embodied Interaction, TEI 2026 - Hybrid, Chicago, United States
Duration: Mar 8 2026 → Mar 11 2026

Publication series

NameTEI 2026 - Proceedings of 20th International Conference on Tangible, Embedded, and Embodied Interaction

Conference

Conference20th International Conference on Tangible, Embedded, and Embodied Interaction, TEI 2026
Country/TerritoryUnited States
CityHybrid, Chicago
Period3/8/26 → 3/11/26

Keywords

  • Computer Vision (CV)
  • ReacTIVision
  • Scoping Review
  • Tangible Interaction
  • Toolkits

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Software
  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'Why (Not) ReacTIVision: Emerging Challenges and Opportunities for Building Tangible User Interfaces with Computer Vision Toolkits'. Together they form a unique fingerprint.

Cite this