A gesture-driven multimodal interactive dance system

Gang Qian; Feng Guo; Todd Ingalls; Loren Olson; Jody James; Thanassis Rikakis

A gesture-driven multimodal interactive dance system

Gang Qian, Feng Guo, Todd Ingalls, Loren Olson, Jody James, Thanassis Rikakis

Arts, Media and Engineering, School of (AME)

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

53 Scopus citations

Abstract

In this paper, we report a real-time gesture driven interactive system with multimodal feedback for performing arts, especially dance. The system consists of two major parts: a gesture recognition engine and a multimodal feedback engine. The gesture recognition engine provides real-time recognition of the performer's gesture based on the 3D marker coordinates from a marker-based motion capture system. According to the recognition results, the multimodal feedback engine produces associated visual and audio feedback to the performer. This interactive system is simple to implement and robust to errors in 3D marker data. Satisfactory interactive dance performances have been successfully created and presented using the reported system.

Original language	English (US)
Title of host publication	2004 IEEE International Conference on Multimedia and Expo (ICME)
Pages	1579-1582
Number of pages	4
State	Published - Dec 1 2004
Event	2004 IEEE International Conference on Multimedia and Expo (ICME) - Taipei, Taiwan, Province of China Duration: Jun 27 2004 → Jun 30 2004

Publication series

Name	2004 IEEE International Conference on Multimedia and Expo (ICME)
Volume	3

Other

Other	2004 IEEE International Conference on Multimedia and Expo (ICME)
Country/Territory	Taiwan, Province of China
City	Taipei
Period	6/27/04 → 6/30/04

ASJC Scopus subject areas

General Engineering

Cite this

Qian, G, Guo, F, Ingalls, T, Olson, L, James, J & Rikakis, T 2004, A gesture-driven multimodal interactive dance system. in 2004 IEEE International Conference on Multimedia and Expo (ICME). 2004 IEEE International Conference on Multimedia and Expo (ICME), vol. 3, pp. 1579-1582, 2004 IEEE International Conference on Multimedia and Expo (ICME), Taipei, Taiwan, Province of China, 6/27/04.

@inproceedings{5fad7af2f233479191ee5b80a31e2d36,

title = "A gesture-driven multimodal interactive dance system",

abstract = "In this paper, we report a real-time gesture driven interactive system with multimodal feedback for performing arts, especially dance. The system consists of two major parts: a gesture recognition engine and a multimodal feedback engine. The gesture recognition engine provides real-time recognition of the performer's gesture based on the 3D marker coordinates from a marker-based motion capture system. According to the recognition results, the multimodal feedback engine produces associated visual and audio feedback to the performer. This interactive system is simple to implement and robust to errors in 3D marker data. Satisfactory interactive dance performances have been successfully created and presented using the reported system.",

author = "Gang Qian and Feng Guo and Todd Ingalls and Loren Olson and Jody James and Thanassis Rikakis",

year = "2004",

month = dec,

day = "1",

language = "English (US)",

isbn = "0780386035",

series = "2004 IEEE International Conference on Multimedia and Expo (ICME)",

pages = "1579--1582",

booktitle = "2004 IEEE International Conference on Multimedia and Expo (ICME)",

note = "2004 IEEE International Conference on Multimedia and Expo (ICME) ; Conference date: 27-06-2004 Through 30-06-2004",

}

TY - GEN

T1 - A gesture-driven multimodal interactive dance system

AU - Qian, Gang

AU - Guo, Feng

AU - Ingalls, Todd

AU - Olson, Loren

AU - James, Jody

AU - Rikakis, Thanassis

PY - 2004/12/1

Y1 - 2004/12/1

N2 - In this paper, we report a real-time gesture driven interactive system with multimodal feedback for performing arts, especially dance. The system consists of two major parts: a gesture recognition engine and a multimodal feedback engine. The gesture recognition engine provides real-time recognition of the performer's gesture based on the 3D marker coordinates from a marker-based motion capture system. According to the recognition results, the multimodal feedback engine produces associated visual and audio feedback to the performer. This interactive system is simple to implement and robust to errors in 3D marker data. Satisfactory interactive dance performances have been successfully created and presented using the reported system.

AB - In this paper, we report a real-time gesture driven interactive system with multimodal feedback for performing arts, especially dance. The system consists of two major parts: a gesture recognition engine and a multimodal feedback engine. The gesture recognition engine provides real-time recognition of the performer's gesture based on the 3D marker coordinates from a marker-based motion capture system. According to the recognition results, the multimodal feedback engine produces associated visual and audio feedback to the performer. This interactive system is simple to implement and robust to errors in 3D marker data. Satisfactory interactive dance performances have been successfully created and presented using the reported system.

UR - http://www.scopus.com/inward/record.url?scp=11244328259&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=11244328259&partnerID=8YFLogxK

M3 - Conference contribution

SN - 0780386035

SN - 9780780386037

T3 - 2004 IEEE International Conference on Multimedia and Expo (ICME)

SP - 1579

EP - 1582

BT - 2004 IEEE International Conference on Multimedia and Expo (ICME)

T2 - 2004 IEEE International Conference on Multimedia and Expo (ICME)

Y2 - 27 June 2004 through 30 June 2004

ER -

A gesture-driven multimodal interactive dance system

Abstract

Publication series

Other

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this