Expressive Gesture www.kcng.org/mvm
[email protected]
Kia Ng Interdisciplinary Centre for Scientific Research in Music (ICSRiM) University of Leeds School of Computing & School of Music Leeds LS2 9JT, UK
www.kcng.org/mvm
www.kcng.org/mvm
SENSOR 1 SENSOR 2 SENSOR 3 SENSOR 4 MULTIPLEXER
AD CONVERTER
RA0 RA1 RA2 RB1
RB2
RB3 RB4
RB5 RB6 RB7
PIC 168FA RB0
OSC1
MAXI RS232
OSC2
1OMHz CRYSTAL
To RS232 serial port
www.kcng.org/mvm
www.kcng.org/mvm
DG tempo profiles
DM tempo profiles
KA tempo profiles
1.4
1.6
1.4
1.2
1.4
1.2
1.0
1.2
1.0
DG1TEMPO
DM1TEMPO
1.0
DG2TEMPO
DM2TEMPO
DG3TEMPO DG4TEMPO DG5TEMPO
.4 1
9
17
DM3TEMPO
.8
Value
Value
.6
KA1TEMPO
.8
DM4TEMPO DM5TEMPO
.6
25
1
CHORD
9
17
25
CHORD
KA2TEMPO KA3TEMPO
.6
Value
.8
KA4TEMPO KA5TEMPO
.4 1
9
17
25
CHORD
1.6
1.4
1.2
1.0
.8 DGMEAN
Value
Tempo: between performers
.6 DMMEAN .4
KAMEAN 1
CHORD
9
17
25
www.kcng.org/mvm
.12
.14
.14
.10
.12
.12
.10
.08
.10
.08 .08
.04
.02
0.00
.06
Value v(c) in m/s
Value v(a) in m/s
Value v(b) in m/s
.06
.06
.04
.04
.02
.02
0.00
8.08
9.88
8.98
11.68 13.48
10.78 12.58
15.28 17.08 18.88
14.38 16.18 17.98
20.68 22.48 24.28
19.78 21.58 23.38
8
10
25.18
9
T
11 11
13 12
15 14
17 16
18 17
20 19
22 21
10.3
23 23
13.3
12.5
14.7
14.0
16.2
15.5
17.7
17.0
19.2
18.4
20.7
19.9
22.1
21.4
23.6
22.9
24.4
T
T
1.4
1.6
1.4
11.8
11.0
24
1.3 1.4 1.2
1.2 1.1
1.2 1.0
Value KA3TEMPO
Value DM4TEMPO
Value DG2TEMPO
1.0 1.0
.9 .8 .7
.8
.8
.6
.6
.6
1
1
Case Number
9
17
25
9
17
25
33
1
9
17
25
33
33
Case Number
Case Number
www.kcng.org/mvm
DG xy position
DM xy position
Bivariate Scattergram Split By: second
KA xy position
Bivariate Scattergram Split By: second
13 8.000
12
9.000 10.000
11
11.000
8.000
30
13.000 14.000
9
15.000 16.000
8
17.000 18.000
7
28
10.000
6
21.000 22.000
5
23.000
12.000 24
25.000
14.000
22
15.000
20
16.000 17.000
18
3
4
5
6
7
8 9 sx(b) in cm
10
11
12
13
12.000 13.000
12
14.000 15.000
10
16.000 17.000
8
18.000 19.000
18.000 19.000
16
6
20.000 21.000
20.000
14
21.000
22.000
4
23.000
22.000
12
23.000 10
24.000
2
25.000
24.000 25.000
8
3
11.000
13.000
24.000
4
10.000 14
11.000
26
19.000 20.000
9.000
16
9.000
12.000
10
Bivariate Scattergram Split By: second
7.000
8
10
12
14
16
18 20 22 sx(a) in cm
24
26
28
30
26.000 27.000
26.000
0 0
2
4
6
8 10 sx(a) in cm
12
14
16
27.000 28.000 29.000
www.kcng.org/mvm
eBallet Sustain
Direct
Attack Indirect Flexibility during movement
Notation
Expressive Model
(dance score)
Machine Representation
Voice & other forms of interaction/input/control
3D Virtual Environment
3D Avatar/ Character
HCI/Interaction
eBallet Simulation • eChoreography • Edutainment • Cultural Heritage access, reconstruction and preservation
www.kcng.org/mvm
FSTART LH3231 FEND
Cabriole devant
Each key pose = an animation keyframes
www.kcng.org/mvm
Gesture in my current personal research context, draft 0.1 ☺ 26/11/2003
A sequence of movement (physical or otherwise) with emotional, expressional and communicational intend or respond to stimuli, consciously or unconsciously.
www.kcng.org/mvm
Thank you… Web: www.kcng.org Email:
[email protected] ICSRiM, University of Leeds, Leeds LS2 9JT, UK www.kcng.org/mvm