👂 🎴 🕸️
Roll
''
pitch
and
yaw
on
a
dancing
body
:
one
reference
frame
''
six
motion
sensors
''
three
rotations
.
<
p
class
='
fragment
'>
Six
small
sensors
on
one
dancer
.
Six
streams
of
numbers
.
What
do
they
actually
say
?
p
><
p
class
='
fragment
'>
Each
sensor
answers
one
question
:
<
em
>
how
am
I
turned
''
compared
with
the
moment
you
pressed
Calibrate
?
em
>
p
><
p
class
='
fragment
'>
The
answer
is
always
three
numbers
:
<
span
class
='
c
-
r
'>
roll
span
>''
<
span
class
='
c
-
p
'>
pitch
span
>
and
<
span
class
='
c
-
y
'>
yaw
span
>.
p
><
p
class
='
fragment
'><
strong
>
Today
:
what
these
three
words
mean
on
a
dancing
body
.
strong
>
p
>
<
p
class
='
fragment
'>
Origin
:
the
<
strong
>
sternum
strong
>.
p
><
p
class
='
fragment
'>
Calibration
pose
:
standing
straight
''
arms
hanging
''
<
strong
>
palms
turned
forward
strong
>.
p
><
p
class
='
fragment
'><
span
class
='
c
-
r
'>
X
span
>
points
forward
''
out
of
the
chest
.
<
span
class
='
c
-
p
'>
Y
span
>
points
to
the
dancer
'
s
left
.
<
span
class
='
c
-
y
'>
Z
span
>
points
up
.
p
><
p
class
='
fragment
'>
Like
an
aeroplane
flying
forward
:
nose
''
left
wing
''
up
.
p
><
p
class
='
fragment
'><
strong
>
Calibrate
=
declare
this
pose
to
be
zero
.
strong
>
p
>
<
p
class
='
fragment
'>
Two
hands
''
two
legs
''
torso
''
head
.
p
><
p
class
='
fragment
'>
Each
sensor
reports
its
<
strong
>
orientation
strong
>
(
roll
''
pitch
''
yaw
)''
its
<
strong
>
rotation
speed
strong
>
and
its
<
strong
>
acceleration
strong
>
—
at
rest
it
feels
gravity
''
1
g
pointing
up
.
p
><
p
class
='
fragment
'><
strong
>
Today
we
only
need
the
first
:
orientation
.
strong
>
p
>
<
p
class
='
fragment
'>
A
rigid
body
in
space
can
turn
in
exactly
three
independent
ways
.
p
><
p
class
='
fragment
'>
Pilots
named
them
.
<
span
class
='
c
-
r
'>
roll
span
>:
tilt
a
wing
down
.
<
span
class
='
c
-
p
'>
pitch
span
>:
nose
up
or
down
.
<
span
class
='
c
-
y
'>
yaw
span
>:
nose
left
or
right
.
p
><
p
class
='
fragment
'>
In
our
frame
each
one
is
a
rotation
about
one
axis
:
<
span
class
='
c
-
r
'>
roll
span
>
about
<
span
class
='
c
-
r
'>
X
span
>''
<
span
class
='
c
-
p
'>
pitch
span
>
about
<
span
class
='
c
-
p
'>
Y
span
>''
<
span
class
='
c
-
y
'>
yaw
span
>
about
<
span
class
='
c
-
y
'>
Z
span
>.
p
><
p
class
='
fragment
'>
Which
way
is
positive
?
The
<
strong
>
right
-
hand
rule
strong
>:
thumb
along
the
axis
''
fingers
curl
in
the
positive
direction
.
p
><
p
class
='
fragment
'>(
In
ShivaSynth
the
sign
also
depends
on
how
a
sensor
is
strapped
on
—
more
about
that
later
.)
p
><
p
class
='
fragment
'><
strong
>
Roll
''
pitch
''
yaw
are
not
parts
of
the
body
.
They
are
rotations
about
the
frame
'
s
axes
.
strong
>
p
>
<
p
class
='
fragment
'>
Turn
about
the
axis
that
points
<
em
>
out
of
your
chest
em
>.
p
><
p
class
='
fragment
'>
Torso
:
<
strong
>
side
bend
strong
>.
Head
:
<
strong
>
tilt
strong
>''
ear
to
shoulder
.
Whole
body
:
cartwheel
.
p
><
p
class
='
fragment
'>
Positive
roll
:
leaning
to
the
dancer
'
s
right
.
p
><
p
class
='
fragment
'>
In
the
app
:
<
code
>
twist
code
>.
p
><
p
class
='
fragment
'><
strong
>
Try
it
:
tilt
your
head
as
if
to
say
“
hmm
''
I
'
m
not
so
sure
”.
strong
>
p
>
<
p
class
='
fragment
'>
Turn
about
the
axis
that
runs
through
you
from
right
to
left
.
p
><
p
class
='
fragment
'>
Torso
:
<
strong
>
bow
strong
>.
Head
:
<
strong
>
nod
strong
>.
Leg
:
kick
forward
.
p
><
p
class
='
fragment
'>
Positive
pitch
:
bowing
forward
.
p
><
p
class
='
fragment
'>
In
the
app
:
<
code
>
lean
code
>.
p
><
p
class
='
fragment
'><
strong
>
Try
it
:
nod
“
yes
”.
strong
>
p
>
<
p
class
='
fragment
'>
Turn
about
the
<
strong
>
vertical
strong
>
axis
.
p
><
p
class
='
fragment
'>
Torso
:
<
strong
>
turn
strong
>''
pirouette
.
Head
:
look
around
''
shake
“
no
”.
p
><
p
class
='
fragment
'>
Positive
yaw
:
turning
to
the
dancer
'
s
left
(
counter
-
clockwise
''
seen
from
above
).
p
><
p
class
='
fragment
'>
In
the
app
:
<
code
>
turn
code
>.
p
><
p
class
='
fragment
'><
strong
>
Yaw
is
special
:
nothing
in
gravity
says
which
way
you
face
.
More
about
that
in
a
minute
.
strong
>
p
>
<
p
class
='
fragment
'>
On
a
limb
the
frame
<
strong
>
travels
with
the
limb
strong
>.
p
><
p
class
='
fragment
'><
span
class
='
c
-
r
'>
x
span
>
runs
along
the
bone
towards
the
hand
or
foot
;
<
span
class
='
c
-
y
'>
z
span
>
points
out
of
the
skin
;
<
span
class
='
c
-
p
'>
y
span
>
completes
the
triple
.
p
><
p
class
='
fragment
'><
span
class
='
c
-
r
'>
roll
span
>
=
twist
the
limb
about
its
own
axis
(
wrist
''
foot
).
<
span
class
='
c
-
p
'>
pitch
span
>
=
raise
/
lower
.
<
span
class
='
c
-
y
'>
yaw
span
>
=
swing
aside
.
p
><
p
class
='
fragment
'><
strong
>
Palms
forward
at
calibration
fixes
what
“
zero
twist
”
means
.
strong
>
p
>
<
p
class
='
fragment
'>
Lift
your
right
arm
sideways
''
like
a
jumping
jack
.
p
><
p
class
='
fragment
'>
In
the
<
strong
>
body
frame
strong
>
that
is
a
turn
about
<
span
class
='
c
-
r
'>
X
span
>''
the
forward
axis
:
a
<
span
class
='
c
-
r
'>
roll
span
>.
p
><
p
class
='
fragment
'>
For
the
sensor
on
the
wrist
it
is
a
turn
about
its
own
<
span
class
='
c
-
y
'>
z
span
>:
the
app
calls
it
<
span
class
='
c
-
y
'>
yaw
span
>''
<
em
>
swing
aside
em
>.
p
><
p
class
='
fragment
'>
Same
rotation
''
same
numbers
.
Only
the
name
changed
.
p
><
p
class
='
fragment
'><
strong
>
Always
say
which
frame
you
are
in
.
strong
>
p
>
<
p
class
='
fragment
'>
Hold
your
phone
flat
in
front
of
you
''
screen
up
.
p
><
p
class
='
fragment
'><
strong
>
A
:
strong
>
turn
it
90
°
to
the
left
(
yaw
)''
<
em
>
then
em
>
tip
its
far
edge
down
90
°
(
pitch
).
Note
where
the
screen
points
.
p
><
p
class
='
fragment
'><
strong
>
B
:
strong
>
start
again
.
Pitch
first
''
<
em
>
then
em
>
yaw
.
p
><
p
class
='
fragment
'>
Same
two
quarter
-
turns
''
two
different
poses
.
p
><
p
class
='
fragment
'><
strong
>
Rotations
do
not
commute
.
So
“
roll
''
pitch
''
yaw
”
needs
an
agreed
order
of
application
.
strong
>
p
>
<
p
class
='
fragment
'>
Bow
deeply
''
torso
horizontal
:
the
axis
out
of
your
chest
now
points
at
the
floor
.
p
><
p
class
='
fragment
'>
Now
a
turn
about
<
span
class
='
c
-
r
'>
x
span
>
(
roll
)
and
a
turn
about
the
vertical
(
yaw
)
are
<
strong
>
the
same
movement
strong
>.
The
angles
can
no
longer
be
told
apart
.
p
><
p
class
='
fragment
'>
A
glitch
of
the
three
-
angle
description
—
not
of
the
body
.
Deep
bows
and
raised
arms
bring
any
dancer
there
.
p
><
p
class
='
fragment
'>
The
cure
:
sensors
compute
with
quaternions
inside
and
use
angles
for
display
only
.
ShivaSynth
'
s
<
code
>
height
code
>
is
the
angle
between
“
up
”
now
and
“
up
”
at
calibration
''
which
stays
clean
in
every
pose
.
p
><
p
class
='
fragment
'><
strong
>
Three
angles
are
a
convenient
language
''
not
the
truth
of
orientation
.
strong
>
p
>
<
p
class
='
fragment
'>
At
rest
''
the
accelerometer
feels
gravity
.
That
gives
roll
and
pitch
—
<
em
>
absolute
em
>.
p
><
p
class
='
fragment
'>
Turning
about
the
vertical
does
not
change
where
gravity
points
.
Yaw
has
no
such
anchor
.
p
><
p
class
='
fragment
'>
Two
remedies
:
add
up
the
gyroscope
'
s
rotation
speed
(
small
errors
accumulate
:
<
strong
>
drift
strong
>)
or
consult
a
magnetic
compass
(
disturbed
by
metal
and
electronics
).
p
><
p
class
='
fragment
'><
strong
>
So
:
calibrate
before
you
dance
''
and
expect
<
code
>
turn
code
>
to
be
the
least
stable
of
the
three
.
strong
>
p
>
<
p
class
='
fragment
'>
In
the
dashboard
every
sensor
plots
its
<
span
class
='
c
-
r
'>
roll
span
>
(
red
)''
<
span
class
='
c
-
p
'>
pitch
span
>
(
blue
)
and
<
span
class
='
c
-
y
'>
yaw
span
>
(
yellow
).
p
><
p
class
='
fragment
'>
The
patch
bay
turns
them
into
controls
:
<
code
>
twist
code
>
=
roll
''
<
code
>
lean
code
>
=
pitch
''
<
code
>
turn
code
>
=
yaw
.
p
><
p
class
='
fragment
'>
In
the
Techno
patch
''
for
instance
''
the
DJ
filter
follows
<
code
>
lean
code
>''
the
acid
line
'
s
cutoff
follows
<
code
>
twist
code
>.
p
><
p
class
='
fragment
'>
If
a
signed
feature
goes
the
wrong
way
''
flip
the
±
in
the
patch
bay
:
the
strap
may
sit
the
other
way
round
.
p
><
p
class
='
fragment
'><
strong
>
Your
body
'
s
rotations
become
the
instrument
'
s
parameters
.
strong
>
p
>
<
p
class
='
fragment
'>
Which
sensor
''
which
angle
?
Do
each
movement
and
say
it
aloud
.
p
><
p
class
='
fragment
'>
Nod
“
yes
”
→
head
''
<
span
class
='
c
-
p
'>
pitch
span
>
p
><
p
class
='
fragment
'>
Shake
“
no
”
→
head
''
<
span
class
='
c
-
y
'>
yaw
span
>
p
><
p
class
='
fragment
'>
Ear
to
shoulder
→
head
''
<
span
class
='
c
-
r
'>
roll
span
>
p
><
p
class
='
fragment
'>
Bow
→
torso
''
<
span
class
='
c
-
p
'>
pitch
span
>
 · 
Pirouette
→
torso
''
<
span
class
='
c
-
y
'>
yaw
span
>
 · 
Side
bend
→
torso
''
<
span
class
='
c
-
r
'>
roll
span
>
p
><
p
class
='
fragment
'>
Wave
sideways
→
hand
''
<
span
class
='
c
-
y
'>
yaw
span
>
 · 
Turn
your
foot
out
→
leg
''
<
span
class
='
c
-
r
'>
roll
span
>
 · 
Kick
→
leg
''
<
span
class
='
c
-
p
'>
pitch
span
>
p
><
p
class
='
fragment
'><
strong
>
And
which
of
these
gets
you
into
gimbal
lock
?
strong
>
p
>
<
p
class
='
fragment
'><
strong
>
Frame
:
strong
>
origin
at
the
sternum
''
X
forward
''
Y
left
''
Z
up
.
p
><
p
class
='
fragment
'><
span
class
='
c
-
r
'>
roll
span
>
about
X
''
<
span
class
='
c
-
p
'>
pitch
span
>
about
Y
''
<
span
class
='
c
-
y
'>
yaw
span
>
about
Z
—
and
on
a
limb
''
the
axes
follow
the
limb
.
p
><
p
class
='
fragment
'>
The
names
depend
on
the
frame
;
the
order
of
rotations
matters
;
yaw
drifts
;
angles
break
down
at
90
°.
p
><
p
class
='
fragment
'><
strong
>
Next
:
from
orientation
to
rhythm
—
what
can
we
do
with
the
speed
of
these
rotations
?
strong
>
p
>
<
p
class
='
fragment
'>
Every
movement
''
however
free
it
looks
''
has
a
pulse
.
A
step
''
a
swing
of
the
arm
''
a
beat
of
a
wing
—
each
repeats
''
and
each
repetition
takes
time
.
p
><
p
class
='
fragment
'>
This
session
gives
you
the
physical
vocabulary
for
talking
precisely
about
that
pulse
:
<
strong
>
period
strong
>''
<
strong
>
frequency
strong
>''
and
<
strong
>
speed
strong
>
—
and
why
they
are
not
the
same
thing
.
p
><
p
class
='
fragment
'>
By
the
end
''
you
'
ll
be
able
to
describe
your
own
heartbeat
''
your
own
gait
''
even
a
hummingbird
'
s
wing
''
in
exactly
the
same
terms
—
which
is
also
the
first
step
toward
<
em
>
tracking
em
>
movement
and
turning
it
into
sound
''
piano
included
.
p
>
<
p
class
='
fragment
'>
A
<
strong
>
period
strong
>
(
T
)
is
the
time
it
takes
for
one
complete
cycle
of
a
repeating
motion
—
one
full
step
''
one
full
wingbeat
''
one
full
swing
.
p
><
p
class
='
fragment
'><
strong
>
Frequency
strong
>
(
f
)
is
simply
how
many
of
those
cycles
happen
per
second
:
f
=
1
/
T
.
If
a
step
takes
half
a
second
''
its
frequency
is
2
steps
per
second
.
p
><
p
class
='
fragment
'>
Frequency
is
measured
in
Hertz
(
Hz
)
—
one
Hz
means
one
complete
cycle
every
second
.
A
slow
''
heavy
motion
has
a
long
period
and
a
low
frequency
;
a
quick
''
light
motion
has
a
short
period
and
a
high
frequency
.
p
>
<
p
class
='
fragment
'>
The
simplest
periodic
body
in
physics
is
the
pendulum
:
a
weight
swinging
from
a
fixed
point
.
p
><
p
class
='
fragment
'>
Its
period
depends
only
on
its
length
and
on
gravity
—
not
on
how
wide
it
swings
''
and
not
on
how
heavy
the
weight
is
.
A
longer
pendulum
always
swings
more
slowly
than
a
short
one
.
p
><
p
class
='
fragment
'>
This
single
fact
—
<
em
>
longer
means
slower
em
>
—
turns
out
to
govern
almost
every
example
in
today
'
s
session
''
from
a
child
'
s
leg
to
a
hummingbird
'
s
wing
.
p
>
<
p
class
='
fragment
'>
The
most
intimate
periodic
motion
you
own
is
your
own
heart
:
roughly
one
beat
per
second
at
rest
—
about
60
-
80
beats
per
minute
''
close
to
1
Hz
.
p
><
p
class
='
fragment
'>
Under
exertion
—
dancing
included
—
that
frequency
can
double
or
more
''
while
the
body
'
s
other
rhythms
(
breath
''
stride
)
often
tangle
into
related
''
overlapping
periods
.
p
><
p
class
='
fragment
'>
Long
before
any
machine
measured
it
''
the
heartbeat
was
probably
humanity
'
s
first
unit
of
tempo
.
p
>
<
p
class
='
fragment
'>
Walking
is
periodic
too
:
dancers
and
gait
researchers
alike
call
its
frequency
<
strong
>
cadence
strong
>
—
steps
per
minute
.
A
relaxed
walk
sits
around
100
-
120
steps
/
min
''
roughly
1
.
7
-
2
Hz
.
p
><
p
class
='
fragment
'>
But
cadence
alone
doesn
'
t
tell
you
how
fast
someone
is
actually
travelling
.
A
tall
person
and
a
short
person
can
share
the
same
cadence
and
still
cover
very
different
distances
per
step
.
p
><
p
class
='
fragment
'>
Which
raises
the
question
underneath
this
whole
session
:
if
frequency
alone
isn
'
t
speed
''
what
else
is
needed
?
p
>
<
p
class
='
fragment
'>
Speed
is
frequency
multiplied
by
how
far
each
cycle
carries
you
—
its
<
strong
>
amplitude
strong
>''
or
in
gait
terms
''
the
<
strong
>
stride
length
strong
>.
p
><
p
class
='
fragment
'>
Sprinters
increase
both
:
a
faster
leg
-
cycle
frequency
<
em
>
and
em
>
a
longer
stride
.
Elite
sprinters
reach
cadences
above
4
-
5
steps
/
second
with
strides
over
two
metres
—
two
independent
quantities
''
frequency
and
amplitude
''
multiplying
into
genuinely
extreme
speed
.
p
><
p
class
='
fragment
'>
Keep
this
multiplication
in
mind
:
speed
=
frequency
×
amplitude
.
It
will
come
back
''
almost
unchanged
''
when
we
get
to
the
piano
.
p
>
<
p
class
='
fragment
'>
Remember
the
pendulum
:
a
longer
pendulum
swings
more
slowly
.
The
same
logic
applies
to
limbs
and
wings
''
which
behave
like
pendulums
built
out
of
muscle
and
bone
.
p
><
p
class
='
fragment
'>
A
short
limb
(
or
a
short
wing
)
is
a
„
short
pendulum
“
—
it
naturally
wants
to
oscillate
fast
.
A
long
limb
is
a
„
long
pendulum
“
—
it
naturally
wants
to
oscillate
slowly
.
p
><
p
class
='
fragment
'>
This
is
why
small
animals
move
in
a
blur
and
large
animals
move
almost
in
slow
motion
—
not
because
of
effort
''
but
because
of
size
itself
.
p
>
<
p
class
='
fragment
'>
A
hummingbird
'
s
wings
beat
around
50
times
per
second
(
50
Hz
)
—
fast
enough
to
hover
motionless
in
the
air
.
p
><
p
class
='
fragment
'>
A
housefly
'
s
wings
beat
even
faster
''
well
above
150
-
200
Hz
—
too
fast
for
the
human
eye
to
resolve
as
individual
strokes
.
p
><
p
class
='
fragment
'>
Contrast
that
with
an
albatross
''
gliding
on
wings
that
may
flap
barely
once
per
second
''
or
an
elephant
'
s
unhurried
gait
''
with
a
period
closer
to
two
full
seconds
per
step
.
p
><
p
class
='
fragment
'>
Same
physics
''
three
orders
of
magnitude
apart
—
purely
a
function
of
size
.
p
>
<
p
class
='
fragment
'>
A
piano
string
is
''
again
''
a
pendulum
in
disguise
—
just
a
vibrating
one
instead
of
a
swinging
one
.
p
><
p
class
='
fragment
'>
Short
''
thin
''
tightly
-
strung
strings
(
the
piano
'
s
high
notes
)
vibrate
at
a
high
frequency
.
Long
''
thick
''
loosely
-
strung
strings
(
the
low
notes
''
wound
in
copper
wire
)
vibrate
at
a
low
frequency
.
p
><
p
class
='
fragment
'><
strong
>
Short
and
light
vibrates
fast
;
long
and
heavy
vibrates
slow
strong
>
—
the
exact
same
rule
that
separated
a
hummingbird
'
s
wing
from
an
elephant
'
s
leg
.
p
>
<
p
class
='
fragment
'>
Music
names
the
same
quantity
differently
:
<
strong
>
tempo
strong
>''
measured
in
beats
per
minute
(
BPM
).
p
><
p
class
='
fragment
'>
A
tempo
of
120
BPM
means
one
beat
every
0
.
5
seconds
—
a
period
of
half
a
second
''
a
frequency
of
2
Hz
.
A
slow
adagio
at
60
BPM
is
a
1
-
second
period
''
exactly
the
frequency
of
a
resting
heartbeat
.
p
><
p
class
='
fragment
'>
Tempo
is
simply
frequency
wearing
a
musician
'
s
name
.
p
>
<
p
class
='
fragment
'><
strong
>
Entrainment
strong
>
is
what
happens
when
an
independent
periodic
body
—
a
footstep
''
a
heartbeat
''
a
swinging
arm
—
locks
its
own
frequency
onto
an
external
one
''
such
as
a
musical
beat
.
p
><
p
class
='
fragment
'>
This
is
most
of
what
dancing
<
em
>
is
em
>''
physically
:
a
body
voluntarily
tuning
its
many
natural
periods
—
stride
''
swing
''
sway
—
to
a
shared
external
frequency
.
p
><
p
class
='
fragment
'>
Which
means
a
dancer
'
s
movement
is
not
just
<
em
>
inspired
em
>
by
music
—
it
can
be
measured
''
cycle
for
cycle
''
against
it
.
p
>
<
p
class
='
fragment
'>
Measuring
a
heartbeat
or
a
pendulum
is
easy
.
Measuring
a
dancer
'
s
full
-
body
period
''
in
real
time
''
on
stage
''
is
not
—
which
is
exactly
the
technical
problem
this
course
is
named
after
.
p
><
p
class
='
fragment
'>
Modern
tools
attack
it
from
several
angles
:
wearable
accelerometers
(
measuring
acceleration
directly
)''
motion
-
capture
markers
''
and
camera
-
based
pose
estimation
(
tracking
joints
frame
by
frame
from
ordinary
video
).
p
><
p
class
='
fragment
'>
Each
gives
a
stream
of
numbers
over
time
—
a
position
''
a
velocity
—
from
which
period
''
frequency
and
amplitude
can
all
be
recovered
.
p
>
<
p
class
='
fragment
'>
Once
a
movement
'
s
frequency
is
captured
as
a
number
''
it
can
be
<
em
>
mapped
em
>
—
frequency
to
pitch
''
amplitude
to
volume
''
period
to
rhythm
—
onto
a
piano
''
real
or
sampled
.
p
><
p
class
='
fragment
'>
This
is
the
project
underneath
<
em
>
Dancing
Piano
em
>:
using
the
exact
physical
quantities
introduced
today
—
the
same
ones
that
separate
a
hummingbird
from
an
elephant
—
to
let
a
tracked
body
play
an
instrument
with
its
own
motion
.
p
><
p
class
='
fragment
'>
Every
session
from
here
builds
''
piece
by
piece
''
toward
that
pipeline
:
track
''
measure
''
map
''
sound
.
p
>
<
p
class
='
fragment
'>
Today
'
s
vocabulary
—
period
''
frequency
''
amplitude
''
speed
''
entrainment
—
is
the
physical
foundation
for
everything
that
follows
in
this
course
.
p
><
p
class
='
fragment
'>
Next
sessions
will
get
hands
-
on
with
the
tracking
side
:
how
to
actually
capture
a
body
'
s
movement
''
and
how
to
turn
the
resulting
numbers
into
music
.
p
><
p
class
='
fragment
'>
Before
then
:
notice
your
own
rhythms
this
week
—
your
stride
''
your
pulse
''
the
tempo
of
whatever
you
happen
to
be
dancing
to
.
p
>
[Impressum, Datenschutz, Login] Other subprojects of udk.ai linkring: teacher.solar fibel.digital refused.science gardens.digital baumhaus.digital