WEBVTT

00:00:00.000 --> 00:00:00.960 align:middle line:90%


00:00:00.960 --> 00:00:04.430 align:middle line:84%
Hello, in this video, we will
look at mobile technologies

00:00:04.430 --> 00:00:08.750 align:middle line:84%
for studying music
and body motion.

00:00:08.750 --> 00:00:10.310 align:middle line:84%
In the laboratory
setting, we are

00:00:10.310 --> 00:00:15.240 align:middle line:84%
able to use highly advanced
infrared optical motion capture

00:00:15.240 --> 00:00:17.930 align:middle line:84%
systems to study,
very precisely,

00:00:17.930 --> 00:00:20.310 align:middle line:90%
how people move to music.

00:00:20.310 --> 00:00:23.660 align:middle line:84%
But, sometimes, we need
to go outside the lab

00:00:23.660 --> 00:00:26.790 align:middle line:84%
and study how people
move in the real world,

00:00:26.790 --> 00:00:31.330 align:middle line:84%
how people move while listening
to music on the metro,

00:00:31.330 --> 00:00:34.900 align:middle line:84%
on the bus, or in
the dance club.

00:00:34.900 --> 00:00:37.430 align:middle line:84%
For this reason, we
need to have some sort

00:00:37.430 --> 00:00:43.360 align:middle line:84%
of mobile technology for
studying music and body motion.

00:00:43.360 --> 00:00:45.270 align:middle line:84%
In front of me, I have
a couple of examples

00:00:45.270 --> 00:00:47.270 align:middle line:90%
of such technologies.

00:00:47.270 --> 00:00:49.060 align:middle line:84%
One of the advantages
of this system

00:00:49.060 --> 00:00:51.680 align:middle line:84%
is that it can be
very, very small,

00:00:51.680 --> 00:00:54.520 align:middle line:90%
such as this accelerometer.

00:00:54.520 --> 00:00:58.270 align:middle line:84%
Imagine studying body
motion in a dance club

00:00:58.270 --> 00:01:00.930 align:middle line:84%
where you can put this in
the pocket of every dancer

00:01:00.930 --> 00:01:04.180 align:middle line:84%
in the club, and you get
some data on how they move

00:01:04.180 --> 00:01:07.400 align:middle line:84%
and can see how this
relates to the music

00:01:07.400 --> 00:01:11.730 align:middle line:84%
and how they compare
to each other.

00:01:11.730 --> 00:01:16.010 align:middle line:84%
Accelerometers and gyroscopes
and also magnetometers

00:01:16.010 --> 00:01:19.200 align:middle line:84%
are inside every--
basically, at least

00:01:19.200 --> 00:01:22.170 align:middle line:90%
every mobile phone these days.

00:01:22.170 --> 00:01:26.920 align:middle line:84%
So everybody, in practise,
has their own motion capture

00:01:26.920 --> 00:01:31.460 align:middle line:84%
technology that
they carry around.

00:01:31.460 --> 00:01:33.580 align:middle line:84%
More specialised
systems also exist,

00:01:33.580 --> 00:01:39.500 align:middle line:84%
such as this bracelet which
contains a sensor that measure

00:01:39.500 --> 00:01:44.270 align:middle line:84%
muscle tension, in addition to
the accelerometer and gyroscope

00:01:44.270 --> 00:01:49.450 align:middle line:84%
that lets you measure the
direction of the bracelet

00:01:49.450 --> 00:01:55.570 align:middle line:84%
and also how fast it
accelerates, like this.

00:01:55.570 --> 00:01:58.660 align:middle line:84%
So it will tell you
which direction I point

00:01:58.660 --> 00:02:02.610 align:middle line:84%
and how I turned my hand
because of the muscle sensors.

00:02:02.610 --> 00:02:06.730 align:middle line:90%


00:02:06.730 --> 00:02:11.780 align:middle line:84%
This suit is a motion capture
suit from Accents Technologies.

00:02:11.780 --> 00:02:17.040 align:middle line:84%
It contains 17 of
these orange sensors

00:02:17.040 --> 00:02:19.310 align:middle line:84%
and, inside each
of these, there's

00:02:19.310 --> 00:02:25.280 align:middle line:84%
a magnetometer and
gyroscope and accelerometer,

00:02:25.280 --> 00:02:28.360 align:middle line:84%
which measures inertia
and acceleration

00:02:28.360 --> 00:02:34.350 align:middle line:84%
and the magnetic flux,
or basically a compass.

00:02:34.350 --> 00:02:39.530 align:middle line:84%
Combining 17 of the sensors
with a model of a human body,

00:02:39.530 --> 00:02:43.310 align:middle line:84%
saying that, for instance,
this sensor and this sensor

00:02:43.310 --> 00:02:47.170 align:middle line:84%
can't move further apart
than this and this sensor

00:02:47.170 --> 00:02:50.940 align:middle line:84%
and this sensor can
only move in this angle,

00:02:50.940 --> 00:02:54.690 align:middle line:84%
it's possible to get
an estimation of how

00:02:54.690 --> 00:03:00.380 align:middle line:84%
the pose of the
person is at any time.

00:03:00.380 --> 00:03:04.160 align:middle line:84%
And the result you get
is quite good, actually,

00:03:04.160 --> 00:03:07.060 align:middle line:84%
from thinking that this is--
this type of technology,

00:03:07.060 --> 00:03:09.660 align:middle line:90%
there are no cameras involved.

00:03:09.660 --> 00:03:13.980 align:middle line:84%
The system is portable with
two cylinders, like this.

00:03:13.980 --> 00:03:17.850 align:middle line:84%
And it's possible
to move quite far

00:03:17.850 --> 00:03:23.300 align:middle line:84%
away from the transmitter, which
is right next to our computer.

00:03:23.300 --> 00:03:27.240 align:middle line:84%
So looking at the screen
now, my head is upright

00:03:27.240 --> 00:03:29.450 align:middle line:84%
and the avatar is
following my movements.

00:03:29.450 --> 00:03:32.550 align:middle line:84%
We tested it up to 50
metres without problems.

00:03:32.550 --> 00:03:35.400 align:middle line:90%


00:03:35.400 --> 00:03:38.930 align:middle line:84%
The one small problem with this
system is that it's drifting,

00:03:38.930 --> 00:03:42.460 align:middle line:84%
so if you move around a lot
and go back to the same place,

00:03:42.460 --> 00:03:46.950 align:middle line:84%
you will possibly have a
result that diverges slightly.

00:03:46.950 --> 00:03:52.570 align:middle line:84%
And also, it's not able to
give you millimetre position,

00:03:52.570 --> 00:03:55.910 align:middle line:84%
like you get in the
optical systems.

00:03:55.910 --> 00:04:01.090 align:middle line:84%
Still, it's remarkably good
and absolutely a good way

00:04:01.090 --> 00:04:03.980 align:middle line:90%
of measuring body movement.

00:04:03.980 --> 00:04:06.560 align:middle line:84%
What you can see here is that
there's quite a lot of cables,

00:04:06.560 --> 00:04:11.560 align:middle line:84%
so using it in, for instance
a stage performance,

00:04:11.560 --> 00:04:14.995 align:middle line:84%
requires that you are
aware of your system.

00:04:14.995 --> 00:04:17.310 align:middle line:84%
And you will not be
able to move as freely

00:04:17.310 --> 00:04:19.116 align:middle line:90%
as without the system.

00:04:19.116 --> 00:04:22.029 align:middle line:84%
But we've used it in
several performances,

00:04:22.029 --> 00:04:26.160 align:middle line:84%
and you can use it as
a DJ to control DJ sets

00:04:26.160 --> 00:04:28.130 align:middle line:90%
or as a musical instrument.

00:04:28.130 --> 00:04:30.580 align:middle line:90%
[PLAYING GUITAR]

00:04:30.580 --> 00:04:47.595 align:middle line:90%