Teaching A Robot To Dance With Kaaya’s Holosuit

But there are more interesting uses for this full-body motion capture suit.
 
At the 2018 Augmented World Expo, tucked away at the back of the Santa Clara Convention Center, a very small robot was learning to dance. I know so because I was the one teaching it, simply by flailing my limbs around and having it mirror my movements. I was literally doing the robot.
 
This was all happening because of a (slightly-too-small) jacket on my back called the HoloSuit, which was covered in sensors. These sensors tracked every movement and relayed that information to a tiny robot stood nearby, doing its best to pop and groove in time.
 
The HoloSuit, created by Kaaya Tech, is actually three bits of clothing that can be worn separately or combined: a jacket, some gloves and a pair of pants. There are two versions of the full-body suit, one with 26 sensors and a more high-end version with a total of 36 sensors scattered across the jacket gloves and pants. Even 26 is a lot when you compare it to other motion capture bodysuits; 36 should make for some pretty incredible precision.
 
Both suits also have nine haptic feedback sensors, and buttons on the hands, opening up a host of other possibilities beyond motion capture.
 
For example, Kaaya CEO Harsha Kikkeri showed me a video animation of someone in a submarine launching torpedoes at an unseen enemy. Going from dancing robots to literal war was quite an escalation, but it illustrated the varied spectrum of possible use cases. It’s not easy to train inside submarines, but the HoloSuit could be a way to simulate that environment, training people as if they were helming a sub beneath the depths.

,

,

Or, it could be used to improve your golf swing. The suit could essentially replace a coach, using haptic signals to shake out your bad habits. As Kikkeri explained, you could then take the suit to the golf course and have it track your performance, giving you insight into your performance after.
 
It may find a use for manual labor jobs to alert employees when they’re putting themselves in physical danger – or maybe for controlling robots sent into burning buildings. There are a lot of possibilities, including plenty of applications in VR and AR. Immediately I thought about using this as a full-body virtual reality controller.

,

 

Source: Wareable

more insights