AudioMove

Guiding users with limb motion exercises can assist them in their physical recovery and muscle training. However, traditional visual tracking methods often require multiple camera angles to help the user understand their movements and require the user to be within the range of the screen. This is not effective for more ubiquitous situations. Therefore, we propose a method that uses spatial audio to guide the user with a multiple-directional limb motion exercise. Depending on the user’s perception of spatial audio’s direction, we designed feedback to help the user adjust the movement height and complete the move to the designated position. We use a smartphone attached to the body limb to capture the user’s movement data and generate feedback. To better support using spatial audio for limb motion guiding, we also developed the method to fuse the spatial audio with the limb’s motion data. Users could hear the audio direction change by rotating their body limbs to increase the dynamic variations. The experiment showed that with our designed method user could conduct the multiple-directional limb exercise to the designated position. And using the method of spatial audio fusing motion data could help users to locate the direction better. The spatial audio-based limb’s motion exercise system could create a natural, pervasive, and non-visual exercise training system in daily life.