top of page
7.jpg

Apple Virtual Personal Trainer

This project focus on the ideal personal training experience in a home environment.

ROLE
Concept
Research
Illustration

DURATION
January-July 2021

INTRODUCTION

The project was done as part of my internship at Apple. The project focused on developing an innovative commercial use case for the Apple LiDAR scanner (embedded in the cameras of new Apple devices). After conducting pre-project rigorous research, we chose Fitness as the main domain for innovation.

How can the LiDAR contribute to the ideal training experience?


How can we utilize LIDAR accuracy to provide real-time instructions and feedback?
 

Which fitness domain will most benefit from this accuracy?

Frame 19.png

LiDAR

LiDAR (Light Detection and Ranging) is used to determine distance by measuring how long it takes light to reach an object and reflect back. The custom-designed LiDAR Scanner uses direct time of flight to measure reflected light from up to five meters away. It works at the photon level, operates at nanosecond speeds, and opens up tremendous possibilities.

RESEARCH

Frame 2_edited.png

Interviews

Frame 3_edited.png

Surveys

Frame 7_edited.png

Personas

Frame 10_edited.png

Thematic coding

Frame 9_edited.png

Desk research

Frame 8.png

Competitor Analysis

User emphaty map_edited.png

User empathy map

INTERVIEWS

After researching different fitness domains, we decided to focus on Pilates which requires a high level of precision that can be achieved by utilizing LiDAR’s accuracy capabilities. In addition, Mat Pilates is one of the most common practices in the USA today.

We conducted in-depth interviews with both trainers and trainees. We focused on experts trainers with 10+ years of experience in the Pilates domain and on American trainees who have experience in Pilates and online/digital training. Following the interviews, we conducted thematic coding in order to identify needs and pains.

Quote related to Posture accuracy, feedback & modifications

“I guess it's just the fact that there's no one to correct you and you have no one who could adjust you. Thank God I've had like a little bit of things that I knew that I wasn't positioned and I put too much pressure or whatever...because there's no one watching me”


Trainee 1, 23 YO

Quote related to Motivation

“...I get my motivation from the group, competitive feeling that helps me to get better results”





Trainee 3, 30 YO

SURVEY

We asked people to specify the pros and cons of each training method - personal vs. group.

Group 6911.png

84% of responders would prefer a personal trainer over a group training if both cost the same.
35% of responders mentioned pain management as a key motivator for practicing Pilates.

Group 6916.png

PERSONAS

Jessica
 

  • Woman, 28 years old

  • American, born & raised

  • Industrial engineer

  • MBA student

  • Practicing Pilates over the 3 months

  • Trains two times a week

  • Uses a training app at home

Jonathan

​​

  • Man, 50 years old

  • American, born & raised

  • Lawyer

  • Married + 3

  • Suffers from lower back pains as a result of an old injury

  • Practices Pilates over the past 6 years for pain management

  • Trains 3+ times a week at a Pilates studio

  • Practices in a group for motivation

EMPATHY MAP

SAY
 

  • Where should I train?

  • How long is this workout?

  • I’d like to stay motivated while workout at home on my own time

  • Which app should I use?

  • I don’t have much equipment

THINK
 

  • I wish I had more motivation

  • How should I to perform this exercise

  • I missed her last comment

  • My back hurts and I can’t do this exercise

  • Am I doing this right?

DO

​

  • Work out 3+ times a week in a studio

  • Download an app

  • Inaccurate performance of exercises

FEEL
 

  • Lack of motivation

  • Frustrated

  • Self doubt

  • Inconvenience

  • anxiety

  • Pain

  • Alone

COMPETITOR ANALYSIS

We conducted comprehensive research to map the competitive landscape. We covered not only fitness apps but also advanced reality apps that involve physical movement to determine our approach towards gamification.

Eventually, we divided the competitors into four buckets:

  1. Fitness mobile app that include a variety of workouts.

  2. Fitness app with posture scan using the phone/laptop camera - AI, image processing.

  3. Smart home gym devices.

  4. Advanced reality apps.

image 6.png
image 7.png

CONCEPT

A LiDAR based app that creates a personal training interaction experience at home.

AI, SIRI, and LiDAR leveraged into a virtual personal trainer at home.
AI and Siri operate as the Brain and the trainer's voice, while the LiDAR sensor scans the trainee from all angles as if it was the trainer's eyes.

The system communicates with the trainee as if it was a real trainer standing right next to them.

The system allows the user to connect all of their Apple devices to get the best training experience.

01/05 Top insights
A TWO-SIDED DIALOGUE

One of the most strong themes from our research was the trainee’s dialogue with his trainer.

This interaction does not exist while working out at home. So we have decided to focus on designing an interaction that allows the trainee to communicate with the system using voice and also through simple body gestures (body language).

13.jpg

02/05 Top insights
REAL-TIME CONGRUENT & 360 FEEDBACK

It came up in our interviews that in Pilates it is most essential when the trainer walks around the trainee to see his posture from all angles. Therefore, we designed the system to:

  • Maximizes accuracy by providing real-time feedback and correct form display according to the trainee’s 3D scan.

  • Provide the most accurate feedback as if a trainer was physically in the room.

  • Provides the user a 360 full body view.

ezgif.com-gif-maker (20).gif

03/05 Top insights

FOLLOW UP RECOMMENDATIONS

The third insight that we have generated is about the importance for the trainee to get advice from his trainer and set new goals.
Therefore, we designed the system to provide new goals recommendations to trainees based on their posture and performance.

22.jpg

04/05 Top insights

REAL-TIME MODIFICATIONS

Many trainees have noted that the personal feedback that is adjusted to their abilities/disabilities during workouts is a critical issue for the training experience.

Therefore our system will provide modifications according to the trainees' physical condition and request.

ezgif.com-gif-maker (34).gif

05/05 Top insights

MOTIVATION ENCOURAGEMENT

From our research, we identified that group training contributes to trainees’ motivation and makes them achieve better results.
Therefore, our system enables joint training that includes competitive elements to enjoy a shared training experience.

ezgif.com-gif-maker (31).gif

TAKEAWAYS

Working with Apple was one of the most exciting and precise experiences I had. The project included in-depth research and many iterations to the point that, in my opinion, also reflects Apple's core values - providing intuitive and simple solutions to complex problems. I enjoyed working on an innovative and valuable project. Working with the Apple team, Shira Goren, and Dr. Ayelet Segal was fruitful and fascinating. I loved working with a group of people who always asked questions and put the person at the center. To my great joy, the project exceeded expectations, and so it was decided to continue developing it.

bottom of page