Gestures for Sky TV

Sky Glass brings Sky Q, Sky Broadband and streaming services into a single product experience. Ahead of the gesture control kit launch, I prototyped and tested gesture interactions for controlling the TV, playing games and supporting fitness-led experiences.

Using neural networks and computer vision, I built a pilot system that could recognise a user's gestures and translate them into TV commands. I worked closely with designers and developers to make the interaction model feel learnable, reliable and easy to use.

Python, TensorFlow and Google ML Kit for recognition and experimentation, with React and Node.js supporting prototype interfaces and tooling.