Gesture Based Video Game Control with leap motion

Creating more accessible interactions for video game control via leapmotion hand controller  

Role: Software Developer

Technologies/Skills:  Leap Motion, Latte Panda SBC, USB Dongle, C

Technical Report: Gesture-Based Video Game Control

For a final project in my Operating Systems class, my team and I took our project in a more human centered direction, centering on accessibility and design. We created an intuitive, gesture-based video game controller for Xbox games to make the layout more efficient and accessible to new players, players with small hands, and players with limited hand motion. I built the design, use cases, technical documentation, and D-pad functionality, while learning about and building out the hardware components with my team. ​​​​​​​

The questions that drove our work included: Can we seamlessly link game control to body-based data input, rather than requiring users to inefficiently conform to bulky controllers? Can we make game play more efficient through intuitive design? How might we remove limitations to gaming accessibility and learning to promote inclusivity in technology?

We utilized a Leap Motion Hand Sensor, a USB dongle and a Latte Panda single board computer, alongside several other components to create a highly customizable and clean interactive experience.