Contactless Jigsaw Puzzle
Gesture-controlled assistive game for children with ASD
Overview
A gesture-controlled tangram game developed for children with autism spectrum disorder (ASD) at La Cañada High School in Valencia, Spain. Built in Unity using Leap Motion, the project explored how contactless interaction could support structured learning, spatial reasoning, and motor coordination in a special educational environment.
Outcome
The final system was deployed on both Windows and Android platforms and tested with children and teachers at La Cañada. Beyond gameplay itself, the project became an exploration of accessibility-focused interaction design — balancing technical precision, usability, and cognitive accessibility within a real classroom setting.
Contactless control
Designed during the Covid-19 pandemic, the game used Leap Motion to let children play without touching a screen, mouse, or shared device. The child moves puzzle pieces through hand gestures, making the interaction both more hygienic and more physically engaging.
Software design
The application was structured as a layered Unity system, separating interface control, game logic, Leap Motion input, validation, persistent records, and teacher-facing analysis. This made the project easier to test, extend, and deploy across both Windows and Android versions.
Interaction flow
The application was designed around two user groups: children interacting with the game, and teachers monitoring progression and performance. The system supported multiple interaction methods — gesture, touchscreen, and mouse input — while maintaining a consistent gameplay structure across platforms.
Playful UI
The interface was built around clear visual guidance: selecting difficulty, solving puzzles, receiving immediate feedback, and progressing through levels. The game included both copy and memory modes, allowing the same puzzle system to support visual matching, recall, and spatial reasoning.
Accessibility starts with interaction.
Source code and documentation
The Unity project source files, setup notes, screenshots, and platform-specific instructions are available on GitHub.
View GitHub repository →Playable builds
Final Android and Windows builds are provided through GitHub Releases. The Android version uses touch input, and the Windows version supports Leap Motion interaction.
Download builds →