While collecting pain points from Ekoo users, we uncovered an intriguing issue.

Many individuals find manipulating 3D models with a mouse and keyboard to be imprecise and complex. They struggle to accurately map the data for rotation and scaling with the movement of the mouse. Moreover, due to the complexity of shortcuts, particularly when working online, there is overlap between keyboard commands in modeling software and video conferencing tools, causing frustration for users (e.g., the spacebar serving both as a scaling command and a mute/unmute command).Consequently, we anticipate that users in the future will likely desire a solution where 3D space can be controlled through gestures.

However, determining how to naturally design gesture interactions to minimize user learning costs and align with psychological models poses a challenge.

This was my first time developing gesture controls, so writing the code was a bit challenging for me. Throughout this project, I acquired the skills to implement function calculations and conduct precise joint-level checks, enhancing my ability to finely control user interactions.