Hello! Last week, we were working towards progress in each of our domains within the project.

This week, we are working on compiling what we have so far in order to present for prototype day. Our tentative plan for prototype day is to present our skeleton site on a kiosk-style interface while also collecting data for our machine learning model for gesture recognition. We are hoping to gain information on both the interface of our web application as well as the intuitiveness of our gesture control dictionary. The goal of our project is to create a new and exciting user interface and in order to complete this, the interface must first be an enjoyable experience.

After creating this prototype plan, Gearware got to work on making progress towards our prototype. In terms of the website, we are now able to host the site locally via websockets. The diagram below demonstrates the changes to our original idea and how the site will now communicate.

In terms of gesture control, the script now is able to output the frame in which the hand was detected into a text file as well as save each frame as a .jpg image. For viewing 3D files, we are now able to view them via a React App which we hope to integrate in time with the rest of the web application for prototype day.

Next week, we plan on working to get each of our domains’ desired functionality ready by prototype day. We are excited to get feedback from the judges in order to best continue our project!