This week, Gearware worked on modifying and developing our existing and new code. On the web application domain, we worked on incorporating the new UI design to the website as well as creating the tutorial interface. These components are over halfway complete and hope to have it finished within the next week.
In terms of the gesture control domain, we worked on implementing the current scripts into JavaScript from Python. This allowed to incorporate the gestures being recognized within a React app, which will be very beneficial in the future for integration. Our plan is to continue to optimize the current algorithm by revamping to include calculation of angles in order to determine intent of direction.
This week, Gearware was working to prep for and present our QRB1 to our panel of judges. For this presentation, we showcased what we had accomplished thus far. We showcased our mockups for a new UI design for the webpage as well as the inclusion of a tutorial to aid users to use the gesture controlled input system. We also demonstrated a couple of static gestures working as input with the web application. We also showcased plans for the dynamic gestures, a tentative deadline of deliverables, and associated risks. We received great feedback from the panel and plan to incorporate their responses into our development.
Next week, we plan on continuing development within the UI and gesture recognition. Our goal is to incorporate the dynamic gestures with the web application as well as implement the UI changes to the web app. We hope to finish this early next week to stay inline with our project goals.
This week, Gearware was back to work with our project for Fanatics! We prioritized creating a burndown chart for the rest semester. This allowed us to get a perspective on what was needed to be completed and what the estimated time will be for each task. We are planning on adopting an agile methodology for the remainder of the project development lifestyle. This will allow us to be flexible while we are developing.
Next week, is the QRB 1 event and we plan on putting together what we have done so far in order to get valuable feedback from our panel. We plan on preparing for questions they may have and are excited to present!
Welcome back to the Spring Semester! This week, Gearware got back into the swing of things by revisiting what was accomplished last semester and presenting this to class. From here, we plan on creating a sprint track and a burndown chart of what needs to be completed this semester. We are excited to continue development and create a new and exciting product for our sponsor!
SLDR Day! From left to right, Dr. Silva (faculty coach), Ben (engineering liaison), Katie, Sean, Austin, Cameron, and Robert
This week, Gearware had the pleasure of presenting our System Level Design Review to our sponsor, Fanatics. The SLDR event was hosted at our very own Reitz Union on December 7th, 2021. At this event, we had food and keynote speakers but most of all we had the ability to showcase what we have accomplished thus far in the IPPD program. Overall, the presentation went very well with our sponsors and we received valuable feedback on current progress as well as suggestions for future project implementation and development.
Next semester, Gearware will be focusing more on switching our algorithmic approach to a machine learning model for our gesture control. In addition, we will also be focusing more on the 3D models and their rendering. We plan on taking a break due to the upcoming winter break but plan to reconvene at the beginning of next semester. Gearware is excited to see what the future holds for our project! We will see you in 2022!
This past week, we worked on putting together our System Level Design Review presentation for our peers. We compiled the work we have done thus far as well as the results from prototype day. We received great feedback from our peers that we can apply for our presentation next week with our sponsors.
Overall, the feedback was much more positive than from PDR day, specifically our group’s presentation skills. We plan on incorporating the additional feedback on the content of our presentation (i.e. graphs and figures) for the official SLDR next week. We are excited to present to our sponsors next week!
This week, we presented our prototype to the faculty and staff to gain feedback on our project thus far. We split our demonstration into two parts to get as much feedback on gesture control and our website’s UI. This was a great way to receive feedback on both and helped with the flow of the presentation. We received great feedback and comments in regards to both which will greatly help with our project plans going forth. We decided to revisit some of the gesture commands and UI elements to make them more intuitive for users.
Gesture Control Demo
Website Demo
Gearware’s Demonstration
The next event is the System Level Design Review and Gearware plans on taking the feedback gathered during Prototype Day in preparation for SLDR. We are also making plans of what needs to be accomplished going forth for the rest of the project’s duration.
Last week, we created tentative plans for prototype day on the 16th. We finalized these plans this week and aim to use our time during prototype day to get valuable feedback on the user experience of our website. In addition, we plan on recording data while at the event to be used to train our machine learning model.
This week, we have been working on making progress on each of our domains to have ready to demonstrate for prototype day. We were able to get the 3D model viewer with the designated file type as well as change the appearance of the models using materials. In addition, we have been making progress with gesture control in order to print to console the direction of motion utilizing landmarks to calculate distance. We also finished the user login system for both the front and back ends.
Next week and this weekend, we will be finalizing our plans for the prototype and putting the finishing touches on our prototype. We plan to put together surveys to use during the prototype day to gain the judges’ feedback as well as fix last-minute bugs. We are excited to present next week!
Hello! Last week, we were working towards progress in each of our domains within the project.
This week, we are working on compiling what we have so far in order to present for prototype day. Our tentative plan for prototype day is to present our skeleton site on a kiosk-style interface while also collecting data for our machine learning model for gesture recognition. We are hoping to gain information on both the interface of our web application as well as the intuitiveness of our gesture control dictionary. The goal of our project is to create a new and exciting user interface and in order to complete this, the interface must first be an enjoyable experience.
After creating this prototype plan, Gearware got to work on making progress towards our prototype. In terms of the website, we are now able to host the site locally via websockets. The diagram below demonstrates the changes to our original idea and how the site will now communicate.
In terms of gesture control, the script now is able to output the frame in which the hand was detected into a text file as well as save each frame as a .jpg image. For viewing 3D files, we are now able to view them via a React App which we hope to integrate in time with the rest of the web application for prototype day.
Next week, we plan on working to get each of our domains’ desired functionality ready by prototype day. We are excited to get feedback from the judges in order to best continue our project!
Last week, we presented our PDR presentation for our liaison and other members of Fanatics. We received great feedback that we will take into account during the development of our project.
This week, Gearware was back to work on the technical aspects of our project. We have been working on improving the efficiency of our lazy loading scroll for our application as well as finishing the site skeleton. In addition, we also were able to work on our 3D web viewer for our 3D artifacts
In terms of gesture control, we modified our previous script to now capture coordinate positions through a live video feed. From this, we outputted the coordinates of the 21 positions of the hand into a text file where each frame is captured on each new line. A picture of the result of the program is showcased on the left.
MediaPipe Demo
Next week, we plan to work towards developing our prototype by developing each of our domains more as well as finalizing what to present during prototype day.
