Blog Posts

Blind User Scene Updates

Hello to our readers! Welcome back, and we hope your week has been going well!

This week, Team Wayfinder has been working hard on our prototype, and although things are still very basic, we are proud to have been able to add some key functionalities to our blind user scene in Unity! Some new implementations are the core navigation menu that the user will be interacting with, as well as an updating list of objects that are surrounding the user within a certain radius. By using specific buttons, the user can navigate through the list and select an object to move towards, step by step. Once the user as reached the object chosen, they will be notified of their arrival.

Another important update: with help from the Disability Resource Center and Disability Ambassadors at UF, Team Wayfinder is finally able to speak with and gain some valuable insight from several blind or visually students on campus! We hope to learn lots from them and continue to work with any interested students throughout the semester.

For next week, the team hopes to be able to integrate a working Text-to-Speech system within the scene and continue to resolve issues that have been noted in the Github; some of these include bugs with the updating object list, tweaking the filtering/naming of the objects in the list, and adding some anchor points for improved user navigation. In addition, we aim to continue interviewing students who have been scheduled for next week, so stay tuned for any updates!

First Prototype in Progress

Hello everyone!

It is finally time for PDR presentations! This week, Team Wayfinder delivered a successful PDR presentation to our team coach and liaison, and received valuable feedback toward our project to implement and improve upon. The team was also able present the completed Unity 3D scene for sighted user use, which includes basic user tasks that will be used in testing and that is engaging for the sighted user, and our requirements document that will help guide the team for the rest of the semester.

The team plans for the upcoming week to begin development on the navigation menu and the various mechanisms that will be used for blind user use, laying out specific tasks for the team in JIRA for the next two weeks and necessary user stories and details.

Peer Reviews and Dinner

This week, we had our Preliminary Design Review (PDR) presentations during class and presented it to our peers for commentary and evaluation. This is the first draft of our PDR, so with the feedback that we receive from our peers and coach, we hope to be able to improve and work on it for our final PDR presentation to our liaison next week.

The 3D Unity environment and the Github repository has also been set up this week and the team has begun development on the scene and user tasks for our first initial prototype. The team aims to continue development and adding navigation mechanics for blind users once the main scene and objects have been added for the user tasks that will be performed during testing.

Finally, the team had the pleasure to meet our liaison in person for our weekly meeting and have a dinner together downtown! Below is a picture of our whole team, including our coach Ronnie, and our liaison Sriram. Through the meeting, we were able to narrow down our scope even further and plan to create a document that includes specifically the needs and requirements of user needs and the prototype for the following week.

Team Wayfinder gets dinner at If It Is! From left to right: Coach Ronnie, Sriram, Yiru, Vivian, Kaceja, Sam

Getting Back on Track

Hello and welcome back!

We hope everyone has been able to safely reconnect with friends and family, and send all in the path of Ian our best wishes a quick and smooth recovery.

This week, our team was able to get in contact with the director of the Disability Resource Center (DRC) at UF and send out a brief email to any blind or low vision students who would be interested in speaking with us. We look forward to getting responses and hope to interview several students in the upcoming weeks.

During some of our team meetings this week, we noticed that our discussions started to loop around in circles, revolving around a core question of exactly what our project scope was, especially in the use case or application our product would primarily focus on. As our project is heavily researched based, understanding the direction and setting a clear path for ourselves is very important in the long run. We considered various topics such as input systems, what defined VR applications vs. normal desktop apps or 3D games, and the possible inclusion of a headset or other controllers. We also brainstormed and drafted up several product architecture ideas, but without a concrete grasp of our project and scope, everything was still very abstract.

After meeting with our coach and liaison, however, we realized that we were thinking too much and not physically creating anything – in other words, we were making assumptions without any actual feedback or validation from our target users and testing of our prototype. Thus, for the next week, our team has set out specific tasks and deliverables and aim to first create a simple 3D space in Unity with a couple basic user tasks that we can present to students and get feedback from.

Hurricane Update

Hello readers!

We hope everyone is staying safe and dry in these tough and stressful times, and send our thoughts and prayers to all friends and family in the path of Hurricane Ian. Unfortunately, there are no major updates regarding our project this week with campus being closed due to the storm, but we hope to regroup and get back on track in the next few weeks.

On a lighter note, here is a picture from the IPPD White Belt Sigma workshop last Saturday! We had a lot of fun learning and bonding as a team.

Team Wayfinder! From left to right: Kaceja, Sam, Yiru, Vivian

Exploration and Brainstorm

This week we researched more into user needs and wants and how to reflect those needs and wants into our navigation mechanism. The main idea we came up with was the anchor point navigation mechanism: a graph-based architecture that connects information in the virtual environment, allowing users to explore and navigate more easily. Additionally, we explored existing solutions on how to make VR environments and games accessible. In the upcoming week, we will explore and expand upon more of these concepts and solutions. We will also contact authors and developers of the existing accessibility solutions to learn more.

After exploring different VR engines and platforms, such as Mozilla Hub, we decided to use the Unity game engine to build our initial proof of concepts. Shown on the right is the initial Unity Scene we would build upon to make it accessible to blind users. Starting next week, we will start getting more familiar with Unity. After that, we will start exploring ways to translate sensory inputs that are not accessible to blind users to be user accessible.

Finding Our Way

Wayfinder’s Team Logo

Hello and welcome back to our blog!

Some new updates for this week: we have finally chosen a name for our team and our team logo! Our team name is now officially Wayfinder!

More importantly – this past Wednesday, we had the pleasure of meeting with a blind engineer from Freedom Scientific. He was able to provide us with extremely insightful information regarding the navigation of the JAWS screen reader, his experiences with vision loss and blindness as a software developer, and several challenges that he and many other screen users face on a day-to-day basis. Following this meeting, we conducted some research on existing desktop VR/XR/AR applications that we might be able to use, and was able to come up with several back-of-the-napkin ideas.

At our weekly liaison meeting, we presented some of these ideas and were able to receive a lot of feedback. We also had the chance to speak with another blind software engineer working at Freedom Scientific, who provided us with valuable information and pointers to keep in mind. From this meeting, we were able to gain a deeper understanding of our project and narrow down the scope of it, as well as set out tasks and responsibilities for the upcoming week.

Welcome!

Hello and welcome to our first blog post! We are a team of four students at the University of Florida working with Freedom Scientific, and the goal of our project is to create a navigation tool to make XR/VR/AR applications accessible to the visually impaired.

This week, we’ve just started getting to know each other and have had our first meetings with our team coach and liaison. We plan to start researching and exploring various AR frameworks next week, laying down a foundation and important plans to guide us through the semester.

Team Members:

  • Sam Blau – 4th year Computer Science
  • Kaceja Calder – 4th year Computer Science
  • Yiru Mu – 4th year Biomedical Engineering
  • Vivian Sung – 4th year Computer Science

Sponsor: Freedom Scientific

Coach: Rong Zhang