Blog Posts
WEEK #30: EchoPilot Finale~
EchoPilot here!
This week marked the culmination of our efforts as the team presented our Final Design Review (FDR) after extensive preparation. The day comprised four key events: a demonstration for our liaisons, a keynote address and recognition for the best IPPD team presentation, group presentations during the FDR, and an open-to-the-public showcase of our prototype.
The highlight undoubtedly was the group FDR presentation, representing our final opportunity to share our progress with those who have guided and supported us throughout this journey. It was a resounding success, with the team effectively showcasing every aspect of our work.
The open showcase was equally thrilling, as it attracted new faces eager to learn about our project. Not only did we relish the chance to present to them, but their verbal feedback underscored the project’s significance and its positive social impact.
As our journey comes to a close, we extend heartfelt gratitude to everyone who has been part of our adventure. Special thanks to our coach, Dr. Catia Silva, our liaison Sriram Ramanathan from Freedom Scientific, IPPD Director Dr. Edward Latorre-Navarro, and the entire IPPD Staff and Faculty for their unwavering support and the opportunity they provided us. Thank you all for following our progress. With that, EchoPilot bids farewell, signing off with gratitude and pride!
WEEK #29: Final Stretch
Welcome back, EchoPilot enthusiasts! It’s time for another exciting update on our journey towards creating a revolutionary tool for enhancing JAWS navigation for the visually impaired. In this blog post, we’ll dive into our recent accomplishments, focusing on our progress towards the Final Design Review (FDR).
FDR Report Draft Completed
We’re thrilled to announce that we’ve completed the rough draft of our FDR Report, a crucial milestone in our project’s development. This comprehensive report outlines our project’s objectives, methodologies, and findings, providing a detailed overview of our progress thus far. We’ve submitted the draft to Canvas and our coach for review, eagerly anticipating their feedback to further refine our work.
Refining Our FDR Poster
In response to valuable feedback received, we’ve diligently restructured our team’s FDR poster to better frame the scope of our project. This revision ensures that our poster effectively communicates the significance of EchoPilot and highlights its innovative features. We’re committed to ensuring that our poster accurately reflects the impact and potential of our prototype.
Video Editing Underway
Our collaboration with our company liaison has yielded valuable insights, prompting us to embark on the re-editing of our team’s video. We’re incorporating feedback to enhance the clarity and impact of our video, ensuring that it effectively showcases EchoPilot’s capabilities and benefits. Stay tuned for an improved and engaging video presentation coming soon!
Crafting FDR Presentation Slides
We’ve taken significant strides in crafting our FDR presentation slides, creating a rough draft to outline key points and insights. To ensure the effectiveness of our presentation, we’ve engaged in thorough reviews with Sriram, welcoming his feedback and suggestions for improvement. These collaborative efforts are instrumental in refining our presentation and effectively conveying our project’s goals and achievements.
Presenting and Reflecting
Recently, we had the opportunity to present our FDR presentation slides to our classmates, receiving valuable feedback and insights. We deeply appreciate the constructive criticism and suggestions provided, which will inform our efforts to further enhance our presentation and address any areas for improvement.
As we continue to progress towards the FDR milestone, we’re energized by the momentum and support driving our project forward. Stay tuned for more updates as we strive to bring EchoPilot to new heights of innovation and accessibility!
WEEK #28: Road to FDR
Welcome back to another update from EchoPilot!
We’ve been hard at work, and we’re thrilled to share our recent accomplishments as we continue to refine our project and push towards our goals. Let’s dive right in!
Prototype Showcase and Insights
Our journey towards refining EchoPilot took a significant step forward as we created a draft video for an upcoming in-class review. This video offers a comprehensive overview of our project, highlighting the problem we’re addressing, our innovative solution, and a glimpse into our prototype in action. We’re eager to gather feedback from our peers and further refine this presentation.
Project Visibility and Feedback
In addition to the draft video, we’ve also crafted a draft poster showcasing our project for display at the Final Design Review (FDR). Drawing on insights from our fellow classmates, we’ve received valuable feedback to ensure our poster effectively communicates the essence of EchoPilot and its impact.
Progress on FDR Report
As we gear up for the Final Design Review, we’ve commenced work on the FDR Report draft. This involved dividing volumes among team members and initiating the writing process for each section. By collaboratively tackling this comprehensive report, we aim to provide a detailed account of our project’s development and future prospects.
Enhancing Code Readability and Documentation
To streamline our project’s development process, we’ve implemented code documentation as docstrings. This not only improves code readability but also facilitates the creation of a comprehensive README file, making it easier for others to understand and contribute to our project.
Exploring Future Improvements
Looking ahead, we’re not only focused on the present state of EchoPilot but also on its future potential. As part of the FDR report, we’re delving into avenues for future improvement, such as exploring a Self-Querying architecture and implementing redundant chunking. By advising stakeholders like Freedom Scientific on these potential enhancements, we aim to contribute to the ongoing evolution of assistive technologies for the visually impaired.
With each accomplishment, we’re one step closer to realizing our vision of making JAWS navigation more accessible and intuitive for visually impaired individuals. Stay tuned for more updates as we continue to innovate and refine EchoPilot!
WEEK #27: PID Showcase and Final Stretch Preparations
Welcome back, EchoPilot here!
In this update, we dive into our recent showcase at the Prototype Inspection Day (PID), where we unveiled how our prototype elevates JAWS navigation for visually impaired users. Join us as we explore feedback insights, collaboration updates with the DRC, and advancements in our testing suite.
Prototype Showcase and Insights
During the PID, our team conducted two simulations to showcase how our prototype enhances JAWS navigation for visually impaired users. In the first simulation, judges experienced a scenario emulating the navigation challenges faced by visually impaired users relying on JAWS. Here they completed tasks using only keyboard navigation, similar to how a blind user would operate a computer. In the subsequent stage, the judges were permitted to use EchoPilot to assist them in completing the tasks, replicating the support that our prototype offers in real-world scenarios.
In the initial stage, challenges emerged, including the need to identify the operating system and difficulties in navigating URLs and locating specific links. Judges stressed the importance of clarifying the operating system at the start of the simulation and providing clear objectives for each task.
During the second stage, judges acknowledged the clarity of EchoPilot’s results but raised concerns about multiple responses and incorrect prompts. Feedback centered on crafting contextual elevator pitches, improving prompts for single-option best responses, and integrating user testing data.
Moreover, feedback underscored the significance of integrating user feedback, enhancing prompt clarity, and autonomously identifying the user’s environment. These insights will guide our ongoing efforts to refine EchoPilot and improve its usability.
Updates with User and Automated Testing
Our collaboration with the Disability Resource Center (DRC) remains steadfast. We’ve been actively communicating our needs and emphasizing the importance of recruiting prospective testers. This collaboration underscores our commitment to making EchoPilot accessible and user-friendly for all.
Our testing suite underwent expansion, and we conducted thorough automated testing, capturing fresh accuracy data for future stakeholder presentations. This rigorous testing regimen is essential for continuously evaluating and enhancing EchoPilot’s performance across various scenarios.
User testing results will be meticulously analyzed, providing valuable insights for future enhancements. Additionally, we’re revising our automated testing methods to allow for more granular display of results, enabling us to assess performance across different contexts more effectively.
Project Pitch Deliverables
Looking ahead, our next steps are clear. We are gearing up to record a prototype demo video for an in-class review next week. This video will offer a comprehensive overview of EchoPilot’s features, facilitating further feedback and refinement. To address user confusion with our current prototype’s responses, we’re experimenting with better prompts. Our aim is to provide clearer instructions and multiple pathways to accomplish tasks, thereby enhancing the user experience.
Stay tuned for more updates as we near our final stretch!
WEEK #26: Preparing for Spring PID
Greetings, EchoPilot enthusiasts!
Much of this week was spent planning and preparing for the upcoming Prototype Inspection Day (PID). We dedicated time to devise a comprehensive layout and plan for presenting our prototype, ensuring that judges and or coaches have the opportunity to interact with our model as a JAWS user would. Additionally, the team has been continuously expanding the testing data as well as doing necessary adjustments to ensure that the prototype .
Testing Initiatives and Expansion
We are reapproaching our contact to the Disability Resource Center (DRC) to schedule user testing sessions. Setting an internal deadline for feedback response, we aim to gather insights from diverse users to enhance the accessibility and usability of EchoPilot. We’re committed to creating a platform that caters to the needs of all users, and collaborative testing with organizations like the DRC is instrumental in achieving this goal.
We also expanded our testing suite by incorporating JAWS certification exam questions provided by our liaison. Through rigorous testing, we evaluated our model’s ability to answer these questions, paving the way for further optimization to address unique question types present in this data.
Feedback Integration and Azure Review
To gather more qualitative usage data, we have reintroduced the feedback response form to our prototype. This enables us to collect valuable insights from Freedom Scientific testing users, informing iterative improvements to our model. Furthermore, we began reviewing feedback responses logged to Azure, identifying areas where our prototype may require adjustments to enhance user-friendliness and functionality.
With Prototype Inspection Day in just a week, our team is preparing to showcase the progress we’ve made in all of our work this semester. As we continue our journey towards the Final Design Review (FDR), we remain committed to delivering a prototype that exceeds expectations and addresses the needs of our users.
Stay tuned for more updates as we head on down the final stretch of our EchoPilot project!
WEEK #25: Advancements in Accessibility and Development
Welcome back, EchoPilot supporters!
This week, we’ve taken significant strides in enhancing our testing suite to ensure comprehensive coverage of diverse topics. Additionally, the team has been making significant progress in preparation for the upcoming Prototype Inspection Day (PID).
Expanding Testing Suite and User Testing Initiatives
Building upon our commitment to inclusivity, we added questions from the JAWS Support Facebook group to our testing suite, broadening the range of scenarios our model can proficiently handle. Additionally, we have expanded our suite with more keystrokes pertaining to information retrieval such as reading out multiple lines of text. Furthermore, we continued our collaboration with the Disability Resource Center (DRC), recontacting them with a more specific request for user testing.
Light Prototype Inspection Day Preparations
With Prototype Inspection Day nearing, initial planning has been underway to ensure a seamless presentation. We’ve created a detailed list of tasks that panelists can feasibly complete within our allotted timeframe, optimizing the demonstration experience. Tasks will be focused on essential everyday keystrokes. Additionally, we’ve begun storyboarding a prototype demonstration video, structuring it to effectively showcase the value of our prototype to stakeholders.
See you all next week for more updates on our project!
WEEK #23: Advancements and Future Plans
Hello there!
This week our team has been diligently working to enhance the accessibility and usability of our prototype. From final design preparation to user testing continuity and automation exploration, let’s delve into the advancements driving our project forward.
Final Design Preparation
One of the pivotal milestones in our journey is the Final Design Review (FDR), and to pave the way for this, we’ve meticulously crafted an FDR outline document. This comprehensive guide will serve as a roadmap for creating our final design materials, ensuring that every aspect of our prototype is thoroughly examined and optimized.
Testing Continuity
Our commitment to user-centric design remains steadfast, and we’ve maintained continuous contact with our group of user testers. We’re eagerly anticipating setting up testing appointments to gather invaluable feedback, which will be instrumental in refining and enhancing the accessibility and usability of EchoPilot.
To further bolster our testing efforts, we’ve delved into usage data analysis to supplement our testing suite. By scrutinizing usage patterns, we can tailor our testing approach and formulate targeted questions to extract meaningful insights during user testing sessions.
In our quest for comprehensive testing, we’ve gained access to JAWS Facebook groups to further enrich our testing suite with common questions and scenarios. Leveraging the collective knowledge and experiences of these communities enables us to ensure that EchoPilot addresses a wide range of user needs and preferences.
Automation Exploration
Recognizing the importance of efficiency in our development process, we’ve delved into researching the use of diff tools and algorithms. These tools hold the potential to automate our ingestion process, streamlining the identification of files or file parts that still need to be uploaded. By harnessing automation, we aim to enhance the scalability and effectiveness of our development efforts.
With Prototype Inspection Day on the horizon and the Final Design Review drawing closer, we’re excited to showcase our progress and receive valuable insights that will guide us towards the finish line.
Have a nice Spring break!
WEEK #22: Insightful Feedback and Progress
Hello there EchoPilot enthusiasts!
This week, our recent presentation at QRB2 shed light on the crucial role of user testing in refining our prototype. Alongside this, we’ve crafted a comprehensive pricing strategy and embarked on automation refactoring for increased efficiency.
QRB2 Feedback and User Testing Data
We recently had the opportunity to present our progress at QRB2, where we received invaluable feedback from experts. This feedback serves as a guiding light as we chart our course towards upcoming goals, ensuring that we stay on track and continually improve.
The feedback primarily focused on collecting user testing data to verify that the Large Language Model (LLM) utilized in our prototype delivers impartial, highly accurate responses and demonstrates robust generalization capabilities. Consequently, prioritizing interaction with our user community is essential, leading us to connect with both the Disability Resource Center (DRC) and students provided by coaches to gather user testing feedback. Their perspectives play a vital role in enhancing our prototype to meet the diverse needs of all users.
Pricing Strategy and Optimization
In parallel with our user testing initiatives, we’ve developed a comprehensive pricing breakdown for our most recent architecture. This breakdown serves as a crucial tool in our ongoing testing efforts, allowing us to strike a balance between accuracy and cost-effectiveness. We’re continuously fine-tuning our parameters and prompt configurations to optimize performance while keeping costs in check.
Refactoring into Automation
Looking ahead, we’ve initiated the refactoring process in preparation for automating our ingestion mechanism. By streamlining our processes and implementing automation where possible, we aim to improve efficiency and scalability, ultimately advancing the EchoPilot project to new heights.
Stay tuned for further updates as we continue our journey of innovation with EchoPilot!
WEEK #21: QRB2 and Celebrations
Hello, EchoPilot enthusiasts! This week, we’re thrilled to share the exciting strides we have taken in presenting the second Quarterly Review Board (QRB2). Our comprehensive showcase highlighted the evolution of our project, showcasing the significant progress achieved over the past weeks.
Liaison Visit
To kick off the week, our liaison visited to facilitate productive discussions about EchoPilot’s development. Following our meeting we celebrated our progress with an enjoyable dinner at a Vietnamese restaurant. This in-person interaction strengthened our collaboration as we look forward to achieving more milestones together.
Fine-tuning Preparations
With an eye on enhancements, our focus shifts towards fine-tuning. As we gather the necessary training data, preparations are underway to refine our model’s understanding and responses. This strategic step ensures that EchoPilot not only meets current standards but continues to evolve, providing accurate and contextually relevant information.
Testing Suite Expansion
In our pursuit of excellence, we are actively expanding our testing suite. This forward-thinking approach allows us to push the boundaries of our model’s accuracy and performance. By incorporating diverse scenarios and queries, we ensure that EchoPilot remains robust and reliable in catering to a myriad of user needs.
Collaborative User Testing with the DRC
Recognizing the significance of user feedback, we have reached out to the UF Disability Resource Center (DRC) for additional user testing. This collaborative effort aims to ensure the accessibility and usability of EchoPilot for users with diverse needs. By engaging with the DRC, we are committed to creating a platform that is inclusive and tailored to the requirements of all users.
With the FDR looming, our team is poised to present a project that exceeds expectations. Stay tuned as we reveal the culmination of our efforts in reranking, automation, and knowledge optimization. See you next week!