Blog Posts

Week 19: Off The Drawing Board

This week brought productive work sessions and liaison discussions, creating a clearer sense of direction as the team moves into the testing phase. With most of our ordered parts finally arriving (procurement can be slow!), we’re transitioning from design and printing into hands-on assembly and evaluation.

On the computer vision side, we presented our latest proximal tip detection work to the liaisons. Right now we’re using color-based HSV masking in OpenCV to identify the copper wire and SAS sensor from images of the proximal end. We discussed recommendations for moving toward object recognition or pixel classification rather than relying solely on color, and designing a physical guide to separate the wires so they’re easier to distinguish in images. The proximal tip is the most critical orientation check since it connects to the rest of the catheter, so getting this right is a top priority.

The mechanical wire insertion sub-assembly also got a detailed walkthrough. A motor-driven wheel mechanism for pushing the wire was developed using bevel gears to redirect motion along Z and Y axes. A clever ramp system lifts the wheel over the lumen instead of needing our original servo-based approach, saving valuable space.

The vision verification box is approaching its near-final form. The software can now automatically configure camera exposure and gain before capturing. The liaisons asked us to write up setup instructions so they can replicate the build in their Jacksonville lab and start sending us real images for offline processing.

A big takeaway from the meeting: J&J management’s top priority is de-risking the wire loading mechanism. They want to get our fixtures into the hands of actual lab technicians to evaluate real-world usability — whether the fixture damages the nitinol wire, whether feed speed is appropriate, and what failure modes emerge. We’re also now formally documenting every failure we observe during testing, building a record that tracks what broke, what we fixed, and what still needs attention.

Looking ahead, the pace is picking up, and the team is energized and excited to see months of design work start to come together on the bench.

Week 18: Awaiting parts but steady progress!

The team continued to make steady progress this week as we focused on strengthening both the software infrastructure and mechanical integration needed to support the vision verification system and the one-to-one scale prototype. Several foundational tasks were completed that will enable more streamlined testing and iteration in the coming weeks.

On the software and sensing side, we completed the initial setup of the Raspberry Pi and successfully integrated the ArenaView SDK with OpenCV to enable image acquisition directly through code. This integration represents an important step toward a fully automated and reproducible vision pipeline. In addition, we shared detailed field of view and lens calculations with the liaison team to support camera and optics decisions and ensure alignment with system requirements.

Mechanical and electrical progress included ordering and receiving key electronic components needed for continued development. We also designed and 3D printed early prototypes of a motor mount intended to interface with the one-to-one scale prototype structure. These initial prints will allow us to evaluate fit, alignment, and mounting strategy before finalizing the design.

Looking ahead to next week, the team will focus on finalizing the distal and proximal tip vision algorithms once additional image data is collected using the updated verification box parameters. We will assemble and test the full vision verification setup using the latest printed components and integrate the recently received parts into the wire insertion assembly. In parallel, we will update the latest mechanical designs in either STEP format or SolidWorks 2024 to ensure files are ready for review and downstream use.

One open action item remains for coordination with the liaison engineers, which is to finalize the March trip date.

Overall, the project remains on schedule, and the progress made this week continues to advance both system integration and readiness for more comprehensive testing.

An image of a prototype for our new mount!!

Week 17: Progress!!

The team made solid progress this week across both the vision and mechanical subsystems, with a particular focus on advancing verification capabilities and preparing for further integration of the wire insertion assembly. Several parallel efforts came together to strengthen the foundation for upcoming testing and refinement.

On the vision side, we continued developing the distal and proximal tip detection algorithms and made meaningful improvements to their performance. In support of this work, we reprinted the full vision verification setup, this time including the external enclosure. This updated build will allow us to better control lighting, camera placement, and part alignment, which are all critical factors for consistent image capture and reliable algorithm evaluation. In parallel, we formally defined the complete set of vision requirements for the system, including pixel size, sensor format, resolution, aperture, and lens specifications. Establishing these parameters provides clear constraints for both hardware selection and future software tuning.

Mechanical progress focused on preparing for additional automation of the wire insertion assembly. We ordered key components including a timing belt, stepper motor, motor driver, shaft collars, and bearings. These parts will enable initial motorized testing and help us assess performance, alignment, and control strategies before committing to a finalized configuration.

The team also presented current project progress during QRB1 and received valuable feedback on both the technical direction and overall system approach. The discussion helped validate recent design decisions and highlighted areas for continued refinement as the project moves forward.

Looking ahead, the team will focus on finalizing the distal and proximal tip vision algorithms once additional image data is collected using the updated verification box. We will assemble and test the newly printed vision verification setup, integrate the recently ordered components into the wire insertion assembly, and design and fabricate additional custom parts as needed based on evaluation of these components. In parallel, we will continue exploring external motorized solutions for vision verification lens adjustment while also assessing whether a commercially available all-in-one camera and lens solution could meet system requirements.

A few action items remain for coordination with the liaison engineers, including sharing the Python script needed for camera API integration, providing additional images of passing catheters to support algorithm development, and completing the When2Meet poll for the upcoming March trip.

Overall, the project remains on schedule, and the progress made this week positions the team well for continued integration and testing in the coming phases.

Here is an image of our CV testing browser:

Week 16 – Subsystems Coming to Life

This week the focus moved from planning stages to implementation stages as numerous subsystems entered into the physical prototype testing phase. Continuing the progress from SLDR and orientation for Spring semester, team members worked on developing hardware, verification tools, and organization.

Mechanically, motor, pulley, and pulley rod holder fixtures were built for the mechanical insertion subsystem. These units represent one stage in proving belt-driven motion/alignment, leading up to a full-scale prototype. Their construction has already aided in determining assembly constraints prior to motor/belt installation.

Advancements were also made on the orientation verification subsystem. A new fixture that is 3D printed to allow for more consistent imaging was made. Additionally, the computer vision algorithm was improved to allow for a higher degree of pass/fail accuracy. These improvements allow us to have greater confidence in our ability to consistently know when a board is oriented incorrectly during testing.

In order to keep track of work-in-progress and future tasks, allowing for better visibility between subteams, the team has started using Trello.

Next weeks activities will consist mainly of documentation and testing. Successes/failures of both mechanical insertion and orientation verification subsystems will be photo/videographed and image datasets run through the updated algorithm and uploaded to M-Box to document pass/fail catheter cases. More computer vision testing will take place using AI manipulated images to determine system strength. Once motors and belt components are received, fixtures will be fit-tested for compliance and liaison engineers have been requested to 3D print current designs out of M-Box to verify functionality before committing to ceramic printing.

Week 15: Jumping Back In

The team returned from a restful winter break, but instead of a cold start, we dived right into new updates on our project. Over break, we modified our designs to utilize the magic of mirrors to create new viewpoints, and developed a new interface for our computer vision (shout out to Sean!). The team’s passion and commitment to this project give us a strong confidence in reaching our goals. In our first week, we attended a lecture discussing the ethical principles of engineering, and discussed our moral codes in the face of unethical dilemmas. We also updated our liaisons on our progress in our first meeting, showcasing our new CAD models, diagrams and software.

This spring, we know what to expect and are planning to approach this semester more tactically. We’ll be implementing new project management strategies, such as Scrum-style planning and sub-team knowledge exchange. Tools like JIRA will help us stay organized within ourselves and also the liaisons, who remain involved and eager to hear from us.

Week 14: SLDR Week!

The team had a major milestone this week, wrapping up our SLDR on December 2nd. The review presented an opportunity to share the current status of our system, walk through design decisions, and receive detailed feedback to help guide the next phase of development. Attendees from Johnson and Johnson and the University of Florida discussed various aspects: physical architecture, bill of materials, verification strategy, preliminary manufacturing considerations, early prototype results, and overall project planning. Feedback was positive and shed light on multiple technical priorities in the coming months.
Much of the review was confirmation of the direction of our mechanical and vision subsystems. The panel agreed that it was reasonable to continue the development of a cooking fixture and its camera mount because of its importance in ensuring uniformity in the handling and alignment of components for making a catheter. Strong support was given for the creation of a formal verification box concept, which will facilitate orientation checks and camera alignment by providing a controlled environment in which to take images and perform calibration. This will be important both during algorithm development and in system integration.
The team also confirmed the path forward for completing the one-to-one scale prototype using motors, timing belts, and pulleys. Parts have already been ordered for this build using the existing budget, and the review reinforced the importance of demonstrating the full mechanical assembly in Spring. This prototype will form the basis for validating subsystem interactions and preparing for more advanced automation work.
On the software and sensing side, the reviewers supported our current computer vision approach to detect the copper wire and to identify the proximal and distal tip of the catheter. Iteration of these models will continue to be critical for reliable part verification across a large variation in catheters. Testing will be expanded to include correct and incorrect samples so the vision pipeline can be evaluated against real sources of variation.
Based on the results of the SLDR, we proposed a very clear path forward for each of the subsystems. On the mechanical side, the next few weeks will involve updating the CAD for the cooking fixture and camera mount, printing revised prototypes, and checking functionality. In parallel, concept drafting and a test plan for the verification box will start, along with initial bill of materials planning. The remaining parts for the one-to-one prototype will be assembled as they come in, and the team will start alignment and bring-up testing. Vision work will continue to include model tuning and expanded sample evaluation, while the BOM will be updated to reflect confirmed components and lead times.
All said and done, the SLDR was a productive and energizing moment for the team. The review validated our direction and provided clarity of expectations for the next phase, while strengthening our alignment across mechanical, software, and verification efforts. The insights gathered will be incorporated into the final SLDR report and will help in guiding our work into Spring.

Week 13: SLDR Prep!

The team made steady progress this week as we continued refining both the mechanical and sensing components of our system while preparing for several key milestones in our development timeline. Building on feedback from recent discussions, we focused our efforts on technical improvements, documentation, and early-stage testing that will inform the next phase of the project.

One of the primary accomplishments this week was drafting the SLDR, which will serve as an important reference point for aligning our design choices, subsystem responsibilities, and project direction. We also met with Dr. Stubbs to review our overall system architecture and motor requirements. This discussion helped clarify several design considerations and provided guidance for the mechanical and control decisions we will finalize in the coming weeks.

On the prototyping side, we began purchasing the remaining components needed to automate the current prototype. These parts will allow us to progress from manual operation toward a more complete representation of the intended system behavior. In addition, we received and assembled new catheters for testing and were able to verify that the prototype continues to function mechanically as expected.

We also made adjustments to the cooking fixture to address concerns raised during the previous meeting. These modifications will support improved alignment and should contribute to more consistent handling of the catheter components. In parallel, we began preliminary testing aimed at detecting electrodes within catheter images. These early tests will help guide improvements to the image processing pipeline and build toward more consistent and reliable computer vision performance.

Looking ahead to next week, our priorities include completing the SLDR, acquiring the remaining parts before the holiday period, improving the vision system’s performance on lower quality images, and continuing iteration on the cooking fixture based on the week’s feedback. The team will not be meeting next week due to the Thanksgiving break.

Here is a picture of our new computer vision progress:

 

Week 12: PDR week!

The team continued to make meaningful progress this week as our work shifted further from preliminary investigation into detailed design development and prototyping efforts. Building on insights from recent discussions with Johnson & Johnson, we advanced several parallel tracks of the project that will inform both our near-term deliverables and long-term system integration.

One of the major developments this week was the construction of a full-scale mechanical prototype of the wire insertion assembly. Creating this physical model allowed us to evaluate clearances, motions, and potential points of interference within the system. In parallel, we completed a comprehensive CAD assembly of the prototype, which provided additional clarity on areas of concern and highlighted design limitations that might not be immediately evident from physical inspection alone. Together, these efforts strengthened our understanding of the assembly’s mechanical requirements and constraints.

We also made notable progress in the software and sensing components of the project. Using the latest image set provided by J&J, the team enhanced the performance of our computer vision pipeline for detecting copper holes. These preliminary results helped us refine our approach and prepare for the transition from MATLAB to an OpenCV-based implementation. Alongside this work, we conducted an evaluation of several potential cameras, comparing them across relevant performance criteria to determine which option will best support the vision verification workflow. This analysis informed the initial concept design for the vision verification box, which will house and align the sensing components in future iterations.

In addition to these technical advances, the team began planning for the next stages of procurement and assembly. We identified the remaining components needed to complete the manual assembly of the full-scale prototype and will incorporate final camera dimensions into the verification box design once a selection is made. These steps help ensure that mechanical and sensing subsystems evolve cohesively as development progresses.

Looking ahead, the focus for next week will be on fine-tuning the computer vision algorithm, initiating the software transition to OpenCV, finalizing camera selection, and acquiring the parts necessary to complete the prototype. Coordination efforts will also continue, including arranging transport of materials from Jacksonville to Gainesville and confirming dates for the next SLDR site visit.

Overall, it was a productive and technically rich week for the team. The progress made in both mechanical prototyping and vision system development positions us well for continued advancement in the coming weeks.


Due to delays with travel arrangements, we gave our PDR during our regularly scheduled liaison meeting time and it was a success and our liaisons gave us some great feedback we hope to take for the SLDR coming up this week!

Week 11: PID Day!

This week marked steady progress as we continued developing both the mechanical and computer vision components of our wire insertion system. During Prototype Inspection Day, we presented our current design to professors and industry professionals. The feedback we received was constructive and helped us identify areas to refine as we move forward.

On the mechanical side, we updated the cooking holder CAD model and began making parallel progress on the camera mount fixture. We are also working on scaling down the assembly, with particular attention on finalizing the lumen holder and feeder wire clamps, which will play an important role in stability and accuracy.

Earlier in the week, we reviewed our computer vision strategy as a team. The approach is moving in a good direction, and we are preparing updates to share in our next progress review on Friday.


Plans for Next Week

  • Print and test the first version of the camera mount fixture, then make adjustments as needed.
  • Continue building out our computer vision codebase and improving detection performance.
  • Begin integrating components into the full-scale wire insertion model to transition from individual prototypes to a unified system.
  • Order the correct camera hardware so that future testing can be performed under realistic operating conditions.

Open Items for Liaison Engineer(s)

  • Finalize outstanding PDR documentation and details.

Project Status: On Schedule

We are maintaining steady momentum and remain on track with our planned development timeline. More updates will follow next week as we begin initial integration and testing.

Here is our team during our PID presentation:

Week 10: Preparing for Prototype Inspection

Team CORBOTICS has continued to focus on design for fixtures, integration of subsystems, and preparation for testing in anticipation of Prototype Inspection Day. During this week, the team worked to improve the reliability and repeatability of our fixtures, verify our process flow, and synchronize efforts between the mechanical, computer vision, and automation subteams.

Corrections were made to the lumen holder fixture that positions and secures the catheter lumen during automated assembly, based on feedback from our liaison at Johnson & Johnson’s Biosense Webster division. The fixture’s wall height was increased to provide additional lateral support and further prevent misalignment during testing. The fixture’s reliability and repeatability were the target mechanical properties, as these are necessary for a successful automation process.

Mid-week, some team members made a field trip to a robotics team in Lakeland to learn more about their automation setup. They were able to experiment with parts, test various mechanical interfaces, and brainstorm potential design solutions that could work with our system. Additionally, they were able to return with some spare parts and material that they were able to salvage and will be used in our prototype build. The team expects this component to push progress forward leading up to Prototype Inspection Day.

For members who were unable to attend the trip in person, those on campus followed up by discussing and sharing photos and notes from the team’s time at the other robotics team. The team’s general knowledge of the potential design elements to make a design simpler or how to re-purpose existing mechanisms has increased.

Our cooking fixture and holding fixture have been modified according to the finalized Process Flow Chart, which details every step of the manual assembly of the catheter. This visual reference has proven useful for determining where the team needs to automate steps and integrating all of the subsystems.

The computer vision subteam has continued to make progress on detection and labeling tools using OpenCV. We have been able to make these corrections to further optimize OpenCV for our fixture changes.

Team CORBOTICS is working toward tightly synchronizing the mechanical fixtures, computer vision tools, and control systems as a complete automation process. The next steps in our preparation are system testing and finalizing our design documentation before inspection.