Blog Posts

Week 9: Strengthening Quality Control and Preparing for AI Days

This week, Team Genesis focused on understanding how reliably our Anatomy-to-Asset pipeline performs across a larger collection of liver scans. We expanded our quality control evaluation, investigated recurring failures, and continued preparing to share our project at UF AI Days.

We consolidated QC settings into a central configuration file, making thresholds easier to update and apply consistently across the pipeline. Our expanded PanTS evaluation showed promising segmentation results, with a median Dice score of 0.971 and approximately 4.2% of measured cases falling below the 0.90 threshold.

The evaluation also identified internal pockets, incomplete scan boundaries, and a shared Poisson’s ratio setting that caused physics-check failures. These findings reinforced the need to assess segmentation accuracy and simulation readiness separately.

Initial mesh experiments revealed a trade-off: removing the fixed triangle count eliminated non-manifold edges in tested cases but increased self-intersections. SDF reconstruction and Taubin smoothing reduced self-intersections and improved triangle quality, although some surface artifacts remained and processing time increased.

Alongside the technical work, we worked on our UF AI Days poster. Next week, we will focus on integrating these improvements, refining QC thresholds, and preparing for the November 3 prototype inspection

Week 8: Improving Mesh Smoothness and Moving Toward Physics-Ready Assets

This week, Team Genesis focused on improving the smoothness and quality of our liver meshes for simulation. We experimented with higher-resolution meshing, introduced new smoothing techniques, and investigated methods to detect and repair mesh defects.

We also discussed our progress with Dr. Catia Silva, focusing on the trade-offs between mesh quality, anatomical accuracy, and physics readiness.

Improving Liver Mesh Smoothness

One of our main experiments involved improving the surface quality of meshes generated using fTetWild. Our initial meshes contained visible triangular patterns and uneven surfaces that could affect their suitability for simulation.

We compared three approaches: original fTetWild, high-resolution fTetWild, and Signed Distance Field (SDF) smoothing combined with fTetWild.

Increasing the resolution improved surface detail, while SDF smoothing helped reduce visible irregularities. We also explored Taubin smoothing to further improve mesh quality while limiting unwanted changes to the liver’s shape.

Comparing Different Meshing Approaches

Our experiments showed clear differences in surface quality and mesh complexity. The original fTetWild mesh contained approximately 12,582 boundary faces, while the high-resolution version increased this to 166,172 faces.

Combining SDF smoothing with fTetWild produced a smoother surface using approximately 69,506 boundary faces, demonstrating a promising balance between mesh complexity and visual quality.

These results suggest that increasing triangle counts alone may not be necessary to achieve smoother anatomical models.

Strengthening Mesh Quality and Repair

Another important focus was identifying mesh defects that could prevent our models from being used in physics simulations.

We investigated self-intersecting triangles, non-manifold edges, and poor triangle quality. We also explored repair techniques such as MeshFix and targeted hole filling to address issues that padding alone could not resolve.

To track these problems systematically, we continued developing our quality-control framework and proposed a failure mode register to document issues across the pipeline.

Looking Ahead

Next, we will compare mesh quality across different triangle counts, investigate localized smoothing techniques, and evaluate how effectively automated repair methods resolve remaining mesh defects.

We also plan to begin testing our reconstructed liver assets in NVIDIA Isaac Sim to evaluate their physical behavior and move closer to producing reliable, physics-ready anatomical models.

Week 7: Improving Liver Mesh Quality and Strengthening Our Pipeline

This week, Team Genesis focused on making our liver models more reliable for simulation. We explored different mesh generation techniques, studied how small changes to segmentation masks affect mesh quality, and developed new quality-control checks for our pipeline.

We also completed our Preliminary Design Review (PDR) presentation with our NVIDIA liaison, Oge Marques, discussing our progress and the challenges ahead.

Improving Liver Mesh Reliability

One of our main experiments involved testing 102 liver segmentation masks from TotalSegmentator. We compared different levels of zero padding before converting the masks into 3D meshes.

Adding padding improved the percentage of watertight meshes from 63% to 83%. However, we also discovered that excessive padding can change the liver’s anatomical shape, making it less suitable for applications such as robotic ultrasound training.

To address this, we proposed limiting how much extra volume padding can introduce, ensuring that models used for robot training remain anatomically accurate.

Comparing Different Meshing Approaches

We also compared marching cubes with fTetWild, a tetrahedral meshing approach. While marching cubes produced smoother surfaces, fTetWild generated watertight meshes with fewer vertices in our initial comparison.

These results are promising, but further testing across additional liver samples is needed before selecting the most suitable approach.

Building a Quality-Control Framework

Another important development was creating a quality-control framework to evaluate our pipeline at multiple stages, from image ingestion and segmentation to mesh validation and physics readiness.

We tested this framework using three liver datasets: TotalSegmentator, FLARE22, and MSD Liver. We also developed structured reports that record whether each stage passes or fails and explain the reasons for failure.

Our next improvements will focus on detecting mesh self-intersections, evaluating triangle quality, and checking whether the reconstructed models preserve the original anatomy.

Looking Ahead

Next, we will expand our meshing experiments, refine the quality-control thresholds, and continue improving the reliability of liver models for simulation. We will also use feedback from our NVIDIA liaison to guide the next steps toward producing physics-ready anatomical assets.

Week 6: Refining Our Design and Focusing on the Liver

This week, Team Genesis presented our Preliminary Design Review (PDR), bringing together our research, pipeline architecture, and early validation results. The review helped us explain our design choices and identify the work needed to turn CT scans into reliable anatomical assets for simulation.

We now have a clear focus: the liver, with TotalSegmentator as our current segmentation tool. Our earlier stomach experiments provided a useful foundation, but liver performance will need its own evaluation.

Making Mesh Conversion More Reliable

One important lesson from testing was that reducing a model’s triangle count can introduce defects. We added a safeguard that keeps the more detailed mesh whenever simplification damages its geometry.

We also addressed code-review feedback and passed 73 software tests, including real CPU runs of both segmentation backends through OpenUSD export. These results strengthen the pipeline, although passing software tests does not establish full physics readiness.

Exploring the Next Improvements

Our team’s experiments highlighted additional challenges with liver meshes and recurring watertightness problems with surface nets. Adithya will continue comparing meshing approaches, while Megha will investigate repair methods, including approaches for handling internal cavities.

We are also exploring whether early segmentation checks can predict later mesh failures, helping us avoid unnecessary processing.

Looking Ahead

Next, we will expand liver testing, run GPU validation on HiPerGator, and continue evaluating assets in Isaac Sim. We will also seek feedback from our NVIDIA liaison on the PDR and the criteria needed to demonstrate physics readiness.

Week 5: Putting Our Anatomy-to-Asset Pipeline to the Test

This week, Team Genesis moved beyond generating 3D models and started testing how they actually behave in NVIDIA Isaac Sim. After running our pipeline on real CT data, we discovered and fixed several issues with the exported model, including its orientation, scale, and how it loads into the simulator. We then tested the model by dropping it under gravity to see how it behaved. We also experimented with mesh generation and found that when an organ reaches the edge of a CT image, the resulting mesh can have an open surface. Adding padding helped us close the surface in our test. With the pipeline now running end to end for one sample CT scan, we’re working on building a quality control and experimentation system to each team can run tests with sets of CT scans and report their findings to improve our model.

Week 4: Shaping the Anatomy-to-Asset Technical Pipeline

Week 4 marked an important step forward for Team 17 as we moved from initial research toward defining our technical approach. Throughout the week, we explored the major stages of our pipeline involving CT image segmentation, 3D mesh generation, and quality control while comparing different approaches with Dr. Silva to understand the trade offs of each. We also identified several promising public CT datasets and began narrowing our options based on which anatomy would best support the project’s goals. Looking ahead to our upcoming meeting with the NVIDIA liaison engineer, the team compiled a list of key technical and scope questions to clarify project expectations and ensure our approach aligns with NVIDIA’s own goals for the collaboration. With initial research and task assignments now complete, we’re excited to move into hands-on work: setting up NVIDIA Isaac Sim on HiPerGator, investigating TotalSegmentator, and taking our first real steps toward building the pipeline.

Week 3: From Research to a Clearer Technical Direction

Week 3 marked an important step forward for Team 17 as we moved from initial research toward defining our technical approach. Throughout the week, we explored the major stages of our pipeline, including CT image segmentation, 3D mesh generation, and quality control, while comparing different approaches with Dr. Silva. We also identified several potential public CT datasets and began narrowing down the options based on the anatomy that will best support our project. As we prepare for our upcoming meeting with the NVIDIA liaison engineer, the team has compiled key technical and scope questions to clarify project expectations and ensure that our approach aligns with NVIDIA’s goals. With our initial research and task assignments complete, we are now looking forward to setting up NVIDIA Isaac Sim on HiPerGator, investigating TotalSegmentator, and taking our first steps toward building the pipeline