This week, instead of our usual class, we had an IPPD project work day to keep our project moving forward. The team met over Zoom (see photo below) to collaborate across sub-teams and made great progress.

The GPU Testing Team created FP16 TensorRT engines that produce similar results to FP32 engines but run about 20% faster, giving us another performance boost for inference tasks. The Benchmarking Team added the ability to alter the satellite starting location in the orchestrator for scenario testing. They also finished integrating the lightweight runner into the benchmarking script, making it easier to test and evaluate other tasking methods. Additionally, they added a benchmark stage to the GitLab CI file, which can automatically run a test instance of the benchmarking script when merging code. Finally, the RL Training Team constructed a detailed training plan for phase-based model training sequences that can be run either sequentially or concurrently, giving the team flexibility in orchestrating experiments.

It was a productive week thanks to the IPPD project work day! Each sub-team is moving forward, and we’re excited to see these pieces come together as we continue to scale up.