Blog Posts

HAPPY VALENTINES DAY!!!

This week, class was cancelled so that each team can meet up and continue working on their project. The team met up and discussed the development of our AI model and the construction of our backend system. We took the time to figure out a different way to gather image data by fetching them from the Fanatics website directly. To do this, we would be using Python and its respective libraries to web scrape the website and pull both the PNG image and the JSON elements it has attached with it.

Valentines Day!!!

We also met with our liaison for the first time this semester and we discussed a summary of what the project is and how we are going to go about solving it. We also went through the entire QRB 1 with him and created a Slack channel so it can be easier to reach him for any questions.

Next week, we will be getting all the image data we need from the liaison, setting up the training on HiPerGator, continuing FDR development (Volume 1), and RSVPing for the FDR.

PREPARING FOR QRB2

This week, we started class by reviewing our QRB 1 and speaking about the different challenges, positives, and negatives that it brought with it. This was done to improve our presentation for QRB 2 which we will be presenting in the next few weeks. We also took some time to work on our Final Design Report Outline, which comprises of all of the work that the team accomplished and will accomplish by the end of the semester.

HiPerGator Servers Team Will Be Using

Our team also took the time this week to complete our HiPerGator training, create a backend script to convert images into PNG, and develop a program to train our image generator (which still needs to categorize images appropriately).

Next week, we will be starting training on the HiperGator, finish coding to organize the backend data, and get more Fanatics data from the liaison.

QRB Presentation!

This week, the Fantastic 5 presented to three judges, including a surprise guest, during our Qualitative Review Board. The team presented our project risks, project plan, and work distribution among the team. During our presentation, our coach Dr. Thomas brought in a surprise guest, the president of Palm University College in Ghana, Dr. Okantey! It was valuable presenting to him and getting his feedback. He found the work we were doing interesting and liked the progress we have made.

Dr. Peter Carlos Okantey, President of Palm University College

The main feedback our team got was to describe the AI metrics that are needed, such as sampling steps and noise level. We also received feedback about getting in touch with our liaison, as ever since he got reassigned, we have not heard back from our new one. We ended up contacting the liaison again and he said in the next two weeks they will reach out.

Next week, we are going to continue working on training the AI and developing the backend.

Starting Implementation

This week, the team had our first SCRUM meeting where we delegated tasks to each other and came up with our first sprint. Our sprints will last two weeks, and by the end of this sprint the AI model team will have figured out a way to start training the AI model using python. The backend team will focus on converting fanatics images to png and stripping attributes of the jerseys from a JSON.

This week, we also are preparing for our Qualitative Review Board coming up on Tuesday. We just have to finish up the PowerPoint and practice the presentation.

Title Slide of QRB Presentation

Next week, aside from presenting the QRB, we are hoping we hear back from our new liaison so we can set up a meeting as soon as possible. We need to get a bigger dataset from Fanatics, and we set up HiPerGator training for the upcoming Monday.

QRB Prep and Sad News

This week, the team started prepping for the Qualitative Review Board. We came up with our accomplishments last semester and what we have to do for the rest of the semester to meet our goals. Next, we will have to create a PowerPoint presentation to present it to the coaches on January 30th.

We also received sad news that our liaison last semester Jason got reassigned to another division within Fanatics so he will not be our liaison anymore. The team is sad to see him go, we enjoyed working with him. We have yet to meet our new liaison, but we are communicating with him to set up an appointment time.

The team also decided to split up the work of the project. Samy, Hadi and Joseph are going to work on the AI model and building it. While Sara and Aditi are going to work on the API to connect stable diffusion to Fanatics side code.

Image of AI Training Guide the Team Found

We are planning on following this guide, which shows big improvements to their prompt generation when a base stable diffusion model is tuned to the type of images they are looking for. If I follow this guide, i could improve the output we get from stable diffusion which generally is not great.

And We Are Back!

Hope everyone had a happy holiday season! The Fantastic 5 certainly did.

With the start of the Spring semester, comes the return of IPPD. Already on the first week of classes, the team dealt with a tornado warning and getting soaked from a thunderstorm heading to class. Classes were not cancelled unfortunately. One of our members was brave enough to face the storm head on. She is now sick.

Tornado Emergency Alert

Regardless, this week the Fantastic 5 completed a critical path plan for the rest of the semester to highlight major tasks that need to be achieved for success in the project. We also started correspondence involved with getting training for HiPerGator, as the team needs the supercomputer to train the AI model as it requires a lot of resources. We also had to complete a Work Breakdown Structure for January to distribute work for the month. This allows us to be more efficient and get started with our AI training.

Critical Path for the semester

Our Work Breakdown Structure is as follows for the month of January:

  • 0.0 Product Image Generator for Fanatics Website
  • 1.0 Project Management
  • 2.0 Further Research
  • 3.0 Stable Diffusion Development
    • 3.1 Testing
      • 3.1.1 Unit Tests
    • 3.2 Backend
      • 3.2.1 Train AI model using Stable Diffusion
      • 3.2.2 Integration with Fanatics Platform
      • 3.2.3 Stable Diffusion Handler
  • 4.0 Qualification Review Board
    • 4.1 Create PowerPoint
    • 4.2 Rehearse Presentation

Next week, we are going to start implementing the AI model and preparing for the QRB.

SLDR Wrapped Up!

This week, we presented our System Level Design Report to the Fanatics team, as well as two other teams and their liaisons. We got asked important questions that we need to consider for our final design, mainly how we are going to tackle accuracy. That is always a challenge with AI, as even powerful models such as ChatGPT can still make mistakes, and with the project we are developing needing as much precision as possible, it will be a worthwhile challenge to the team.

We also found out after meeting with our liaison this week that the users of our model (the content management team) want to start meeting with us next fall as they liked our presentation and are excited about the AI’s capabilities. We look forward to working with more members of Fanatics to make our project as best as it can be!

This will be the last blog post of 2023, so the Fantastic 5 wishes everyone happy holidays and a happy new year!

SLDR Prep!

Hope everyone had a great Thanksgiving!

This week after much needed rest, the team got to work on the System Level Design Report and presentation. On Tuesday, we presented to our peers and got valuable feedback for the presentation to our sponsor next week. The main feedback we received was to use less filler words and to reorganize some of the slides to make it more cohesive.

We also learned about potentially using LORA to improve our model’s accuracy. LoRA models are small Stable Diffusion models that apply tiny changes to standard checkpoint models. We think that using a LoRA we can improve the text that is generated by Stable Diffusion, as typically it is distorted and not accurate.

The semester is winding down and we are excited to start working on the actual product in Spring next year!

Prototype Inspection Day!

This week, we showed off our prototype to pairs of judges. The team had fun showing the work we have accomplished so far, and we also received good feedback. Main piece of feedback we received was to look into transferred learning, which is a machine learning method where a model developed for a task is reused as the starting point for a model on a second task. This could simplify the training process for us since training a model from scratch is very complicated work.

Above is what we showed off for our prototype. We ran stable diffusion XL locally and ran the base models on some preexisting fanatics merch and asked the AI to generate the back view. These were the results which were not entirely accurate. We are hoping that either with a tuned or custom model the results will be much better.

Prepping For Our Prototype Inspection Day!

The past week, the team has been working hard to prepare for our Prototype Inspection Day next Tuesday. We are presenting our project prototype which will consist of a wireframe in Figma and a basic model for Stable Diffusion. A picture of us in class working is below!

For our prototype, we are displaying an example of a stable diffusion model and a test generation of the back of a jersey, shown below. As you can see, using the base models of stable diffusion produces an inaccurate image. We were able to generate the back view, but it is a different material, as well as slightly different color. This will of course improve by using a custom model.

We are also gearing up to start working on our System Level Design Report. We are going to have to present it to Fanatics just like our Preliminary Design Report. The System Level Design Report will outline our solution and architecture we will be implementing to get there.