This week, we concluded our literature review and concept generation phases and finalized the overall system architecture. We decided to implement an intermediate fusion multimodal model, combining multiple unimodal models and synthesizing the outputs of these models with a master neural network model which will produce a final output. Our choice was based on a thorough investigation of state-of-the-art multimodal models from the literature and a consideration of important factors such as speed and interaction between modalities.

In addition to selecting our system architecture, we finalized our PDR schedule with our liaison. We have begun working on our PDR presentation in preparation for our peer review session on Tuesday. We’re looking forward to getting feedback on our presentation and improving it before we present it to our sponsor.

Next week, we plan to begin gathering data for the model and developing our model architecture.