Plot Twist: We Went with Microsoft Fabric!

After weeks of researching data warehouses, our team had narrowed our options to Google BigQuery and Amazon Redshift. Just when we thought we were approaching a final decision, our project took an unexpected turn: Microsoft Fabric!

Following discussions with Vispero, we decided to move forward with Fabric because it integrates directly with their existing Azure environment. Rather than introducing another cloud provider, Fabric offers a fully managed platform for data ingestion, storage, and analytics, all while keeping infrastructure management relatively simple.

With our warehouse selected, we shifted from research to hands-on implementation. Our team gained access to Vispero’s Azure environment and began exploring Application Insights to better understand the telemetry we’re working with. We also investigated two ingestion approaches: Azure diagnostic settings, which export data through Blob Storage, and Azure Monitor mirroring, which could offer a more direct connection to Fabric.

We encountered a few challenges with Azure permissions, but our next focus is establishing a working ingestion pipeline and preparing for Power BI integration.

This week showed us that engineering decisions don’t always follow a straight path. With our warehouse selected, we’re excited to move from research to implementation!