The solution came about in 2 parts.
Firstly, was the data storage challenge as we needed to store trillions of data points while still maintaining performance. There were a few options in the market but the obvious one was Google Big Query. It was infinitely scalable and designed for solutions just like Roy Morgan Audiences.
With such a complex tool in the making these technologies gave us a perfect foundation to build from.