My final model was inspired by this drawing by Mc Escher’s optical illusion building. There was a lot of them to chose from but this one looked like the most manageable to recreate. It was still a big task and doesn’t look 100% accurate but I think it’s because the building’s proportions don’t work in a 3D software.
https://medium.com/carinas-projects/building-an-impossible-structure-in-virtual-reality-5d275814c898