Photo sphere mixed with 3D

Hi All,

I'm attempting to add a photo sphere to my VR game. Imagine you are standing on a 3D balcony in the app, I have a photo wrapped to the inside of a sphere, which is centered where your head is in VR. I'm having issues trying to align everything to look correct.

Any thoughts? Thanks.