Gear VR: Can I keep a download active while taking the headset off?

I'm making an app that will require the user to download files from time to time, but by design they have to be downloaded inside the app.

I don't want to keep an user waiting for potentially minutes while watching a download progress bar.

Is there any way I can keep the download unaffected by the users taking their headset off?