It's going to add much more complexity for the VFX team. You need to have a VFXSupervisor (or someone who understands the process) onset, and have them sign-off on each setup.
On a show that depends heavily on green screen photography, best practice would have you consider a camera that can shoot 4:2:2; especially if you don't have the budget/experience to light the screen properly.
There are many more items on the todo list for these kinds of shots. As a rule, I won't say it's a "no-no" because I've done many similar shots myself, but only you can decide whether you have the experience, equipment, and team around you to pull this off.