Curse of the Phantom Shadow - Garage Scene part 2... invisible effects

Curse of the Phantom Shadow is a friends project that i've been doing visual effects for a while now.
This particular shot has alot of issues to surmount.

Several elements needed to be created in 3d - gumballs, and a window.

At first glance, it's a straight forward blue screen removal.
__________________________________________________
As this was the director's first movie, and a VFX heavy movie at that, he didn't quite understand the importance of a proper blue screen.
This blue screen is a lesson in what not to do. Wrinkles galore, hot spots, uneven lighting - it pretty much is unusable. I tried to salvage it However, it was not to be. What is a vfx artist to do, then?
__________________________________________________
Rotoscope it ! - thats just a job i really don't want to do. Thats what the blue screen was supposed to avoid.
However - AI auto rotoscoping is now a thing, and i found a website called runway that did the trick. Also resolve has something called magic mask which is the same thing, unfortunately my laptop with only 3gigs is now incompatible with resolve -a case of my software being written outside the parameters of my hardware. Very big suck on that, but runway was good enough got me about 90% of the way with the roto. Hand doing the magazine and fixing some holes got the final hold out.
finally the clock had to be removed on the left hand of the screen, a simple task using photoshop to clean it out.
__________________________________________________
What made this shot's difficulty level go through the roof was a errant zoom glitch twice in the shot - in the middle and near the end the zoom on the camera reset (automatically got close by a little for 10 frames and then back to original setting) so of course that ruins all the masks when that happens. the choice was to try to make the masks follow the jolting camera bit or get rid of it with stabilization techniques.
__________________________________________________
Using fusion - i'm not sure what happened, i use fusion for a long time and i could not get i to remove this issue. I love fusion but its stabilization features are not the easiest to use for anything short of a track. once you get some rotation in there - well, it takes a while to make it work. I've used it to great effect on 2001 maniacs movie stabilizing a shot so solid i could put the effects in perfectly and then reintroducing the camera move (which is how you put effects into moving shots)
__________________________________________________
Luckily resolve stabilization seems way more advanced than fusions - and within 10 minutes i had it solving the issue lickity split - thats how it should be - not bashing your head against a monitor screen going why wont you work.
Like the A-team says - I love it when a plan comes together.
__________________________________________________