EDIT: Here is a dropbox folder with more details and a sample file:
It works! A minor tweak in the code for the scriptjob and it's working nicely. This is what I call version 1, it works like expected (at least how I want it to work), but if you want to change the keyframes etc now that's not going to work without some manual changes. We'll see if I'll give this some thought.
I have no idea if people actually use this, I guess you could just have to pivots that you space-switched between, but I really wanted to make this work without having the user press any extra buttons etc. And it was a fun challenge ;-)
Music: Pretty Lights - Future Blind