If a pitcher catches the ball back from the catcher while in contact with the rubber while a runner is on base is it a balk?

If you fake to an empty base it's a balk. If you attempt to do anything except pitch the ball while on the rubber, it's probably a balk (a particularly sneaky left-handed pitcher may be able to get away with this however).