When Pres is thrown out of office and the VP goes in Who then becomes VP?

There is no Vice-president in that case. That office remains vacant and the duties of the Vice-president to preside over the Senate is then handled by the President pro tempore of the Senate.