Can an uninjured pitcher be substituted in the middle of a count?

Yes.

However, rules state a pitcher must pitch one complete at bat before being taken out of the game (unless the pitcher gets injured and cannot continue). So, as long as the batter being pitched to is not the first batter the pitcher is facing, the pitcher may be removed in the middle of the count.