How many public defenders can refuse to defend due to a conflict of interest?

Yes they can! A conflict of interest is the usual explanation, illness and inability to defend due to excessive case-load are other reasons. Also a public defender can refuse to defend due to issues with the client ie. if they feel threatened or abused they are entitled to walk-away.