Is it correct to say on both counts or both accounts?

The correct phrase is "on both counts." This phrase is commonly used in legal contexts to refer to multiple separate allegations or charges. "On both accounts" is not a standard phrase and may be considered incorrect in formal writing or speech.