Can a collection agency refuse to accept a check or money order for payment?

Generally any payment you send will be applied to your account. However if you are trying to send less than what you owe and marking it as "payment in full" or something similar it will more than likely be returned to you.