How do you say ought in past tense?

Ought is already acceptable in past tense.

'Ought to be' is present tense, while 'Ought to have been' or 'Ought to have' is past tense.