Can I take Ativan with 5htp?

I have been taking 5-htp daily for the past 6 months along with 1mg lorazepam when I need it. I usually take the lorazepam an hour or two after my 5-htp dose and have not noticed any negative effects whatsoever. However, I can't say confirm it is 100% safe to do this.