Do you capitalize full stop sign?

No, you do not capitalize the Words "full stop sign." It is typically written in lowercase as "full stop sign."