Do you put a comma after words first secondly?

I would say yes, although I suggest you use the Words First, Second, and Last.