Do all sentences begin with capital letters or not?

Sentences start with capital letters and end with periods because this is a rule of correct writing and if you follow it, you will be seen as an intelligent and well-educated person by whoever reads what you write.