Should a sentence begin with the word with?

Yes, a sentence is allowed to begin with the Word "with".

For example: With all the pressure of high school people were becoming stressed.