What prevented the people from simply ignoring the church and ndoing as they wished?

to navigate where people were supposed to do there work and they were also good and respected the gods so they will learn how to do as they wish and get what they want or what ever they want so that is what i am thinking is that they should not prevent the people from simply ignoring the church and doing as they want and they can do as they wish and will do what ever a lord tell a serfs what to do plus they can not go some where without a lords permissions. that is why i feel bad for people