Why is establishing justice important purpose of government?

In order to keep the peace in society the government must establish justice. If there is no justice than the people will seek justice of their own which in turn could cause chaos and possibility of over throwing the government.