What level of government is responsible for housing?

No government is responsible for housing. There was a agency called HUD that helped low cost housing in states, but it may have been eliminated by Trump. Low cost loans are given to veterans by the GI bill and VHA also gives loans in certain cases. State and local governments are responsible to make sure housing is built following standards and zoning laws are followed.